2024-01-17T21:32:57.167 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-17T21:32:57.167 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277 --verbose --name leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/orig.config.yaml 2024-01-17T21:32:57.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-17T21:32:57.282 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} email: null first_in_suite: false job_id: '7519277' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 owner: scheduled_leonidus@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5791 sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbBVX91fPWhWEghfT3/vYO8wim162SMfESdMeAMbx9/dXHCllqg004UB9sL6cF6d4GFju8DsG+UQ2ZEAE0M/qg= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLRieEIZnvYpaO6HMlc5Cf6XrKn7zR3BvvkenFAPRg0SGXfz8POMzwLMBhzj09sKUNTDwP/igCcPggeiyx/BCo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-17_20:20:37 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-17T21:32:57.282 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa; will attempt to use it 2024-01-17T21:32:57.283 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks 2024-01-17T21:32:57.283 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-17T21:32:57.284 INFO:teuthology.task.internal:Checking packages... 2024-01-17T21:32:57.306 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4' 2024-01-17T21:32:57.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-17T21:32:57.307 INFO:teuthology.packaging:ref: None 2024-01-17T21:32:57.307 INFO:teuthology.packaging:tag: None 2024-01-17T21:32:57.307 INFO:teuthology.packaging:branch: main 2024-01-17T21:32:57.307 INFO:teuthology.packaging:sha1: 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T21:32:57.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-01-17T21:32:57.717 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-716-gb5d03370-1jammy 2024-01-17T21:32:57.718 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-17T21:32:57.724 INFO:teuthology.task.internal:no buildpackages task found 2024-01-17T21:32:57.724 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-17T21:32:57.740 INFO:teuthology.task.internal:Saving configuration 2024-01-17T21:32:57.755 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-17T21:32:57.760 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-17T21:32:57.787 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 21:27:14.319617', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGLV8pbSGhadOrrff5QuFL/tiiIuvEBJu7ev3Hb1jWK9'} 2024-01-17T21:32:57.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 21:27:14.318510', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII6Z5fHqyeZXijPVL8LEG+QFta1gIebyXH84rQiED3x2'} 2024-01-17T21:32:57.809 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-17T21:32:57.815 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-17T21:32:57.815 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-17T21:32:57.815 INFO:teuthology.run_tasks:Running task console_log... 2024-01-17T21:32:57.912 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa29f4f0430>, signals=[15]) 2024-01-17T21:32:57.913 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-17T21:32:57.919 INFO:teuthology.task.internal:Opening connections... 2024-01-17T21:32:57.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T21:32:57.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:32:58.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T21:32:58.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:32:58.077 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-17T21:32:58.083 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-01-17T21:32:58.088 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-01-17T21:32:58.089 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="22.04" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=jammy 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-17T21:32:58.135 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=jammy 2024-01-17T21:32:58.136 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-01-17T21:32:58.158 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-01-17T21:32:58.163 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-01-17T21:32:58.163 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="22.04" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=jammy 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-17T21:32:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=jammy 2024-01-17T21:32:58.210 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-17T21:32:58.232 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-17T21:32:58.241 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-17T21:32:58.253 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-17T21:32:58.253 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-01-17T21:32:58.255 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-01-17T21:32:58.260 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-17T21:32:58.266 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-17T21:32:58.266 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-01-17T21:32:58.301 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-01-17T21:32:58.318 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-17T21:32:58.369 INFO:teuthology.run_tasks:Running task kernel... 2024-01-17T21:32:58.385 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-01-17T21:32:58.385 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-01-17T21:32:58.385 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-01-17T21:32:58.386 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T21:32:58.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T21:32:58.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-17T21:32:58.755 DEBUG:teuthology.task.kernel:sha1 for client.0 is 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T21:32:58.756 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "064ffc2b249f42d6c6a333d6e6f3d5392519ee92"... 2024-01-17T21:32:58.756 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-01-17T21:32:58.762 INFO:teuthology.orchestra.run.smithi067.stdout:5.15.0-56-generic 2024-01-17T21:32:58.762 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T21:32:58.762 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-17T21:32:58.763 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-17T21:32:58.763 DEBUG:teuthology.orchestra.run.smithi067:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-17T21:32:58.814 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-17T21:32:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-17T21:32:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-17T21:32:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: git config --global init.defaultBranch 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: 2024-01-17T21:32:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:hint: git branch -m 2024-01-17T21:32:58.969 INFO:teuthology.orchestra.run.smithi067.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-17T21:32:58.970 DEBUG:teuthology.orchestra.run.smithi067:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-17T21:32:59.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-17T21:32:59.093 DEBUG:teuthology.orchestra.run.smithi067:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-17T21:34:15.221 INFO:teuthology.orchestra.run.smithi067.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-17T21:34:15.222 INFO:teuthology.orchestra.run.smithi067.stderr: * [new branch] main -> origin/main 2024-01-17T21:34:15.254 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190312 -> 20190312 2024-01-17T21:34:15.254 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190416 -> 20190416 2024-01-17T21:34:15.254 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190514 -> 20190514 2024-01-17T21:34:15.254 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190618 -> 20190618 2024-01-17T21:34:15.254 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190717 -> 20190717 2024-01-17T21:34:15.255 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190815 -> 20190815 2024-01-17T21:34:15.255 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20190923 -> 20190923 2024-01-17T21:34:15.255 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20191022 -> 20191022 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20191215 -> 20191215 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200122 -> 20200122 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200316 -> 20200316 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200421 -> 20200421 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200519 -> 20200519 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200619 -> 20200619 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200721 -> 20200721 2024-01-17T21:34:15.256 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200817 -> 20200817 2024-01-17T21:34:15.257 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20200918 -> 20200918 2024-01-17T21:34:15.257 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201022 -> 20201022 2024-01-17T21:34:15.257 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201118 -> 20201118 2024-01-17T21:34:15.257 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20201218 -> 20201218 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210208 -> 20210208 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210315 -> 20210315 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210511 -> 20210511 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210716 -> 20210716 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210818 -> 20210818 2024-01-17T21:34:15.258 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20210919 -> 20210919 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20211027 -> 20211027 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20211216 -> 20211216 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220209 -> 20220209 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220310 -> 20220310 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220411 -> 20220411 2024-01-17T21:34:15.259 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220509 -> 20220509 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220610 -> 20220610 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220708 -> 20220708 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220815 -> 20220815 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20220913 -> 20220913 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221012 -> 20221012 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221109 -> 20221109 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20221214 -> 20221214 2024-01-17T21:34:15.261 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230117 -> 20230117 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230210 -> 20230210 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230310 -> 20230310 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230404 -> 20230404 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230515 -> 20230515 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230625 -> 20230625 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230804 -> 20230804 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20230919 -> 20230919 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231030 -> 20231030 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231111 -> 20231111 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20231211 -> 20231211 2024-01-17T21:34:15.262 INFO:teuthology.orchestra.run.smithi067.stderr: * [new tag] 20240115 -> 20240115 2024-01-17T21:34:19.572 INFO:teuthology.orchestra.run.smithi067.stderr:Updating files: 46% (1596/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 62% (2149/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 76% (2613/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 83% (2840/3421) Updating files: 83% (2852/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-01-17T21:34:19.577 INFO:teuthology.orchestra.run.smithi067.stdout:HEAD is now at bf0987d3 Merge branch 'robot/patch-0-1705440424' into 'main' 2024-01-17T21:34:19.600 INFO:teuthology.task.kernel:Downloading kernel 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 on client.0... 2024-01-17T21:34:19.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=064ffc2b249f42d6c6a333d6e6f3d5392519ee92 2024-01-17T21:34:19.824 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/ 2024-01-17T21:34:19.825 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /tmp/linux-image.deb && echo linux-image-6.7.0-g064ffc2b249f_6.7.0-g064ffc2b249f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/ --input-file=- 2024-01-17T21:34:19.828 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi067.front.sepia.ceph.com to complete... 2024-01-17T21:34:21.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17 21:34:21 URL:https://4.chacra.ceph.com/r/kernel/testing/064ffc2b249f42d6c6a333d6e6f3d5392519ee92/ubuntu/jammy/flavors/default/pool/main/l/linux-6.7.0-g064ffc2b249f/linux-image-6.7.0-g064ffc2b249f_6.7.0-g064ffc2b249f-1_amd64.deb [39123014/39123014] -> "/tmp/linux-image.deb" [1] 2024-01-17T21:34:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:FINISHED --2024-01-17 21:34:21-- 2024-01-17T21:34:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:Total wall clock time: 1.7s 2024-01-17T21:34:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:Downloaded: 1 files, 37M in 1.5s (25.0 MB/s) 2024-01-17T21:34:21.545 INFO:teuthology.task.kernel:Installing kernel 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 on client.0... 2024-01-17T21:34:21.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo dpkg -i /tmp/linux-image.deb 2024-01-17T21:34:21.811 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-image-6.7.0-g064ffc2b249f. 2024-01-17T21:34:23.741 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-17T21:34:23.745 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-17T21:34:23.852 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-6.7.0-g064ffc2b249f (6.7.0-g064ffc2b249f-1) ... 2024-01-17T21:34:27.345 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-6.7.0-g064ffc2b249f (6.7.0-g064ffc2b249f-1) ... 2024-01-17T21:34:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:update-initramfs: Generating /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T21:34:48.645 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2024-01-17T21:34:48.651 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-17T21:34:48.672 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-01-17T21:34:48.951 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T21:34:48.967 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T21:34:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-17T21:34:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-17T21:34:49.322 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-17T21:34:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-17T21:34:49.475 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-17T21:34:49.475 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-17T21:34:49.475 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-17T21:34:49.516 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-01-17T21:34:49.680 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-deb -c /tmp/linux-image.deb 2024-01-17T21:34:49.687 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./ 2024-01-17T21:34:49.687 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./boot/ 2024-01-17T21:34:49.687 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4444641 2024-01-17 06:30 ./boot/System.map-6.7.0-g064ffc2b249f 2024-01-17T21:34:49.697 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 170149 2024-01-17 06:30 ./boot/config-6.7.0-g064ffc2b249f 2024-01-17T21:34:49.697 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11441152 2024-01-17 06:30 ./boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T21:34:49.718 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/postinst.d/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/postrm.d/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/preinst.d/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./etc/kernel/prerm.d/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/ 2024-01-17T21:34:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/ 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/ 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/ 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/ 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 490345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-17T21:34:49.720 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 152241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-17T21:34:49.721 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/ 2024-01-17T21:34:49.722 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/ 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/mce/ 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/cpuid.ko 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kernel/msr.ko 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/ 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 353705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-17T21:34:49.723 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 881649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2276625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/arch/x86/kvm/kvm.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/af_alg.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/algif_hash.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/algif_skcipher.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ansi_cprng.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/anubis.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/arc4.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/asymmetric_keys/ 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/ 2024-01-17T21:34:49.847 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_memcpy.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_pq.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_tx.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/async_xor.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/async_tx/raid6test.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/authenc.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/authencesn.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blake2b_generic.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blowfish_common.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/blowfish_generic.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/camellia_generic.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast5_generic.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast6_generic.ko 2024-01-17T21:34:49.848 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cast_common.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/ccm.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cmac.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crc32_generic.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cryptd.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_engine.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_simd.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/crypto_user.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/cts.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/des_generic.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/dh_generic.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/echainiv.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/essiv.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/fcrypt.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/khazad.ko 2024-01-17T21:34:49.849 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lrw.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lz4.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/lz4hc.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/md4.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/michael_mic.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/pcbc.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/pcrypt.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/rmd160.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/seed.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/serpent_generic.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 149481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/tcrypt.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/tea.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/twofish_common.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/twofish_generic.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/vmac.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/wp512.ko 2024-01-17T21:34:49.850 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xcbc.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xor.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xts.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/crypto/xxhash_generic.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/ 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_extlog.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/acpi_pad.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/apei/ 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/apei/einj.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/ec_sys.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/platform_profile.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/sbs.ko 2024-01-17T21:34:49.851 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/sbshc.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/acpi/video.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/acard-ahci.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ahci.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/ahci_platform.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 88401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/libahci.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/libahci_platform.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_acpi.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ali.ko 2024-01-17T21:34:49.852 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_amd.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_artop.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_atiixp.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_atp867x.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cmd640.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cmd64x.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_cypress.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_efar.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt366.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt37x.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_it8213.ko 2024-01-17T21:34:49.853 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_it821x.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_jmicron.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_legacy.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_marvell.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_mpiix.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_netcell.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ninja32.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ns87410.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_ns87415.ko 2024-01-17T21:34:49.854 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_oldpiix.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_opti.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_optidma.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pcmcia.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_piccolo.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_radisys.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_rdc.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_rz1000.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sch.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_serverworks.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sil680.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_sl82c105.ko 2024-01-17T21:34:49.855 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_triflex.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pata_via.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/pdc_adma.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_inic162x.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_mv.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_nv.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_promise.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_qstor.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sil.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sil24.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sis.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_svw.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_sx4.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_uli.ko 2024-01-17T21:34:49.856 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_via.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ata/sata_vsc.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/auxdisplay/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/auxdisplay/ks0108.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/bcma/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/bcma/bcma.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/aoe/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/aoe/aoe.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/drbd/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 965305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/drbd/drbd.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 173353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/floppy.ko 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/mtip32xx/ 2024-01-17T21:34:49.857 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 116321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/nbd.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/null_blk/ 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 110737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/null_blk/null_blk.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/pktcdvd.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/rbd.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/xen-blkback/ 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/zram/ 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/block/zram/zram.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/applicom.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hangcheck-timer.ko 2024-01-17T21:34:49.858 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/ 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/via-rng.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 148609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 139313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/lp.ko 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/mwave/ 2024-01-17T21:34:49.859 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/mwave/mwave.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/nvram.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/ppdev.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tlclk.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/ 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/ 2024-01-17T21:34:49.860 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/ 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-palmas.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-si5351.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-twl6040.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/clk/clk-wm831x.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/ 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-17T21:34:49.861 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 246841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/ccp/ccp.ko 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 517033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-17T21:34:49.862 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/padlock-aes.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/padlock-sha.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/virtio/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dca/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dca/dca.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/dw/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ioat/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/ 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 79953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/amd64_edac.ko 2024-01-17T21:34:49.863 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/e752x_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/edac_mce_amd.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i3000_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i3200_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i5100_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i5400_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i7300_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i7core_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/i82975x_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/ie31200_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/sb_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/edac/x38_edac.ko 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/ 2024-01-17T21:34:49.864 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-gpio.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max14577.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max77693.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-max8997.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-palmas.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/ 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/efi/ 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/ 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-17T21:34:49.865 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-arizona.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-da9052.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-da9055.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-dln2.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-generic.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-ich.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-kempld.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max7300.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max730x.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-max732x.ko 2024-01-17T21:34:49.866 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-sch.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-vx855.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-17T21:34:49.867 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/ 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-a4tech.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-apple.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-appleir.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-aureal.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-axff.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-belkin.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cherry.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-chicony.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cp2112.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-cypress.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-dr.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-elecom.ko 2024-01-17T21:34:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-elo.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-emsff.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ezkey.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gaff.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-generic.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gt683r.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-gyration.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-holtekff.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-hyperv.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-icade.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-kensington.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-keytouch.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-kye.ko 2024-01-17T21:34:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lcpower.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-led.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lenovo.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-lg-g15.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-logitech.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-magicmouse.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-microsoft.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-monterey.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-multitouch.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ntrig.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-ortek.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-penmount.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-petalynx.ko 2024-01-17T21:34:49.870 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-picolcd.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-pl.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-plantronics.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-primax.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-rmi.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-common.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-17T21:34:49.871 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-roccat.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-saitek.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-samsung.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sjoy.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sony.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-speedlink.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-steelseries.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-sunplus.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-tivo.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-tmff.ko 2024-01-17T21:34:49.872 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-topseed.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-twinhan.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-uclogic.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-waltop.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 143473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-wiimote.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-xinmo.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-zpff.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid-zydacron.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 269281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/hid.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/uhid.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/ 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 217873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hid/wacom.ko 2024-01-17T21:34:49.873 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/ 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_balloon.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_utils.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 305321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hv/hv_vmbus.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/abituguru.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/abituguru3.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ad7414.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ad7418.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adc128d818.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1025.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1026.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1029.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm1031.ko 2024-01-17T21:34:49.874 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adm9240.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ads7828.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7410.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7411.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7462.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7470.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7475.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/adt7x10.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/amc6821.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/applesmc.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asb100.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asc7621.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/atxp1.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/coretemp.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-17T21:34:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/dme1737.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ds1621.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ds620.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc1403.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc2103.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/emc6w201.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f71805f.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f71882fg.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/f75375s.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/fam15h_power.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/fschmd.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/g760a.ko 2024-01-17T21:34:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/g762.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/gl518sm.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/gl520sm.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/hih6130.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/i5500_temp.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/i5k_amb.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ibmaem.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ibmpex.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ina209.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ina2xx.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 130449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/it87.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/jc42.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/k10temp.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/k8temp.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lineage-pem.ko 2024-01-17T21:34:49.877 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm63.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm73.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm75.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm77.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm78.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm80.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm83.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm85.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm87.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm90.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm92.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm93.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95234.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95241.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/lm95245.ko 2024-01-17T21:34:49.878 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc2945.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4151.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4215.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4222.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4245.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4260.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/ltc4261.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max16065.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max1619.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max1668.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max197.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6639.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6650.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/max6697.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/mcp3021.ko 2024-01-17T21:34:49.879 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6683.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6775-core.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct6775.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/nct7802.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pc87360.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pc87427.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pcf8591.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-17T21:34:49.880 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/powr1220.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch5627.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch5636.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sht15.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sht21.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/shtc1.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/sis5595.ko 2024-01-17T21:34:49.881 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47b397.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47m1.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/smsc47m192.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/thmc50.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp102.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp103.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp401.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/tmp421.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/via-cputemp.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/via686a.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/vt1211.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/vt8231.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83627ehf.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83627hf.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83781d.ko 2024-01-17T21:34:49.882 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83791d.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83792d.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83793.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83795.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83l785ts.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/w83l786ng.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/ 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/ 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/ 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-17T21:34:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-17T21:34:49.884 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-17T21:34:49.885 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-mux.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-smbus.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/i2c-stub.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/ 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 273609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 883681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_core.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-17T21:34:49.886 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 324329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 282601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 493217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx4/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 420561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx5/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 741449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mthca/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 296881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 153801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/usnic/ 2024-01-17T21:34:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 168969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/iser/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/isert/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 111425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srp/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 128753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srpt/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 129529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/ 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/evbug.ko 2024-01-17T21:34:49.888 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/ff-memless.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/ 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/gameport/gameport.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/joydev.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/ 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-17T21:34:49.889 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lm8323.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/lm8333.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/qt1070.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/qt2160.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/stowaway.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-17T21:34:49.890 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/matrix-keymap.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/ 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/appletouch.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/bcm5974.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/cyapatp.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 335953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/psmouse.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/sermouse.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/rmi4/ 2024-01-17T21:34:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 109873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/altera_ps2.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/arc_ps2.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ct82c710.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/parkbd.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/pcips2.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/ps2mult.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/serio_raw.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/serio/serport.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/input/sparse-keymap.ko 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/ 2024-01-17T21:34:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-88pm860x.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-adp5520.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-bd2802.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-blinkm.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-da903x.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-da9052.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-gpio.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3530.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3533.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm355x.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lm3642.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lp3944.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-lp8788.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-max8997.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-mc13783.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-17T21:34:49.893 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca9532.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca955x.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-pca963x.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-ss4200.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-tca6507.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/leds-wm8350.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-17T21:34:49.894 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/ 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/bcache/ 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 647193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/bcache/bcache.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-bio-prison.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-bufio.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-cache-smq.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 155897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-cache.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-crypt.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-delay.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-era.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-flakey.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-log-userspace.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-log.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-mirror.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-multipath.ko 2024-01-17T21:34:49.895 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-queue-length.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-raid.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-region-hash.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-round-robin.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-service-time.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 109529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-snapshot.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-switch.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 181865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-thin-pool.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-verity.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/dm-zero.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/faulty.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/linear.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/multipath.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/persistent-data/ 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 199937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-17T21:34:49.896 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid0.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid1.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 158657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid10.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 393777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/md/raid456.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/ 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/ 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 178137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptbase.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptctl.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptfc.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptlan.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptsas.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptscsih.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/message/fusion/mptspi.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/ 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm800.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm805.ko 2024-01-17T21:34:49.897 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/88pm80x.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/arizona-i2c.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 123721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/arizona.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/bcm590xx.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/dln2.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/janz-cmodio.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/kempld-core.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lm3533-core.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lp3943.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lpc_ich.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/lpc_sch.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/max8907.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-17T21:34:49.898 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/menf21bmc.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/pcf50633.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/retu-mfd.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/si476x-core.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/sm501.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/tps65010.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/tps6507x.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/viperboard.ko 2024-01-17T21:34:49.899 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/vx855.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/wl1273-core.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/mfd/wm8994.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ad525x_dpot.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/altera-stapl/ 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/apds9802als.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/apds990x.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/bh1770glc.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/ 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/c2port/core.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/cb710/ 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/cb710/cb710.ko 2024-01-17T21:34:49.900 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ds1682.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/dummy-irq.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/echo/ 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/echo/echo.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/ 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/at24.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/eeprom/max6875.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/enclosure.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/genwqe/ 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 152201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/hmc6352.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/hpilo.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ibmasm/ 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-17T21:34:49.901 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ics932s401.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/isl29003.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/isl29020.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/ 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/ 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei-me.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei-txe.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 313641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/mei/mei.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/phantom.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ti-st/ 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tifm_7xx1.ko 2024-01-17T21:34:49.902 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tifm_core.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/tsl2550.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_balloon.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_vmci/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 183609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/bonding/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 490849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/bonding/bonding.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/b53/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 455065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/dummy.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/eql.ko 2024-01-17T21:34:49.903 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/ 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 130553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/ 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/adaptec/ 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/agere/ 2024-01-17T21:34:49.904 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/alteon/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/altera/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-17T21:34:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 90345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 176761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1421529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 128569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 131337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 314553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-17T21:34:49.906 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 323745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 193497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 347257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1044793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 204345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/ 2024-01-17T21:34:49.907 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 141225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/ 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/dnet.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/ 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 281137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ethoc.ko 2024-01-17T21:34:49.908 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fealnx.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fujitsu/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 90369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 295481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 584497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 246209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 937673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 287305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igb/ 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 514569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-17T21:34:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 734353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 151769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/jme.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 727473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 278961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-17T21:34:49.910 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1118201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 95665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/neterion/ 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 150905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-17T21:34:49.911 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/nvidia/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 136721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 227897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 671937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/rdc/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/ 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-17T21:34:49.912 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 192353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sfc/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1064737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/silan/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 63337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/ 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-17T21:34:49.913 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/ 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 487593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/ 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/tehuti/ 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ti/ 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-17T21:34:49.914 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 83793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/xircom/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/defxx.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/skfp/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 216985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/geneve.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/hyperv/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 236225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ieee802154/ 2024-01-17T21:34:49.915 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ifb.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ipvlan/ 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/macvlan.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/macvtap.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/ 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mdio.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/mii.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/netconsole.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/nlmon.ko 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/ 2024-01-17T21:34:49.916 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/ 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/amd.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/bcm87xx.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/broadcom.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/cicada.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/davicom.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/et1011c.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/icplus.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/lxt.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/marvell.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/micrel.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/national.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 95561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/phylink.ko 2024-01-17T21:34:49.917 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/qsemi.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/realtek.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/smsc.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/ste10Xp.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/phy/vitesse.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/plip/ 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/plip/plip.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_async.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pppoe.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pppox.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/ppp/pptp.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/sb1000.ko 2024-01-17T21:34:49.918 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/slip/ 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/slip/slip.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/sungem_phy.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/tap.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/ 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_random.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/veth.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vmxnet3/ 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vxlan/ 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 301281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/vxlan/vxlan.ko 2024-01-17T21:34:49.919 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/xen-netback/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ntb/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ntb/ntb.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 265777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/nvme-core.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/nvme/host/nvme.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 131249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_cs.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_pc.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/parport/parport_serial.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/ 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-17T21:34:49.920 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/pci-stub.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pci/xen-pcifront.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/ 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/i82092.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 146289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/pd6729.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/ 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/broadcom/ 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/samsung/ 2024-01-17T21:34:49.921 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/ 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/intel/ 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/ 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/ 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/ 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-17T21:34:49.922 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/acerhdf.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 132025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/hdaps.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/ 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/intel_ips.ko 2024-01-17T21:34:49.923 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/platform/x86/wmi.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/ 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-17T21:34:49.924 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/da9030_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/da9052-battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/gpio-charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max14577_charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max17042_battery.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max8903_charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/max8925_power.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-17T21:34:49.925 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/sbs-battery.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/test_power.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm831x_power.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/power/supply/wm8350_power.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/ 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/ 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/ 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/clients/pps_parport.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/pps/pps_core.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ptp.ko 2024-01-17T21:34:49.926 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ptp/ptp_kvm.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/ 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9052.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9055.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-da9063.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-17T21:34:49.927 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-em3027.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max6900.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8907.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8925.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8997.ko 2024-01-17T21:34:49.928 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-max8998.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-palmas.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-17T21:34:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/rtc/rtc-x1205.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-9xxx.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-sas.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/3w-xxxx.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 135185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/BusLogic.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/a100u2w.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aacraid/ 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 271113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/advansys.ko 2024-01-17T21:34:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 356929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 296049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic94xx/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 189185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/am53c974.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/arcmsr/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 106881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/atp870u.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/be2iscsi/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 247009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bfa/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1171945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bfa/bfa.ko 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2fc/ 2024-01-17T21:34:49.931 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 237721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2i/ 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 115369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ch.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/csiostor/ 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 308921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/ 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 146625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/dc395x.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/dmx3191d.ko 2024-01-17T21:34:49.932 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esas2r/ 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 212425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/esp_scsi.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/ 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 158505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fdomain.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fnic/ 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 263489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/fnic/fnic.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 201817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hpsa.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hptiop.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/hv_storvsc.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/imm.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/initio.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 266537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ipr.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 101473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ips.ko 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/isci/ 2024-01-17T21:34:49.933 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 317153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/isci/isci.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libfc/ 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 315209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libfc/libfc.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 145585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libiscsi.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libsas/ 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 216441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/libsas/libsas.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/lpfc/ 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2197481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/ 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 310841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/megaraid.ko 2024-01-17T21:34:49.934 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mpt3sas/ 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 659801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvsas/ 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 119561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/mvumi.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/ 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pm8001/ 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 366401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/pmcraid.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ppa.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla1280.ko 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/ 2024-01-17T21:34:49.935 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1876633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla4xxx/ 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 559033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/qlogicfas408.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/raid_class.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 261241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_debug.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 173937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 279313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-17T21:34:50.005 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 97729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/ses.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 115889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/st.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/stex.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 164961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/virtio_scsi.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/wd719x.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/scsi/xen-scsifront.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ssb/ 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 129441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ssb/ssb.ko 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/ 2024-01-17T21:34:50.006 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/iscsi/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 736769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/loopback/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_file.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_iblock.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 930697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_mod.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_pscsi.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/target_core_user.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/tcm_fc/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-17T21:34:50.007 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-17T21:34:50.008 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ipwireless/ 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/moxa.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 50953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/mxser.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/n_gsm.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/n_hdlc.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/nozomi.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/ 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/ 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/altera_uart.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/arc_uart.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-17T21:34:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/jsm/ 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/rp2.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/ 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/core/ 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 535985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/ 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_aec.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_cif.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_mf624.ko 2024-01-17T21:34:50.010 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_netx.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_pci_generic.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/uio/uio_sercos3.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/ 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/c67x00/ 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 144617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/ 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/cdc-acm.ko 2024-01-17T21:34:50.011 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/usblp.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/class/usbtmc.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/common/ 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/common/ulpi.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc2/ 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/ 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 454385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/ 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/ 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-17T21:34:50.012 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 92489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 122081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 57729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 85609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-17T21:34:50.013 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/ 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 62361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-17T21:34:50.014 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 161225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/ 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 157681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 69705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 76057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 75073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 73169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 65809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-17T21:34:50.015 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 156409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/ 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 87353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/sl811_cs.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/ 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/mdc800.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/image/microtek.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/adutux.ko 2024-01-17T21:34:50.016 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/appledisplay.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/cytherm.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ehset.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/emi26.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/emi62.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ezusb.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/idmouse.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/iowarrior.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/ldusb.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/legousbtower.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/lvstest.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/sisusbvga/ 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-17T21:34:50.017 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usb3503.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usblcd.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/usbtest.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/uss720.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/misc/yurex.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/mon/ 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/mon/usbmon.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/musb/ 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 301697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/ 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-generic.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-17T21:34:50.018 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/aircable.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ark3116.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ch341.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cp210x.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cyberjack.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/empeg.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/f81232.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 175193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 137081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/io_ti.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ipaq.ko 2024-01-17T21:34:50.019 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ipw.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ir-usb.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 107521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/keyspan.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mct_u232.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/metro-usb.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mos7720.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 78217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mos7840.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/mxuport.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/navman.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/omninet.ko 2024-01-17T21:34:50.020 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/opticon.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 191801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/option.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/oti6858.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/pl2303.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/qcaux.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/qcserial.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/quatech2.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/safe_serial.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 51625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/sierra.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ssu100.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/symbolserial.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb_debug.ko 2024-01-17T21:34:50.021 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33201 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/usbserial.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/visor.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/whiteheat.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 52913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/uas.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-17T21:34:50.022 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-karma.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 180225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/storage/usb-storage.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/ 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 67481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/ 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/ 2024-01-17T21:34:50.023 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 154297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/vfio.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 77609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/ 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_net.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/vhost/vhost_scsi.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/ 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/ 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-17T21:34:50.024 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/apple_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/bd6107.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lcd.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-17T21:34:50.025 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/ 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ds2482.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/ds2490.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/ 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-17T21:34:50.026 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/w1/wire.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/acquirewdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/advantechwdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/dw_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-17T21:34:50.027 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/hpwdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/i6300esb.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ib700wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ibmasr.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/it87_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/machzwd.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/nv_tco.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-17T21:34:50.028 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/retu_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/softdog.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/via_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-17T21:34:50.029 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wdt_pci.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/watchdog/xen_wdt.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/ 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-evtchn.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-gntalloc.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-gntdev.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-pciback/ 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 176441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-privcmd.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 71249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xen-scsiback.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xenfs/ 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ 2024-01-17T21:34:50.030 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/9p/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 166753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/9p/9p.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/adfs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/adfs/adfs.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/affs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 163449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/affs/affs.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/afs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 935033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/afs/kafs.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/autofs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 103401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/autofs/autofs4.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/befs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 64681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/befs/befs.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/bfs/ 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/bfs/bfs.ko 2024-01-17T21:34:50.031 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/binfmt_misc.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/btrfs/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 3455857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/btrfs/btrfs.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cachefiles/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 306009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cachefiles/cachefiles.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ceph/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1336985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ceph/ceph.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/coda/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/coda/coda.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/configfs/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/configfs/configfs.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cramfs/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/cramfs/cramfs.ko 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/dlm/ 2024-01-17T21:34:50.032 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 644073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/dlm/dlm.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/efs/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/efs/efs.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/f2fs/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1506641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/f2fs/f2fs.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fat/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fat/msdos.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/freevxfs/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/freevxfs/freevxfs.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fscache/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 226481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fscache/fscache.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fuse/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/fuse/cuse.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/gfs2/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1229913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/gfs2/gfs2.ko 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfs/ 2024-01-17T21:34:50.033 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 141985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfs/hfs.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfsplus/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 223225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hfsplus/hfsplus.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hpfs/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 193569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/hpfs/hpfs.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/isofs/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/isofs/isofs.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/jfs/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 419881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/jfs/jfs.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/lockd/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 282049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/lockd/lockd.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/minix/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/minix/minix.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/netfs/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 124649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/netfs/netfs.ko 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/blocklayout/ 2024-01-17T21:34:50.034 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 81513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/filelayout/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/flexfilelayout/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 117465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1057969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfs.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv2.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 120265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv3.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2042153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs/nfsv4.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/grace.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfs_common/nfs_acl.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfsd/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1563929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nfsd/nfsd.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nilfs2/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 590713 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nilfs2/nilfs2.ko 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/ 2024-01-17T21:34:50.035 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-celtic.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-centeuro.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-croatian.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-cyrillic.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-gaelic.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-greek.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-iceland.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-inuit.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-roman.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-romanian.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13793 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/mac-turkish.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_ascii.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1250.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1251.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp1255.ko 2024-01-17T21:34:50.036 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp737.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp775.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp850.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp852.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp855.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp857.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp860.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp861.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp862.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp863.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp864.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp865.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp866.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp869.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp874.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 94137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp932.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 142673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp936.ko 2024-01-17T21:34:50.037 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 165745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp949.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_cp950.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_euc-jp.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-1.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-13.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-14.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-15.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-2.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-3.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-4.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-5.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-6.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-7.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_iso8859-9.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-r.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-ru.ko 2024-01-17T21:34:50.038 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_koi8-u.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/nls/nls_utf8.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ntfs/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 220553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ntfs/ntfs.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/cluster/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 244737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlm/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 440737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlmfs/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2593521 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/omfs/ 2024-01-17T21:34:50.039 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/omfs/omfs.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/overlayfs/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 370697 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/overlayfs/overlay.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/pstore/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/pstore/ramoops.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx4/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx4/qnx4.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx6/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 46689 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/qnx6/qnx6.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_tree.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_v1.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/quota/quota_v2.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/reiserfs/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 532025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/reiserfs/reiserfs.ko 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/romfs/ 2024-01-17T21:34:50.040 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/romfs/romfs.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/client/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 2683249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/client/cifs.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/cifs_arc4.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/smb/common/cifs_md4.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/squashfs/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 134777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/squashfs/squashfs.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/sysv/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 91249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/sysv/sysv.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/udf/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 248425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/udf/udf.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ufs/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 162537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/ufs/ufs.ko 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/xfs/ 2024-01-17T21:34:50.041 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4014433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/fs/xfs/xfs.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/ 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/locking/ 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/locking/locktorture.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/time/ 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/time/test_udelay.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/kernel/torture.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6833 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc-itu-t.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc7.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crc8.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/ 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/libarc4.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/crypto/libdes.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/interval_tree_test.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/libcrc32c.ko 2024-01-17T21:34:50.042 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lru_cache.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/ 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/lz4_compress.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/lz4/lz4hc_compress.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/math/ 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/math/cordic.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/memory-notifier-error-inject.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/notifier-error-inject.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/percpu_test.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/pm-notifier-error-inject.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/raid6/ 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 143353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/raid6/raid6_pq.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/rbtree_test.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/reed_solomon/ 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test-kstrtox.ko 2024-01-17T21:34:50.043 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test-string_helpers.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 4876633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_bpf.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_firmware.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_module.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/test_user_copy.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_bm.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_fsm.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/ts_kmp.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/xz/ 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/lib/xz/xz_dec_test.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/mm/ 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/mm/hwpoison-inject.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/ 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 55737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/6lowpan.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_dest.ko 2024-01-17T21:34:50.044 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_fragment.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_hop.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 6985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_mobility.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_routing.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/6lowpan/nhc_udp.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/ 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/garp.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/mrp.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/p8022.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/psnap.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/802/stp.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/8021q/ 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 82593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/8021q/8021q.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/ 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 198905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet.ko 2024-01-17T21:34:50.045 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_fd.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_rdma.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/9p/9pnet_virtio.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/batman-adv/ 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 649977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/batman-adv/batman-adv.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/ 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 65137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/br_netfilter.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 785817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/bridge.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9145 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-17T21:34:50.046 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13217 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9593 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11641 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 56033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/ebtables.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ceph/ 2024-01-17T21:34:50.047 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1046969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ceph/libceph.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/core/ 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 126041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/core/pktgen.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/ 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 194529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_diag.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 58841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_ipv4.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 60873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dccp/dccp_ipv6.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/ 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 390129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/dsa_core.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_brcm.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_dsa.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7721 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_none.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/dsa/tag_trailer.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/hsr/ 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 99881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/hsr/hsr.ko 2024-01-17T21:34:50.048 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/6lowpan/ 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 45537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 255849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ieee802154.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 47985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ah4.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/esp4.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/fou.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/gre.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/inet_diag.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_gre.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_tunnel.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ip_vti.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ipcomp.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 29001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/ipip.ko 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ 2024-01-17T21:34:50.049 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 41929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-17T21:34:50.050 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_bic.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_dctcp.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_diag.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_highspeed.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_htcp.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_hybla.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_illinois.ko 2024-01-17T21:34:50.051 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_lp.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_scalable.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_vegas.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_veno.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_westwood.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tcp_yeah.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/tunnel4.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/udp_diag.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/udp_tunnel.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11361 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ah6.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39705 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/esp6.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/fou6.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 80105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_gre.ko 2024-01-17T21:34:50.052 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 93977 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_tunnel.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ip6_vti.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/ipcomp6.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/mip6.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14137 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14273 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-17T21:34:50.053 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25225 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 74921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/sit.ko 2024-01-17T21:34:50.054 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/tunnel6.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/key/ 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 84433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/key/af_key.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/ 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125305 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_core.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 25953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_eth.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ip.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ip6.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_netlink.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 53321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/l2tp/l2tp_ppp.ko 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/lapb/ 2024-01-17T21:34:50.055 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48121 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/lapb/lapb.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/ 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/llc.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 268265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/llc/llc2.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mac802154/ 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 290441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mac802154/mac802154.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mpls/ 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9393 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/mpls/mpls_gso.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 100633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-17T21:34:50.056 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 102649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 59585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 110753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 113633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 412561 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-17T21:34:50.057 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49265 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conncount.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 411489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 118193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-17T21:34:50.058 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 108105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11233 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10113 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 91737 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_flow_table.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 37297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_log_syslog.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 96545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10129 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_irc.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_sip.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-17T21:34:50.059 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 44297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 614025 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nf_tables.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 42609 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 39785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_log.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_chain_nat.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_compat.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_ct.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9601 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11513 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_fib.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_hash.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_limit.ko 2024-01-17T21:34:50.060 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_log.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_masq.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_nat.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13673 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_numgen.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_osf.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_queue.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_redir.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_reject.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10081 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_reject_inet.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_socket.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_synproxy.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/nft_tproxy.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 89313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/x_tables.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_AUDIT.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-17T21:34:50.061 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 18169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_CT.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_DSCP.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_HL.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13369 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_HMARK.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 38873 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13889 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_LED.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_LOG.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11753 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NETMAP.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NFLOG.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-17T21:34:50.062 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_RATEEST.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11073 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14337 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_SECMARK.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10433 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TEE.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TPROXY.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8321 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_TRACE.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13193 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_addrtype.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_bpf.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cgroup.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cluster.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_comment.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connbytes.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connlabel.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connlimit.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_connmark.ko 2024-01-17T21:34:50.063 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_conntrack.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_cpu.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10969 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_dccp.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_devgroup.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8801 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_dscp.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10657 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ecn.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_esp.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_hashlimit.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_helper.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7865 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_hl.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11921 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ipcomp.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_iprange.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11785 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_ipvs.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_l2tp.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8001 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_length.ko 2024-01-17T21:34:50.064 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10209 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_limit.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_mac.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_mark.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11825 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_multiport.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_nat.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10105 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_nfacct.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_osf.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_owner.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9729 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_physdev.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7633 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_pkttype.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11985 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_policy.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_quota.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_rateest.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8257 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_realm.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36457 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_recent.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13329 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_sctp.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_set.ko 2024-01-17T21:34:50.065 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16913 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_socket.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9505 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_state.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9473 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_statistic.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8809 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_string.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 8553 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_tcpmss.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_tcpudp.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11065 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_time.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netfilter/xt_u32.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netlink/ 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 14537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/netlink/netlink_diag.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/nsh/ 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 12425 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/nsh/nsh.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/ 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 383481 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/openvswitch.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-geneve.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9585 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-gre.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11929 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/openvswitch/vport-vxlan.ko 2024-01-17T21:34:50.066 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/packet/ 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13569 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/packet/af_packet_diag.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/ 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 112057 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/phonet.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54857 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/phonet/pn_pep.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/ 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 252953 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 164937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds_rdma.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rds/rds_tcp.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rxrpc/ 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 818777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/rxrpc/rxrpc.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/ 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32241 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_csum.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_gact.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_ipt.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34097 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_mirred.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23401 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_nat.ko 2024-01-17T21:34:50.067 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 43449 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_pedit.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31961 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_police.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20289 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_simple.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35297 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_skbedit.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36665 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/act_vlan.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26465 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_basic.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34353 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_bpf.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 19281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_cgroup.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_flow.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 32377 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_fw.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 40009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_route.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 61529 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/cls_u32.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7441 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_cmp.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 13409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_ipset.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33313 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_meta.ko 2024-01-17T21:34:50.068 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7897 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_nbyte.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_text.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/em_u32.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 21769 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_choke.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20849 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_codel.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 34681 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_drr.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35817 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_fq.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31617 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_fq_codel.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 35545 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_gred.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 49937 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_hfsc.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 22089 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_hhf.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 66577 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_htb.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_ingress.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 30385 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_mqprio.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10905 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_mqprio_lib.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26185 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_multiq.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 36249 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_netem.ko 2024-01-17T21:34:50.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 27497 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_pie.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10745 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_plug.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 24841 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_prio.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 48625 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_qfq.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 33017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_red.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 26881 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_sfb.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 31409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_sfq.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28945 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_tbf.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 28153 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sched/sch_teql.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/ 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 932169 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/sctp.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sctp/sctp_diag.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/ 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/ 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 336777 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 54993 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-17T21:34:50.070 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 1518417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/sunrpc.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/xprtrdma/ 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 708281 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/ 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 10489 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/diag.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 866345 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/tipc/tipc.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/unix/ 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 16033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/unix/unix_diag.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/ 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 86417 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 68049 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 98017 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 11177 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 17761 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/x25/ 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 125409 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/x25/x25.ko 2024-01-17T21:34:50.071 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/ 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23041 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_algo.ko 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 20649 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 104161 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/net/xfrm/xfrm_user.ko 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/ 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/lib/ 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 15537 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/kernel/virt/lib/irqbypass.ko 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 641009 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.alias 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 625033 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.alias.bin 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 7677 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 23634 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.alias.bin 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 9916 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.bin 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 70653 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.builtin.modinfo 2024-01-17T21:34:50.072 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 147734 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.dep 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 234045 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.dep.bin 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 210 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.devname 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 72797 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.order 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 879 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.softdep 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 255175 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.symbols 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 309826 2024-01-17 06:30 ./lib/modules/6.7.0-g064ffc2b249f/modules.symbols.bin 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/ 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/ 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/doc/ 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x root/root 0 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/ 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 171 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/changelog.Debian.gz 2024-01-17T21:34:50.073 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r-- root/root 691 2024-01-17 06:30 ./usr/share/doc/linux-image-6.7.0-g064ffc2b249f/copyright 2024-01-17T21:34:50.074 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g064ffc2b249f 2024-01-17T21:34:50.074 INFO:teuthology.task.kernel:searching for kernel 6.7.0-g064ffc2b249f 2024-01-17T21:34:50.074 DEBUG:teuthology.orchestra.run.smithi067:> egrep '(submenu|menuentry.*6.7.0-g064ffc2b249f).*{' /boot/grub/grub.cfg 2024-01-17T21:34:50.080 INFO:teuthology.orchestra.run.smithi067.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T21:34:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g064ffc2b249f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g064ffc2b249f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T21:34:50.081 INFO:teuthology.orchestra.run.smithi067.stdout: menuentry 'Ubuntu, with Linux 6.7.0-g064ffc2b249f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.7.0-g064ffc2b249f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-17T21:34:50.081 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-17T21:34:50.081 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.7.0-g064ffc2b249f 2024-01-17T21:34:50.081 DEBUG:teuthology.orchestra.run.smithi067:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-17T21:34:50.123 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi067.front.sepia.ceph.com to complete... 2024-01-17T21:34:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2024-01-17T21:34:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-17T21:34:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-01-17T21:34:50.696 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-6.7.0-g064ffc2b249f 2024-01-17T21:34:50.702 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-6.7.0-g064ffc2b249f 2024-01-17T21:34:50.939 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-17T21:34:50.944 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-17T21:34:50.986 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-17T21:34:50.991 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-17T21:34:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-17T21:34:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-17T21:34:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-17T21:34:51.165 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-01-17T21:34:52.306 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-01-17T21:35:22.308 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-17T21:35:22.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:35:22.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:35:56.988 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-17T21:36:05.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:36:05.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:36:37.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-01-17T21:36:49.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:36:49.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:36:49.649 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-17T21:36:50.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:36:50.349 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g064ffc2b249f"... 2024-01-17T21:36:50.349 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-01-17T21:36:50.398 INFO:teuthology.orchestra.run.smithi067.stdout:6.7.0-g064ffc2b249f 2024-01-17T21:36:50.398 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g064ffc2b249f vs 6.7.0-g064ffc2b249f 2024-01-17T21:36:50.398 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-17T21:36:50.398 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-17T21:36:51.402 DEBUG:teuthology.parallel:result is None 2024-01-17T21:36:51.403 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-17T21:36:51.410 INFO:teuthology.task.internal:Creating test directory... 2024-01-17T21:36:51.411 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T21:36:51.415 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-17T21:36:51.421 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-17T21:36:51.429 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-17T21:36:51.436 INFO:teuthology.task.internal:Creating archive directory... 2024-01-17T21:36:51.436 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T21:36:51.464 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-17T21:36:51.490 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-17T21:36:51.497 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-17T21:36:51.497 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-17T21:36:51.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T21:36:51.532 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T21:36:51.536 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-17T21:36:51.598 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T21:36:51.618 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T21:36:51.620 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T21:36:51.644 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-17T21:36:51.646 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-17T21:36:51.654 INFO:teuthology.task.internal:Configuring sudo... 2024-01-17T21:36:51.654 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T21:36:51.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-17T21:36:51.676 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-17T21:36:51.686 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-17T21:36:51.687 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T21:36:51.721 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-17T21:36:51.727 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T21:36:51.778 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T21:36:51.830 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T21:36:51.830 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T21:36:51.905 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-17T21:36:51.911 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-17T21:36:51.962 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T21:36:51.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-17T21:36:52.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-01-17T21:36:52.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-01-17T21:36:52.127 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-17T21:36:52.135 INFO:teuthology.task.internal:Starting timer... 2024-01-17T21:36:52.136 INFO:teuthology.run_tasks:Running task pcp... 2024-01-17T21:36:52.146 INFO:teuthology.run_tasks:Running task selinux... 2024-01-17T21:36:52.155 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2024-01-17T21:36:52.156 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-01-17T21:36:52.156 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-17T21:36:52.156 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-17T21:36:52.156 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-17T21:36:52.156 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-17T21:36:52.166 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-17T21:36:52.177 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-17T21:36:52.337 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-17T21:36:52.352 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-17T21:36:52.353 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-17T21:44:09.574 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-01-17T21:44:09.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:44:09.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:44:09.659 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-01-17T21:44:09.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-01-17T21:44:09.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T21:44:09.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-17T21:44:09.886 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-01-17T21:44:10.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-17T21:44:10.004 INFO:teuthology.run_tasks:Running task clock... 2024-01-17T21:44:10.015 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-17T21:44:10.016 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T21:44:10.016 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T21:44:10.019 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-17T21:44:10.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Command line: ntpd -gq 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: ---------------------------------------------------- 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: ntp-4 is maintained by Network Time Foundation, 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: corporation. Support and training for ntp-4 are 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: available at https://www.nwtime.org/support 2024-01-17T21:44:10.056 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: ---------------------------------------------------- 2024-01-17T21:44:10.057 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: proto: precision = 0.044 usec (-24) 2024-01-17T21:44:10.057 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: basedate set to 2022-02-04 2024-01-17T21:44:10.057 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: gps base set to 2022-02-06 (week 2196) 2024-01-17T21:44:10.057 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T21:44:10.058 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T21:44:10.058 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: restrict ::: KOD does nothing without LIMITED. 2024-01-17T21:44:10.058 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-17T21:44:10.058 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen and drop on 0 v6wildcard [::]:123 2024-01-17T21:44:10.058 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-17T21:44:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen normally on 2 lo 127.0.0.1:123 2024-01-17T21:44:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2024-01-17T21:44:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen normally on 4 lo [::1]:123 2024-01-17T21:44:10.059 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2024-01-17T21:44:10.060 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:10 ntpd[16838]: Listening on routing socket on fd #22 for interface updates 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Command line: ntpd -gq 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: ---------------------------------------------------- 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: ntp-4 is maintained by Network Time Foundation, 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: corporation. Support and training for ntp-4 are 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: available at https://www.nwtime.org/support 2024-01-17T21:44:10.080 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: ---------------------------------------------------- 2024-01-17T21:44:10.081 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: proto: precision = 0.058 usec (-24) 2024-01-17T21:44:10.081 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: basedate set to 2022-02-04 2024-01-17T21:44:10.081 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: gps base set to 2022-02-06 (week 2196) 2024-01-17T21:44:10.081 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T21:44:10.081 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-17T21:44:10.082 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: restrict ::: KOD does nothing without LIMITED. 2024-01-17T21:44:10.082 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen and drop on 0 v6wildcard [::]:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen normally on 2 lo 127.0.0.1:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen normally on 4 lo [::1]:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-01-17T21:44:10.083 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:10 ntpd[17327]: Listening on routing socket on fd #22 for interface updates 2024-01-17T21:44:11.056 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:11 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:11 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:11 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:13.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:13.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:13.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:13 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:14.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:14.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:14 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:14.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:14.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:14.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:14.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:14.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:14.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:14 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:15.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:15 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:15 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:16.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:16.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:16.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:16.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:16.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:16.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:16 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:16.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:16.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:16.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:16.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:16.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:16.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:16 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:17.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:17.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:17 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stdout:17 Jan 21:44:17 ntpd[17327]: ntpd: time slew -0.001443 s 2024-01-17T21:44:17.081 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew -0.001443s 2024-01-17T21:44:17.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-17T21:44:17.082 INFO:teuthology.orchestra.run.smithi137.stderr:17 Jan 21:44:17 ntpd[17327]: can't open /var/log/ntpstats/loopstats.20240117: Permission denied 2024-01-17T21:44:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-01-17T21:44:17.191 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-01-17T21:44:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:17.191 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:17.192 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:18 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:19.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:19.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:19.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:19.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:19.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:19.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:19.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:19 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-17T21:44:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: can't open /var/log/ntpstats/rawstats.20240117: Permission denied 2024-01-17T21:44:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-17T21:44:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: can't open /var/log/ntpstats/peerstats.20240117: Permission denied 2024-01-17T21:44:20.058 INFO:teuthology.orchestra.run.smithi067.stdout:17 Jan 21:44:20 ntpd[16838]: ntpd: time slew -0.005581 s 2024-01-17T21:44:20.058 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.005581s 2024-01-17T21:44:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-17T21:44:20.059 INFO:teuthology.orchestra.run.smithi067.stderr:17 Jan 21:44:20 ntpd[16838]: can't open /var/log/ntpstats/loopstats.20240117: Permission denied 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:20.169 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-17T21:44:20.172 INFO:teuthology.run_tasks:Running task install... 2024-01-17T21:44:20.182 DEBUG:teuthology.task.install:project ceph 2024-01-17T21:44:20.182 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}} 2024-01-17T21:44:20.182 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'} 2024-01-17T21:44:20.182 INFO:teuthology.task.install:Using flavor: default 2024-01-17T21:44:20.188 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-17T21:44:20.189 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-17T21:44:20.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2024-01-17T21:44:20.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-01-17T21:44:20.255 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-17T21:44:20.285 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-17T21:44:20.285 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-01-17T21:44:20.285 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-17T21:44:20.285 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-17T21:44:20.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T21:44:20.321 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-17T21:44:20.373 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-17T21:44:20.373 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2024-01-17T21:44:20.375 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-17T21:44:20.375 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-17T21:44:20.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T21:44:20.541 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default/ 2024-01-17T21:44:20.542 INFO:teuthology.task.install.deb:Package version is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T21:44:20.592 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default/ 2024-01-17T21:44:20.592 INFO:teuthology.task.install.deb:Package version is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T21:44:20.949 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T21:44:20.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-17T21:44:20.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-01-17T21:44:21.019 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T21:44:21.019 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-17T21:44:21.040 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2024-01-17T21:44:21.134 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-17T21:44:21.239 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-17T21:44:21.240 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-17T21:44:21.248 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-17T21:44:21.251 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-17T21:44:21.268 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-17T21:44:21.333 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-17T21:44:21.415 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-17T21:44:21.429 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy InRelease 2024-01-17T21:44:21.510 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-17T21:44:21.518 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy InRelease 2024-01-17T21:44:21.588 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-17T21:44:21.597 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-17T21:44:21.669 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-01-17T21:44:21.679 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-17T21:44:21.765 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-01-17T21:44:21.765 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-01-17T21:44:21.863 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 28.8 kB in 1s (41.2 kB/s) 2024-01-17T21:44:21.948 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-01-17T21:44:22.059 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 28.8 kB in 1s (36.7 kB/s) 2024-01-17T21:44:22.803 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-01-17T21:44:22.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-653-g1ec1182e-1jammy cephadm=19.0.0-653-g1ec1182e-1jammy ceph-mds=19.0.0-653-g1ec1182e-1jammy ceph-mgr=19.0.0-653-g1ec1182e-1jammy ceph-common=19.0.0-653-g1ec1182e-1jammy ceph-fuse=19.0.0-653-g1ec1182e-1jammy ceph-test=19.0.0-653-g1ec1182e-1jammy ceph-volume=19.0.0-653-g1ec1182e-1jammy radosgw=19.0.0-653-g1ec1182e-1jammy python3-rados=19.0.0-653-g1ec1182e-1jammy python3-rgw=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy python3-rbd=19.0.0-653-g1ec1182e-1jammy libcephfs2=19.0.0-653-g1ec1182e-1jammy libcephfs-dev=19.0.0-653-g1ec1182e-1jammy librados2=19.0.0-653-g1ec1182e-1jammy librbd1=19.0.0-653-g1ec1182e-1jammy rbd-fuse=19.0.0-653-g1ec1182e-1jammy ceph-common-dbg=19.0.0-653-g1ec1182e-1jammy ceph-fuse-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mds-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mgr-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mon-dbg=19.0.0-653-g1ec1182e-1jammy ceph-osd-dbg=19.0.0-653-g1ec1182e-1jammy ceph-test-dbg=19.0.0-653-g1ec1182e-1jammy libcephfs2-dbg=19.0.0-653-g1ec1182e-1jammy librados2-dbg=19.0.0-653-g1ec1182e-1jammy libradosstriper1-dbg=19.0.0-653-g1ec1182e-1jammy librbd1-dbg=19.0.0-653-g1ec1182e-1jammy librgw2-dbg=19.0.0-653-g1ec1182e-1jammy radosgw-dbg=19.0.0-653-g1ec1182e-1jammy rbd-fuse-dbg=19.0.0-653-g1ec1182e-1jammy rbd-mirror-dbg=19.0.0-653-g1ec1182e-1jammy rbd-nbd-dbg=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy cephfs-shell=19.0.0-653-g1ec1182e-1jammy cephfs-top=19.0.0-653-g1ec1182e-1jammy cephfs-mirror=19.0.0-653-g1ec1182e-1jammy 2024-01-17T21:44:22.869 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-01-17T21:44:23.018 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-17T21:44:23.033 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-653-g1ec1182e-1jammy cephadm=19.0.0-653-g1ec1182e-1jammy ceph-mds=19.0.0-653-g1ec1182e-1jammy ceph-mgr=19.0.0-653-g1ec1182e-1jammy ceph-common=19.0.0-653-g1ec1182e-1jammy ceph-fuse=19.0.0-653-g1ec1182e-1jammy ceph-test=19.0.0-653-g1ec1182e-1jammy ceph-volume=19.0.0-653-g1ec1182e-1jammy radosgw=19.0.0-653-g1ec1182e-1jammy python3-rados=19.0.0-653-g1ec1182e-1jammy python3-rgw=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy python3-rbd=19.0.0-653-g1ec1182e-1jammy libcephfs2=19.0.0-653-g1ec1182e-1jammy libcephfs-dev=19.0.0-653-g1ec1182e-1jammy librados2=19.0.0-653-g1ec1182e-1jammy librbd1=19.0.0-653-g1ec1182e-1jammy rbd-fuse=19.0.0-653-g1ec1182e-1jammy ceph-common-dbg=19.0.0-653-g1ec1182e-1jammy ceph-fuse-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mds-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mgr-dbg=19.0.0-653-g1ec1182e-1jammy ceph-mon-dbg=19.0.0-653-g1ec1182e-1jammy ceph-osd-dbg=19.0.0-653-g1ec1182e-1jammy ceph-test-dbg=19.0.0-653-g1ec1182e-1jammy libcephfs2-dbg=19.0.0-653-g1ec1182e-1jammy librados2-dbg=19.0.0-653-g1ec1182e-1jammy libradosstriper1-dbg=19.0.0-653-g1ec1182e-1jammy librbd1-dbg=19.0.0-653-g1ec1182e-1jammy librgw2-dbg=19.0.0-653-g1ec1182e-1jammy radosgw-dbg=19.0.0-653-g1ec1182e-1jammy rbd-fuse-dbg=19.0.0-653-g1ec1182e-1jammy rbd-mirror-dbg=19.0.0-653-g1ec1182e-1jammy rbd-nbd-dbg=19.0.0-653-g1ec1182e-1jammy python3-cephfs=19.0.0-653-g1ec1182e-1jammy cephfs-shell=19.0.0-653-g1ec1182e-1jammy cephfs-top=19.0.0-653-g1ec1182e-1jammy cephfs-mirror=19.0.0-653-g1ec1182e-1jammy 2024-01-17T21:44:23.035 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-01-17T21:44:23.037 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-01-17T21:44:23.109 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-17T21:44:23.188 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T21:44:23.188 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T21:44:23.188 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T21:44:23.189 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T21:44:23.189 INFO:teuthology.orchestra.run.smithi137.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-17T21:44:23.189 INFO:teuthology.orchestra.run.smithi137.stdout: python2.7-minimal 2024-01-17T21:44:23.189 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-17T21:44:23.191 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-17T21:44:23.192 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-17T21:44:23.193 INFO:teuthology.orchestra.run.smithi137.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-01-17T21:44:23.194 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-01-17T21:44:23.280 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-01-17T21:44:23.281 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-17T21:44:23.321 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-17T21:44:23.322 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-17T21:44:23.323 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-17T21:44:23.384 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 142 newly installed, 0 to remove and 269 not upgraded. 2024-01-17T21:44:23.384 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 3,638 MB of archives. 2024-01-17T21:44:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 4,427 MB of additional disk space will be used. 2024-01-17T21:44:23.385 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-17T21:44:23.405 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-17T21:44:23.416 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-17T21:44:23.443 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T21:44:23.443 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T21:44:23.443 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T21:44:23.443 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T21:44:23.443 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-17T21:44:23.445 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-17T21:44:23.446 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-17T21:44:23.447 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-01-17T21:44:23.448 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2024-01-17T21:44:23.449 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2024-01-17T21:44:23.465 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-17T21:44:23.490 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-17T21:44:23.493 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-17T21:44:23.507 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-17T21:44:23.558 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-17T21:44:23.562 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-17T21:44:23.573 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-17T21:44:23.577 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-17T21:44:23.578 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-17T21:44:23.586 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-17T21:44:23.588 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-17T21:44:23.590 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-17T21:44:23.591 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-17T21:44:23.592 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-17T21:44:23.603 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-17T21:44:23.605 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-17T21:44:23.607 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-17T21:44:23.607 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-17T21:44:23.623 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-17T21:44:23.625 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-17T21:44:23.625 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-17T21:44:23.625 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-17T21:44:23.626 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-17T21:44:23.626 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-01-17T21:44:23.635 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-17T21:44:23.636 INFO:teuthology.orchestra.run.smithi067.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-01-17T21:44:23.637 INFO:teuthology.orchestra.run.smithi067.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-01-17T21:44:23.638 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-01-17T21:44:23.644 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-17T21:44:23.644 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-17T21:44:23.646 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-17T21:44:23.647 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-17T21:44:23.664 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-17T21:44:23.665 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-17T21:44:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-17T21:44:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-17T21:44:23.666 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-17T21:44:23.667 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-17T21:44:23.684 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-17T21:44:23.685 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-17T21:44:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-17T21:44:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-17T21:44:23.705 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-17T21:44:23.706 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-17T21:44:23.707 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-17T21:44:23.709 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-17T21:44:23.709 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-17T21:44:23.711 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-17T21:44:23.725 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-17T21:44:23.728 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-17T21:44:23.728 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-17T21:44:23.729 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-17T21:44:23.746 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-17T21:44:23.800 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-17T21:44:23.801 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-17T21:44:23.802 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-17T21:44:23.803 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-17T21:44:23.803 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-17T21:44:23.824 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-17T21:44:23.826 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-17T21:44:23.826 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-17T21:44:23.832 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 142 newly installed, 0 to remove and 269 not upgraded. 2024-01-17T21:44:23.832 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 3,638 MB of archives. 2024-01-17T21:44:23.832 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 4,427 MB of additional disk space will be used. 2024-01-17T21:44:23.832 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-17T21:44:23.846 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-17T21:44:23.846 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-17T21:44:23.851 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-17T21:44:23.852 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-17T21:44:23.853 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-17T21:44:23.853 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-17T21:44:23.853 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-17T21:44:23.854 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-17T21:44:23.857 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-17T21:44:23.858 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-653-g1ec1182e-1jammy [3,502 kB] 2024-01-17T21:44:23.872 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-17T21:44:23.873 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-17T21:44:23.874 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-17T21:44:23.892 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-17T21:44:23.895 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-17T21:44:23.895 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-17T21:44:23.896 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-17T21:44:23.897 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-17T21:44:23.901 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-17T21:44:23.901 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-17T21:44:23.913 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-17T21:44:23.913 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-17T21:44:23.913 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-17T21:44:23.925 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-17T21:44:23.933 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-17T21:44:23.935 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-17T21:44:23.936 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-17T21:44:23.944 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-17T21:44:23.944 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-17T21:44:23.945 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-17T21:44:23.947 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-17T21:44:23.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-17T21:44:23.974 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-17T21:44:24.052 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-17T21:44:24.098 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-17T21:44:24.120 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-17T21:44:24.150 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-17T21:44:24.160 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-653-g1ec1182e-1jammy [3,502 kB] 2024-01-17T21:44:24.232 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-17T21:44:24.256 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-17T21:44:24.284 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-17T21:44:24.308 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-17T21:44:24.330 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-17T21:44:24.357 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-17T21:44:24.380 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-17T21:44:24.402 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-17T21:44:24.424 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-17T21:44:24.445 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-17T21:44:24.468 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-17T21:44:24.491 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-17T21:44:24.513 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-17T21:44:24.535 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-17T21:44:24.556 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-17T21:44:24.577 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-17T21:44:24.599 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-17T21:44:24.682 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-17T21:44:24.703 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-17T21:44:24.724 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-17T21:44:24.745 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-17T21:44:24.766 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-17T21:44:24.790 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-17T21:44:24.811 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-17T21:44:24.833 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-17T21:44:24.854 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-17T21:44:24.875 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-17T21:44:24.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-17T21:44:24.918 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-17T21:44:24.940 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-17T21:44:24.961 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-17T21:44:24.983 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-17T21:44:25.008 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-17T21:44:25.029 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-17T21:44:25.050 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-17T21:44:25.071 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-17T21:44:25.094 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-17T21:44:25.116 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-17T21:44:25.138 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-17T21:44:25.160 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-17T21:44:25.181 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-17T21:44:25.266 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-17T21:44:25.287 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-17T21:44:25.309 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-17T21:44:25.332 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-17T21:44:25.408 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-17T21:44:25.430 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-17T21:44:25.452 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-17T21:44:25.473 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-17T21:44:25.495 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-17T21:44:25.536 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-17T21:44:25.560 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-17T21:44:25.581 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-17T21:44:25.620 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-17T21:44:25.641 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-17T21:44:25.676 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-17T21:44:25.708 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-17T21:44:25.736 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-17T21:44:25.758 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-17T21:44:25.779 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-17T21:44:25.800 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-17T21:44:25.825 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-17T21:44:25.848 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-17T21:44:25.870 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-17T21:44:25.894 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-17T21:44:26.028 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-17T21:44:26.055 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-17T21:44:26.085 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-17T21:44:26.106 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-17T21:44:26.128 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-17T21:44:26.153 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-17T21:44:26.175 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-17T21:44:26.199 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-17T21:44:26.220 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-17T21:44:26.241 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-17T21:44:26.263 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-17T21:44:26.285 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-17T21:44:26.307 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-17T21:44:26.336 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-17T21:44:26.357 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-17T21:44:26.379 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-17T21:44:26.402 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-17T21:44:26.423 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-17T21:44:29.396 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-653-g1ec1182e-1jammy [3,206 kB] 2024-01-17T21:44:31.281 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-653-g1ec1182e-1jammy [3,206 kB] 2024-01-17T21:44:33.985 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-653-g1ec1182e-1jammy [709 kB] 2024-01-17T21:44:34.918 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-653-g1ec1182e-1jammy [356 kB] 2024-01-17T21:44:35.384 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-653-g1ec1182e-1jammy [32.8 kB] 2024-01-17T21:44:35.388 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-653-g1ec1182e-1jammy [180 kB] 2024-01-17T21:44:35.661 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-653-g1ec1182e-1jammy [64.1 kB] 2024-01-17T21:44:35.671 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-653-g1ec1182e-1jammy [330 kB] 2024-01-17T21:44:36.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-653-g1ec1182e-1jammy [6,226 kB] 2024-01-17T21:44:42.488 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-653-g1ec1182e-1jammy [709 kB] 2024-01-17T21:44:44.797 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-653-g1ec1182e-1jammy [356 kB] 2024-01-17T21:44:46.289 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-653-g1ec1182e-1jammy [32.8 kB] 2024-01-17T21:44:46.408 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-653-g1ec1182e-1jammy [180 kB] 2024-01-17T21:44:47.050 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-653-g1ec1182e-1jammy [64.1 kB] 2024-01-17T21:44:47.295 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-653-g1ec1182e-1jammy [330 kB] 2024-01-17T21:44:47.684 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-653-g1ec1182e-1jammy [112 kB] 2024-01-17T21:44:48.084 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-653-g1ec1182e-1jammy [465 kB] 2024-01-17T21:44:48.452 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-653-g1ec1182e-1jammy [6,226 kB] 2024-01-17T21:44:49.453 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-653-g1ec1182e-1jammy [23.0 MB] 2024-01-17T21:45:06.648 INFO:teuthology.orchestra.run.smithi067.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-653-g1ec1182e-1jammy [112 kB] 2024-01-17T21:45:07.076 INFO:teuthology.orchestra.run.smithi067.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-653-g1ec1182e-1jammy [465 kB] 2024-01-17T21:45:08.553 INFO:teuthology.orchestra.run.smithi067.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-653-g1ec1182e-1jammy [23.0 MB] 2024-01-17T21:45:33.783 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-653-g1ec1182e-1jammy [5,055 kB] 2024-01-17T21:45:42.742 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-653-g1ec1182e-1jammy [240 kB] 2024-01-17T21:45:43.174 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-653-g1ec1182e-1jammy [124 kB] 2024-01-17T21:45:43.436 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-653-g1ec1182e-1jammy [1,517 kB] 2024-01-17T21:45:47.427 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-653-g1ec1182e-1jammy [6,237 kB] 2024-01-17T21:45:57.680 INFO:teuthology.orchestra.run.smithi067.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-653-g1ec1182e-1jammy [5,055 kB] 2024-01-17T21:45:58.382 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-653-g1ec1182e-1jammy [22.7 MB] 2024-01-17T21:46:10.358 INFO:teuthology.orchestra.run.smithi067.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-653-g1ec1182e-1jammy [240 kB] 2024-01-17T21:46:10.826 INFO:teuthology.orchestra.run.smithi067.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-653-g1ec1182e-1jammy [124 kB] 2024-01-17T21:46:11.057 INFO:teuthology.orchestra.run.smithi067.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-653-g1ec1182e-1jammy [1,517 kB] 2024-01-17T21:46:13.519 INFO:teuthology.orchestra.run.smithi067.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-653-g1ec1182e-1jammy [6,237 kB] 2024-01-17T21:46:26.472 INFO:teuthology.orchestra.run.smithi067.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-653-g1ec1182e-1jammy [22.7 MB] 2024-01-17T21:46:47.864 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-653-g1ec1182e-1jammy [14.0 kB] 2024-01-17T21:46:47.889 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-653-g1ec1182e-1jammy [865 kB] 2024-01-17T21:46:49.566 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-653-g1ec1182e-1jammy [2,181 kB] 2024-01-17T21:46:54.800 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-653-g1ec1182e-1jammy [770 kB] 2024-01-17T21:46:56.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-653-g1ec1182e-1jammy [139 kB] 2024-01-17T21:46:56.301 INFO:teuthology.orchestra.run.smithi137.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-653-g1ec1182e-1jammy [1,876 kB] 2024-01-17T21:46:59.263 INFO:teuthology.orchestra.run.smithi137.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-653-g1ec1182e-1jammy [8,625 kB] 2024-01-17T21:47:14.092 INFO:teuthology.orchestra.run.smithi137.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-653-g1ec1182e-1jammy [14.2 kB] 2024-01-17T21:47:14.127 INFO:teuthology.orchestra.run.smithi137.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-653-g1ec1182e-1jammy [48.3 MB] 2024-01-17T21:47:24.065 INFO:teuthology.orchestra.run.smithi067.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-653-g1ec1182e-1jammy [14.0 kB] 2024-01-17T21:47:24.116 INFO:teuthology.orchestra.run.smithi067.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-653-g1ec1182e-1jammy [865 kB] 2024-01-17T21:47:26.481 INFO:teuthology.orchestra.run.smithi067.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-653-g1ec1182e-1jammy [2,181 kB] 2024-01-17T21:47:32.496 INFO:teuthology.orchestra.run.smithi067.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-653-g1ec1182e-1jammy [770 kB] 2024-01-17T21:47:34.526 INFO:teuthology.orchestra.run.smithi067.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-653-g1ec1182e-1jammy [139 kB] 2024-01-17T21:47:34.846 INFO:teuthology.orchestra.run.smithi067.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-653-g1ec1182e-1jammy [1,876 kB] 2024-01-17T21:47:40.173 INFO:teuthology.orchestra.run.smithi067.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-653-g1ec1182e-1jammy [8,625 kB] 2024-01-17T21:48:00.017 INFO:teuthology.orchestra.run.smithi067.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-653-g1ec1182e-1jammy [14.2 kB] 2024-01-17T21:48:00.092 INFO:teuthology.orchestra.run.smithi067.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-653-g1ec1182e-1jammy [48.3 MB] 2024-01-17T21:48:57.707 INFO:teuthology.orchestra.run.smithi137.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-653-g1ec1182e-1jammy [121 kB] 2024-01-17T21:48:58.139 INFO:teuthology.orchestra.run.smithi137.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-653-g1ec1182e-1jammy [226 kB] 2024-01-17T21:48:59.000 INFO:teuthology.orchestra.run.smithi137.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-653-g1ec1182e-1jammy [34.0 kB] 2024-01-17T21:48:59.129 INFO:teuthology.orchestra.run.smithi137.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-653-g1ec1182e-1jammy [23.4 kB] 2024-01-17T21:48:59.244 INFO:teuthology.orchestra.run.smithi137.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-653-g1ec1182e-1jammy [38.4 kB] 2024-01-17T21:48:59.390 INFO:teuthology.orchestra.run.smithi137.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-653-g1ec1182e-1jammy [12.3 MB] 2024-01-17T21:49:28.000 INFO:teuthology.orchestra.run.smithi137.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-653-g1ec1182e-1jammy [91.7 kB] 2024-01-17T21:49:28.127 INFO:teuthology.orchestra.run.smithi137.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-653-g1ec1182e-1jammy [3,119 kB] 2024-01-17T21:49:35.067 INFO:teuthology.orchestra.run.smithi137.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-653-g1ec1182e-1jammy [178 kB] 2024-01-17T21:49:35.412 INFO:teuthology.orchestra.run.smithi137.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-653-g1ec1182e-1jammy [702 MB] 2024-01-17T21:50:07.263 INFO:teuthology.orchestra.run.smithi067.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-653-g1ec1182e-1jammy [121 kB] 2024-01-17T21:50:07.491 INFO:teuthology.orchestra.run.smithi067.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-653-g1ec1182e-1jammy [226 kB] 2024-01-17T21:50:07.896 INFO:teuthology.orchestra.run.smithi067.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-653-g1ec1182e-1jammy [34.0 kB] 2024-01-17T21:50:07.955 INFO:teuthology.orchestra.run.smithi067.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-653-g1ec1182e-1jammy [23.4 kB] 2024-01-17T21:50:07.993 INFO:teuthology.orchestra.run.smithi067.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-653-g1ec1182e-1jammy [38.4 kB] 2024-01-17T21:50:08.085 INFO:teuthology.orchestra.run.smithi067.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-653-g1ec1182e-1jammy [12.3 MB] 2024-01-17T21:50:43.768 INFO:teuthology.orchestra.run.smithi067.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-653-g1ec1182e-1jammy [91.7 kB] 2024-01-17T21:50:43.901 INFO:teuthology.orchestra.run.smithi067.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-653-g1ec1182e-1jammy [3,119 kB] 2024-01-17T21:50:50.472 INFO:teuthology.orchestra.run.smithi067.stdout:Get:126 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-653-g1ec1182e-1jammy [178 kB] 2024-01-17T21:50:50.933 INFO:teuthology.orchestra.run.smithi067.stdout:Get:127 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-653-g1ec1182e-1jammy [702 MB] 2024-01-17T22:13:44.916 INFO:teuthology.orchestra.run.smithi137.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [18.1 MB] 2024-01-17T22:14:20.712 INFO:teuthology.orchestra.run.smithi137.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-653-g1ec1182e-1jammy [77.6 MB] 2024-01-17T22:17:07.025 INFO:teuthology.orchestra.run.smithi137.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-653-g1ec1182e-1jammy [41.3 MB] 2024-01-17T22:18:12.314 INFO:teuthology.orchestra.run.smithi137.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-653-g1ec1182e-1jammy [158 MB] 2024-01-17T22:19:59.677 INFO:teuthology.orchestra.run.smithi067.stdout:Get:128 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [18.1 MB] 2024-01-17T22:20:47.517 INFO:teuthology.orchestra.run.smithi067.stdout:Get:129 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-653-g1ec1182e-1jammy [77.6 MB] 2024-01-17T22:23:03.148 INFO:teuthology.orchestra.run.smithi067.stdout:Get:130 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-653-g1ec1182e-1jammy [41.3 MB] 2024-01-17T22:23:15.388 INFO:teuthology.orchestra.run.smithi137.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [535 MB] 2024-01-17T22:24:27.485 INFO:teuthology.orchestra.run.smithi067.stdout:Get:131 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-653-g1ec1182e-1jammy [158 MB] 2024-01-17T22:30:11.312 INFO:teuthology.orchestra.run.smithi067.stdout:Get:132 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [535 MB] 2024-01-17T22:37:01.801 INFO:teuthology.orchestra.run.smithi137.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,134 MB] 2024-01-17T22:44:31.722 INFO:teuthology.orchestra.run.smithi067.stdout:Get:133 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,134 MB] 2024-01-17T22:53:13.784 INFO:teuthology.orchestra.run.smithi137.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [16.3 MB] 2024-01-17T22:53:17.288 INFO:teuthology.orchestra.run.smithi137.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [81.3 MB] 2024-01-17T22:53:35.564 INFO:teuthology.orchestra.run.smithi137.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [11.2 MB] 2024-01-17T22:53:36.891 INFO:teuthology.orchestra.run.smithi137.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [103 MB] 2024-01-17T22:53:51.433 INFO:teuthology.orchestra.run.smithi137.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [163 MB] 2024-01-17T22:54:12.716 INFO:teuthology.orchestra.run.smithi137.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-653-g1ec1182e-1jammy [319 MB] 2024-01-17T22:54:14.067 INFO:teuthology.orchestra.run.smithi067.stdout:Get:134 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [16.3 MB] 2024-01-17T22:54:17.950 INFO:teuthology.orchestra.run.smithi067.stdout:Get:135 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [81.3 MB] 2024-01-17T22:54:30.653 INFO:teuthology.orchestra.run.smithi067.stdout:Get:136 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [11.2 MB] 2024-01-17T22:54:32.047 INFO:teuthology.orchestra.run.smithi067.stdout:Get:137 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-653-g1ec1182e-1jammy [103 MB] 2024-01-17T22:54:43.893 INFO:teuthology.orchestra.run.smithi067.stdout:Get:138 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-653-g1ec1182e-1jammy [163 MB] 2024-01-17T22:54:51.130 INFO:teuthology.orchestra.run.smithi137.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,697 kB] 2024-01-17T22:54:51.161 INFO:teuthology.orchestra.run.smithi137.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-653-g1ec1182e-1jammy [97.0 MB] 2024-01-17T22:55:00.213 INFO:teuthology.orchestra.run.smithi137.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [2,998 kB] 2024-01-17T22:55:00.867 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 3,638 MB in 1h 10min 37s (859 kB/s) 2024-01-17T22:55:01.025 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-17T22:55:01.110 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-01-17T22:55:01.115 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-17T22:55:01.165 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-17T22:55:01.460 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-17T22:55:01.480 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-17T22:55:01.517 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:55:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:Get:139 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-653-g1ec1182e-1jammy [319 MB] 2024-01-17T22:55:01.845 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cmd2. 2024-01-17T22:55:01.866 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-17T22:55:01.903 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-17T22:55:02.273 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-17T22:55:02.293 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-17T22:55:02.373 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:55:02.685 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-17T22:55:02.705 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-17T22:55:02.735 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:55:03.080 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-17T22:55:03.100 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-17T22:55:03.138 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:55:03.592 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-17T22:55:03.612 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:03.658 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:04.028 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-17T22:55:04.039 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:04.069 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:04.423 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-17T22:55:04.443 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:04.481 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:04.850 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-17T22:55:04.871 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-17T22:55:04.908 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:55:05.212 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librados2. 2024-01-17T22:55:05.232 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-librados2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:05.261 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:05.723 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librbd1. 2024-01-17T22:55:05.743 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-librbd1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:05.781 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:06.225 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-01-17T22:55:06.246 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:06.284 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:06.661 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-01-17T22:55:06.682 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-rados_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:06.719 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:06.997 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-17T22:55:07.018 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:07.055 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:07.291 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-01-17T22:55:07.303 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:07.341 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:07.669 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-17T22:55:07.689 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:07.727 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:08.055 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-01-17T22:55:08.075 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-17T22:55:08.113 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-17T22:55:08.366 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-01-17T22:55:08.378 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:08.407 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:08.744 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-17T22:55:08.764 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-17T22:55:08.802 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:55:09.079 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-17T22:55:09.100 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-17T22:55:09.138 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:55:09.441 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-17T22:55:09.461 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-17T22:55:09.499 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:55:09.802 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua5.1. 2024-01-17T22:55:09.823 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-17T22:55:09.852 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:55:10.172 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-any. 2024-01-17T22:55:10.192 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-17T22:55:10.230 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-17T22:55:10.482 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package zip. 2024-01-17T22:55:10.494 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-17T22:55:10.533 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking zip (3.0-12build2) ... 2024-01-17T22:55:10.852 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package unzip. 2024-01-17T22:55:10.873 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-17T22:55:10.910 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:55:11.306 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package luarocks. 2024-01-17T22:55:11.327 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-17T22:55:11.364 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:55:11.739 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-01-17T22:55:11.759 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-librgw2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:11.797 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:12.333 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-01-17T22:55:12.344 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:12.382 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:12.669 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-17T22:55:12.689 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-17T22:55:12.718 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:55:13.046 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-01-17T22:55:13.067 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:13.105 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:13.633 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-01-17T22:55:13.654 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-ceph-common_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:13.699 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:15.155 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-01-17T22:55:15.175 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-ceph-base_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:15.230 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:15.843 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-17T22:55:15.863 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-17T22:55:15.909 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:55:16.195 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cheroot. 2024-01-17T22:55:16.216 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-17T22:55:16.253 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:55:16.592 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-17T22:55:16.612 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-17T22:55:16.650 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:55:16.911 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-17T22:55:16.931 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-17T22:55:16.960 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:55:17.246 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-17T22:55:17.267 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-17T22:55:17.305 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:55:17.607 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempora. 2024-01-17T22:55:17.628 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-17T22:55:17.666 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-17T22:55:17.944 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-portend. 2024-01-17T22:55:17.964 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-17T22:55:18.002 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-17T22:55:18.246 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-17T22:55:18.267 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-17T22:55:18.305 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-17T22:55:18.608 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-17T22:55:18.628 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-17T22:55:18.666 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:55:18.986 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-01-17T22:55:18.998 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-17T22:55:19.036 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-17T22:55:19.347 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-01-17T22:55:19.368 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-17T22:55:19.406 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-17T22:55:19.717 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-17T22:55:19.737 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-17T22:55:19.775 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:55:20.078 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-01-17T22:55:20.098 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-17T22:55:20.136 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:55:20.591 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-17T22:55:20.612 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-17T22:55:20.897 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:55:21.275 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-17T22:55:21.296 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-17T22:55:21.342 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:55:21.695 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-01-17T22:55:21.715 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-17T22:55:21.753 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:55:22.122 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-01-17T22:55:22.143 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-17T22:55:22.192 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:55:22.559 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-01-17T22:55:22.579 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-17T22:55:22.625 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:55:22.995 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-01-17T22:55:23.015 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-17T22:55:23.061 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:55:23.406 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-17T22:55:23.418 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-17T22:55:23.456 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:55:23.759 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-17T22:55:23.779 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-17T22:55:23.808 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:55:24.086 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-01-17T22:55:24.107 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-17T22:55:24.145 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-17T22:55:24.439 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-01-17T22:55:24.460 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-17T22:55:24.497 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:55:24.860 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-certifi. 2024-01-17T22:55:24.881 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-17T22:55:24.918 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-17T22:55:25.109 INFO:teuthology.orchestra.run.smithi067.stdout:Get:140 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-653-g1ec1182e-1jammy [1,697 kB] 2024-01-17T22:55:25.123 INFO:teuthology.orchestra.run.smithi067.stdout:Get:141 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-653-g1ec1182e-1jammy [97.0 MB] 2024-01-17T22:55:25.238 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-idna. 2024-01-17T22:55:25.259 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-17T22:55:25.296 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-17T22:55:25.616 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-urllib3. 2024-01-17T22:55:25.636 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-17T22:55:25.665 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:55:25.943 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests. 2024-01-17T22:55:25.955 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-17T22:55:25.985 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:55:26.246 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-17T22:55:26.267 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-17T22:55:26.304 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:55:26.616 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-17T22:55:26.637 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:26.666 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:27.054 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-17T22:55:27.075 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:27.112 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:27.432 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-17T22:55:27.452 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-17T22:55:27.490 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:55:27.776 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-01-17T22:55:27.797 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-17T22:55:27.834 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-17T22:55:28.179 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-01-17T22:55:28.200 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:28.237 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:28.557 INFO:teuthology.orchestra.run.smithi067.stdout:Get:142 https://2.chacra.ceph.com/r/ceph/main/1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-653-g1ec1182e-1jammy [2,998 kB] 2024-01-17T22:55:28.640 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-01-17T22:55:28.661 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:28.698 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:29.244 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 3,638 MB in 1h 11min 5s (853 kB/s) 2024-01-17T22:55:29.260 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-01-17T22:55:29.281 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:29.310 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:29.392 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-17T22:55:29.460 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-17T22:55:29.463 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-17T22:55:29.508 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-17T22:55:29.927 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-17T22:55:29.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-17T22:55:30.018 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:55:30.305 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cmd2. 2024-01-17T22:55:30.320 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-17T22:55:30.355 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-17T22:55:30.396 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-01-17T22:55:30.408 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:30.446 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:30.666 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-17T22:55:30.681 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-17T22:55:30.749 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:55:30.766 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-01-17T22:55:30.786 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:30.824 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:31.078 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-17T22:55:31.093 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-17T22:55:31.161 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:55:31.211 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-01-17T22:55:31.232 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:31.268 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:31.464 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-17T22:55:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-17T22:55:31.514 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:55:31.622 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-01-17T22:55:31.642 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-cephadm_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:31.679 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:31.859 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-17T22:55:31.874 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:31.925 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:32.016 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-17T22:55:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-17T22:55:32.074 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-17T22:55:32.362 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-17T22:55:32.377 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:32.385 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-17T22:55:32.397 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:55:32.420 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:32.435 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:55:32.740 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-17T22:55:32.755 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-17T22:55:32.790 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:55:33.051 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-17T22:55:33.066 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-17T22:55:33.101 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:55:33.462 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2. 2024-01-17T22:55:33.465 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-babel. 2024-01-17T22:55:33.477 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../010-librados2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:33.486 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:55:33.523 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:55:33.529 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:33.835 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-01-17T22:55:33.855 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-17T22:55:33.893 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-17T22:55:33.965 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1. 2024-01-17T22:55:33.980 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../011-librbd1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:34.023 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:34.221 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-17T22:55:34.242 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:34.279 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2024-01-17T22:55:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:34.426 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:34.591 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-17T22:55:34.611 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-17T22:55:34.649 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-17T22:55:34.703 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2024-01-17T22:55:34.717 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../013-python3-rados_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:34.761 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:34.952 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-01-17T22:55:34.973 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-17T22:55:35.010 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:55:35.074 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-17T22:55:35.089 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:35.133 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:35.360 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2024-01-17T22:55:35.363 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-17T22:55:35.375 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:35.384 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:35.410 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:35.421 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:35.721 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-17T22:55:35.736 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:35.779 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:35.891 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-17T22:55:35.903 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-17T22:55:35.932 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:55:36.091 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2024-01-17T22:55:36.106 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-17T22:55:36.149 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-17T22:55:36.403 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-01-17T22:55:36.410 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2024-01-17T22:55:36.424 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-17T22:55:36.425 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:36.461 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:55:36.468 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:36.821 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-17T22:55:36.836 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-17T22:55:36.839 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-17T22:55:36.861 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-17T22:55:36.870 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:55:36.991 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:55:37.115 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-17T22:55:37.130 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-17T22:55:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:55:37.286 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-01-17T22:55:37.307 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-17T22:55:37.344 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:55:37.434 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-17T22:55:37.449 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-17T22:55:37.492 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:55:37.862 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua5.1. 2024-01-17T22:55:37.877 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-17T22:55:37.929 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:55:38.119 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-17T22:55:38.142 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:38.186 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:38.207 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-any. 2024-01-17T22:55:38.222 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-17T22:55:38.257 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-17T22:55:38.510 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package zip. 2024-01-17T22:55:38.525 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-17T22:55:38.568 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking zip (3.0-12build2) ... 2024-01-17T22:55:38.854 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package unzip. 2024-01-17T22:55:38.870 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-17T22:55:38.904 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:55:39.197 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-01-17T22:55:39.219 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-17T22:55:39.264 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-17T22:55:39.317 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package luarocks. 2024-01-17T22:55:39.332 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-17T22:55:39.375 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:55:39.575 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-17T22:55:39.597 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-17T22:55:39.641 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:55:39.757 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2024-01-17T22:55:39.771 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../027-librgw2_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:39.815 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:39.937 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-17T22:55:39.958 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-17T22:55:40.003 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:55:40.301 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2024-01-17T22:55:40.315 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:40.323 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-01-17T22:55:40.344 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-17T22:55:40.359 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:40.380 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-17T22:55:40.646 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-17T22:55:40.660 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-17T22:55:40.696 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:55:40.710 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-01-17T22:55:40.731 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-17T22:55:40.768 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-17T22:55:40.999 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2024-01-17T22:55:41.014 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:41.057 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:41.062 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-17T22:55:41.084 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-17T22:55:41.112 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:55:41.415 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-01-17T22:55:41.437 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-17T22:55:41.473 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-17T22:55:41.527 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2024-01-17T22:55:41.542 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../031-ceph-common_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:41.585 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:41.785 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-17T22:55:41.807 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-17T22:55:41.843 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:55:42.440 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-17T22:55:42.453 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:42.482 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:42.624 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2024-01-17T22:55:42.639 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../032-ceph-base_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:42.691 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:42.801 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-17T22:55:42.823 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-17T22:55:42.868 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:55:43.213 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-17T22:55:43.219 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-17T22:55:43.233 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-17T22:55:43.234 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:55:43.277 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:55:43.279 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:55:43.532 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-01-17T22:55:43.544 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:55:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-17T22:55:43.597 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cheroot. 2024-01-17T22:55:43.612 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-17T22:55:43.655 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:55:43.776 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-01-17T22:55:43.788 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-17T22:55:43.826 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:55:43.975 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-17T22:55:43.991 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-17T22:55:44.033 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:55:44.129 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-01-17T22:55:44.150 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-17T22:55:44.195 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:55:44.294 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-17T22:55:44.310 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-17T22:55:44.344 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:55:44.558 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-01-17T22:55:44.570 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-ceph-test_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:44.599 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:44.697 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-17T22:55:44.713 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-17T22:55:44.755 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:55:45.067 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempora. 2024-01-17T22:55:45.082 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-17T22:55:45.125 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-17T22:55:45.419 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-portend. 2024-01-17T22:55:45.435 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-17T22:55:45.469 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-17T22:55:45.780 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-17T22:55:45.796 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-17T22:55:45.839 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-17T22:55:46.142 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-17T22:55:46.157 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-17T22:55:46.200 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:55:46.503 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-natsort. 2024-01-17T22:55:46.518 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-17T22:55:46.553 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-17T22:55:46.662 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-01-17T22:55:46.684 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:46.848 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2024-01-17T22:55:46.863 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-17T22:55:46.931 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-17T22:55:47.091 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-17T22:55:47.113 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:47.157 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:47.234 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-17T22:55:47.250 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-17T22:55:47.292 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:55:47.486 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-colorama. 2024-01-17T22:55:47.507 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-17T22:55:47.552 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-17T22:55:47.595 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2024-01-17T22:55:47.611 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-17T22:55:47.653 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:55:47.863 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-shell. 2024-01-17T22:55:47.884 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:47.921 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:47.973 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-17T22:55:47.989 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-17T22:55:48.048 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:55:48.166 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephfs-top. 2024-01-17T22:55:48.178 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:48.207 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:48.334 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-17T22:55:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-17T22:55:48.392 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:55:48.443 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-17T22:55:48.461 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:48.501 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:48.695 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2024-01-17T22:55:48.711 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-17T22:55:48.753 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:55:48.821 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-17T22:55:48.843 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-17T22:55:48.887 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:55:49.098 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2024-01-17T22:55:49.114 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-17T22:55:49.176 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:55:49.225 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-17T22:55:49.247 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-17T22:55:49.291 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:55:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2024-01-17T22:55:49.492 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-17T22:55:49.526 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:55:49.629 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-01-17T22:55:49.651 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-17T22:55:49.696 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:55:49.779 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2024-01-17T22:55:49.794 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-17T22:55:49.837 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:55:50.118 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pkg-config. 2024-01-17T22:55:50.140 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-17T22:55:50.148 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-17T22:55:50.164 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-17T22:55:50.175 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:55:50.206 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:55:50.395 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-17T22:55:50.407 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-17T22:55:50.445 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:55:50.485 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-17T22:55:50.500 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-17T22:55:50.543 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:55:50.823 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-17T22:55:50.844 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-17T22:55:50.846 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2024-01-17T22:55:50.861 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-17T22:55:50.873 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-17T22:55:50.904 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-17T22:55:51.151 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-01-17T22:55:51.173 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-17T22:55:51.215 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2024-01-17T22:55:51.217 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-17T22:55:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-17T22:55:51.273 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:55:51.529 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-01-17T22:55:51.551 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-17T22:55:51.596 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:55:51.670 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-certifi. 2024-01-17T22:55:51.685 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-17T22:55:51.728 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-17T22:55:52.056 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-idna. 2024-01-17T22:55:52.071 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-17T22:55:52.106 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-17T22:55:52.241 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-01-17T22:55:52.262 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-17T22:55:52.307 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-17T22:55:52.375 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-urllib3. 2024-01-17T22:55:52.391 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-17T22:55:52.434 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:55:52.635 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-01-17T22:55:52.657 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-17T22:55:52.709 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-17T22:55:52.762 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests. 2024-01-17T22:55:52.777 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-17T22:55:52.820 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:55:53.021 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pygments. 2024-01-17T22:55:53.043 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-17T22:55:53.088 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:55:53.131 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-17T22:55:53.146 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-17T22:55:53.189 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:55:53.484 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-17T22:55:53.499 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:55:53.525 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-17T22:55:53.547 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-17T22:55:53.559 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:53.591 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:55:53.913 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-toml. 2024-01-17T22:55:53.935 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-17T22:55:53.979 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-17T22:55:53.980 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-17T22:55:53.995 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:54.038 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:54.266 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-01-17T22:55:54.287 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-17T22:55:54.324 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-17T22:55:54.332 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:55:54.340 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-17T22:55:54.391 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:55:54.677 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-01-17T22:55:54.694 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2024-01-17T22:55:54.699 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-17T22:55:54.710 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-17T22:55:54.743 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:55:54.785 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-17T22:55:55.013 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-17T22:55:55.035 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-17T22:55:55.079 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:55:55.097 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2024-01-17T22:55:55.113 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:55.146 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:55.500 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2024-01-17T22:55:55.516 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:55.558 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:55.826 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-01-17T22:55:55.847 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../122-radosgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:55.891 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:56.137 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2024-01-17T22:55:56.152 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:56.195 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:56.687 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-01-17T22:55:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:56.753 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:56.906 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2024-01-17T22:55:56.921 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../068-ceph_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:56.964 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.056 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-mirror. 2024-01-17T22:55:57.068 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:57.097 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.334 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2024-01-17T22:55:57.349 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:57.392 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.550 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-nbd. 2024-01-17T22:55:57.572 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:57.616 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.712 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2024-01-17T22:55:57.728 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:57.761 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:57.869 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-17T22:55:57.882 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:57.919 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.456 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2024-01-17T22:55:58.472 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../071-cephadm_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:55:58.506 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:55:58.792 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-17T22:55:58.808 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-17T22:55:58.850 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-17T22:55:59.161 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-17T22:55:59.177 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:55:59.220 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:56:00.208 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-babel. 2024-01-17T22:56:00.222 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-17T22:56:00.257 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:56:00.619 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2024-01-17T22:56:00.633 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-17T22:56:00.669 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-17T22:56:01.014 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-17T22:56:01.028 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:01.063 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:01.400 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-17T22:56:01.415 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-17T22:56:01.458 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-17T22:56:01.761 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2024-01-17T22:56:01.776 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-17T22:56:01.819 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:56:02.148 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-17T22:56:02.163 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:02.207 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:02.668 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-17T22:56:02.683 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-17T22:56:02.725 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:56:03.212 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2024-01-17T22:56:03.228 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-17T22:56:03.262 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:56:03.632 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-17T22:56:03.648 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-17T22:56:03.818 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:56:04.087 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2024-01-17T22:56:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-17T22:56:04.137 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:56:04.813 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-17T22:56:04.828 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:04.871 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:05.006 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-17T22:56:05.017 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:05.055 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:05.475 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-17T22:56:05.487 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:05.524 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:05.791 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2024-01-17T22:56:05.807 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-17T22:56:05.849 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-17T22:56:06.194 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-17T22:56:06.210 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-17T22:56:06.252 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:56:06.535 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-17T22:56:06.548 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:06.572 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-17T22:56:06.588 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-17T22:56:06.593 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:06.630 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:56:06.933 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2024-01-17T22:56:06.949 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-17T22:56:06.991 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-17T22:56:07.287 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-17T22:56:07.300 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:07.328 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2024-01-17T22:56:07.337 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:07.344 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-17T22:56:07.386 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-17T22:56:07.690 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-17T22:56:07.705 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-17T22:56:07.748 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:56:08.026 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2024-01-17T22:56:08.042 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-17T22:56:08.092 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-17T22:56:08.454 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-17T22:56:08.470 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-17T22:56:08.512 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:56:09.073 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-17T22:56:09.085 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:09.114 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:09.184 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-17T22:56:09.199 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:09.242 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:09.562 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-17T22:56:09.576 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-17T22:56:09.612 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:56:09.956 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-17T22:56:09.971 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:56:10.014 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:56:10.267 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2024-01-17T22:56:10.282 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-17T22:56:10.325 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-17T22:56:10.603 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2024-01-17T22:56:10.618 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-17T22:56:10.661 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:56:10.956 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2024-01-17T22:56:10.971 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-17T22:56:11.006 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:56:11.337 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2024-01-17T22:56:11.352 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../099-ceph-test_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:11.387 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:13.283 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-volume. 2024-01-17T22:56:13.299 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:13.341 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:13.720 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-17T22:56:13.736 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:13.786 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:14.148 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-colorama. 2024-01-17T22:56:14.164 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-17T22:56:14.214 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-17T22:56:14.334 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-17T22:56:14.346 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:14.391 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:14.458 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-shell. 2024-01-17T22:56:14.474 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:14.516 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:14.769 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephfs-top. 2024-01-17T22:56:14.785 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-653-g1ec1182e-1jammy_all.deb ... 2024-01-17T22:56:14.827 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:15.038 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-17T22:56:15.054 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:15.096 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:15.441 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-17T22:56:15.457 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-17T22:56:15.499 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:56:15.837 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-17T22:56:15.853 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-17T22:56:15.894 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:56:16.291 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2024-01-17T22:56:16.306 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-17T22:56:16.365 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:56:16.720 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pkg-config. 2024-01-17T22:56:16.736 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-17T22:56:16.770 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:56:17.015 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-17T22:56:17.031 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-17T22:56:17.072 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:56:17.534 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-17T22:56:17.550 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-17T22:56:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-17T22:56:17.895 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2024-01-17T22:56:17.911 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-17T22:56:17.953 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-17T22:56:18.257 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2024-01-17T22:56:18.273 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-17T22:56:18.314 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:56:18.659 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2024-01-17T22:56:18.675 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-17T22:56:18.717 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-17T22:56:19.045 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2024-01-17T22:56:19.061 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-17T22:56:19.103 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-17T22:56:19.432 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pygments. 2024-01-17T22:56:19.448 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-17T22:56:19.489 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:56:19.952 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-17T22:56:19.967 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-17T22:56:20.001 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:56:20.304 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-toml. 2024-01-17T22:56:20.321 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-17T22:56:20.362 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-17T22:56:20.649 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2024-01-17T22:56:20.665 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-17T22:56:20.707 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:56:21.068 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2024-01-17T22:56:21.085 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-17T22:56:21.126 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:56:21.404 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-17T22:56:21.421 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-17T22:56:21.463 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:56:22.191 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2024-01-17T22:56:22.206 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../122-radosgw_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:22.249 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:22.811 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2024-01-17T22:56:22.827 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:22.869 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:23.189 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-mirror. 2024-01-17T22:56:23.205 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:23.247 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:23.616 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-nbd. 2024-01-17T22:56:23.632 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:23.682 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:23.927 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common-dbg. 2024-01-17T22:56:23.943 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:23.984 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:25.408 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-17T22:56:25.429 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:25.473 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:25.935 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librados2-dbg. 2024-01-17T22:56:25.947 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:25.984 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:27.070 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-17T22:56:27.083 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:27.120 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:27.489 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-17T22:56:27.501 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:27.539 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:28.934 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-17T22:56:28.955 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:28.999 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:30.281 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-01-17T22:56:30.297 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:30.338 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:30.808 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-01-17T22:56:30.810 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-17T22:56:30.823 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:30.824 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:30.860 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:30.866 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:31.860 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-01-17T22:56:31.876 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:31.918 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:32.604 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-01-17T22:56:32.621 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:32.662 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:34.157 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-01-17T22:56:34.162 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-17T22:56:34.173 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:34.185 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:34.206 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:34.220 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:34.473 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-17T22:56:34.485 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:34.522 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:35.709 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-17T22:56:35.721 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:35.758 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:36.095 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-17T22:56:36.364 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:56:36.489 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:56:36.756 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-17T22:56:37.087 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-17T22:56:37.564 INFO:teuthology.orchestra.run.smithi137.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-17T22:56:37.675 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:38.235 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-01-17T22:56:38.389 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:56:38.674 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:56:38.941 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:56:39.067 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:56:39.117 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test-dbg. 2024-01-17T22:56:39.133 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:39.175 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:39.310 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-17T22:56:39.570 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:56:39.696 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-17T22:56:40.023 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:56:40.391 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-17T22:56:40.651 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-17T22:56:40.902 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-17T22:56:41.186 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:56:41.421 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:56:41.664 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:56:41.965 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:56:42.241 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:42.500 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:56:42.601 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:56:42.719 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-17T22:56:42.987 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:56:43.104 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:56:43.347 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:56:43.741 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-17T22:56:43.769 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-17T22:56:43.842 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:56:43.951 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-17T22:56:44.311 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:56:44.437 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-17T22:56:44.696 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:56:44.964 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:56:45.282 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up zip (3.0-12build2) ... 2024-01-17T22:56:45.408 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:56:46.093 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:56:46.352 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:56:46.478 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:56:46.604 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:56:46.922 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-17T22:56:47.315 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-17T22:56:47.582 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:56:47.959 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:56:48.260 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-17T22:56:48.570 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:56:48.913 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:56:48.925 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-01-17T22:56:48.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:48.983 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:49.164 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:56:49.290 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:49.402 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librados2-dbg. 2024-01-17T22:56:49.418 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:49.591 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-idna (3.3-1) ... 2024-01-17T22:56:49.917 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:56:50.630 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-01-17T22:56:50.647 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:50.713 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:51.049 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librbd1-dbg. 2024-01-17T22:56:51.065 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:51.081 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:56:51.107 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:51.333 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:56:51.459 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-17T22:56:51.710 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:56:51.836 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:56:51.970 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:56:52.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:56:52.385 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2-dbg. 2024-01-17T22:56:52.402 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:52.451 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:52.539 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-17T22:56:52.807 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:56:52.933 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:56:53.243 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:56:53.502 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-17T22:56:53.762 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-17T22:56:54.012 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:56:54.237 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw-dbg. 2024-01-17T22:56:54.254 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:54.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-17T22:56:54.295 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:54.548 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:56:54.674 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-17T22:56:54.950 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:56:55.051 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:56:55.361 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:56:55.678 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:56:55.929 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:56:56.055 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:56:56.190 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:56:56.280 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-17T22:56:56.533 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:56:56.634 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:56:57.027 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:56:57.278 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-17T22:56:57.404 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-17T22:56:57.440 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-01-17T22:56:57.456 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:57.672 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:56:57.750 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-01-17T22:56:57.767 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:57.806 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-17T22:56:57.808 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:58.133 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:56:58.425 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:56:58.676 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-17T22:56:59.028 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-01-17T22:56:59.044 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-653-g1ec1182e-1jammy_amd64.deb ... 2024-01-17T22:56:59.086 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:56:59.304 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-17T22:56:59.423 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-17T22:56:59.580 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-17T22:56:59.691 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-17T22:56:59.817 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-17T22:56:59.840 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:57:00.100 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:57:00.141 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-17T22:57:00.493 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-17T22:57:00.558 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-17T22:57:00.778 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:57:01.113 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:57:01.153 INFO:teuthology.orchestra.run.smithi067.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-17T22:57:01.201 INFO:teuthology.orchestra.run.smithi067.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-17T22:57:01.239 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:01.244 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:01.382 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:01.508 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:57:01.781 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2024-01-17T22:57:01.811 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:01.937 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:01.941 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-17T22:57:02.063 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-17T22:57:02.234 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-17T22:57:02.339 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:02.494 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-17T22:57:02.583 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:02.620 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-17T22:57:02.709 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:02.835 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:02.879 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-17T22:57:03.045 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:57:03.045 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:57:03.139 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-17T22:57:03.323 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-17T22:57:03.587 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:03.642 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-17T22:57:03.712 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:03.838 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:03.964 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:04.018 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-17T22:57:04.091 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:04.217 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:04.286 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-17T22:57:04.334 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:57:04.587 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-17T22:57:04.864 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-17T22:57:05.098 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-17T22:57:05.366 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-17T22:57:05.529 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:05.643 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-17T22:57:05.647 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:05.765 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:05.891 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:05.927 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.017 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.143 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.203 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-17T22:57:06.269 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.329 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-17T22:57:06.395 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.438 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-17T22:57:06.521 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.647 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.698 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-17T22:57:06.765 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:06.824 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-17T22:57:07.125 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-17T22:57:07.307 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-01-17T22:57:07.538 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-17T22:57:07.573 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-17T22:57:07.638 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-17T22:57:07.692 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-01-17T22:57:07.796 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-17T22:57:07.861 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-01-17T22:57:07.879 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-17T22:57:08.016 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-17T22:57:08.172 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-17T22:57:08.298 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-17T22:57:08.372 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-17T22:57:08.575 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-17T22:57:08.851 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-17T22:57:08.891 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:09.095 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:57:09.095 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:57:09.202 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up zip (3.0-12build2) ... 2024-01-17T22:57:09.328 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-17T22:57:09.609 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:09.735 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:10.064 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-17T22:57:10.233 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:57:10.233 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:57:10.323 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-17T22:57:10.449 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-17T22:57:10.575 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-17T22:57:10.771 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:10.893 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-17T22:57:11.122 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-17T22:57:11.319 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-17T22:57:11.587 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-17T22:57:11.656 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:11.900 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:57:11.901 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:57:12.005 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-17T22:57:12.324 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-17T22:57:12.475 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:12.584 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:12.649 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-17T22:57:12.787 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:57:12.787 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:57:13.009 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-17T22:57:13.277 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-17T22:57:13.293 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:13.436 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:13.507 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:57:13.507 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:57:13.746 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-idna (3.3-1) ... 2024-01-17T22:57:14.053 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:14.097 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-17T22:57:14.179 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:14.296 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:14.397 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:14.724 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:57:14.724 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:57:15.242 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:15.368 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:15.370 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-17T22:57:15.494 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:15.605 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:57:15.620 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:15.746 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:15.772 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-17T22:57:15.913 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:16.048 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-17T22:57:16.126 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:57:16.126 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:57:16.175 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-17T22:57:16.284 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-17T22:57:16.569 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-17T22:57:16.632 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:16.783 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:16.845 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-17T22:57:16.884 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:17.034 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:17.136 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:17.142 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:57:17.280 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-17T22:57:17.497 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-17T22:57:17.607 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-17T22:57:17.614 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:57:17.769 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:57:17.875 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-17T22:57:18.176 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-17T22:57:18.435 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-17T22:57:18.703 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-17T22:57:18.903 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:57:18.987 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-17T22:57:19.147 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-17T22:57:19.439 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-17T22:57:19.566 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-17T22:57:19.581 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:57:19.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-17T22:57:19.680 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-01-17T22:57:19.867 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-17T22:57:19.870 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-01-17T22:57:19.871 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T22:57:20.041 INFO:teuthology.orchestra.run.smithi137.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T22:57:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T22:57:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-01-17T22:57:20.042 INFO:teuthology.orchestra.run.smithi137.stdout: python2.7-minimal 2024-01-17T22:57:20.042 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T22:57:20.043 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-01-17T22:57:20.043 INFO:teuthology.orchestra.run.smithi137.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-17T22:57:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-17T22:57:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-17T22:57:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-17T22:57:20.044 INFO:teuthology.orchestra.run.smithi137.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:57:20.045 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-01-17T22:57:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-17T22:57:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-17T22:57:20.045 INFO:teuthology.orchestra.run.smithi137.stdout: libengine-pkcs11-openssl 2024-01-17T22:57:20.084 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-01-17T22:57:20.084 INFO:teuthology.orchestra.run.smithi137.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-17T22:57:20.085 INFO:teuthology.orchestra.run.smithi137.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-17T22:57:20.085 INFO:teuthology.orchestra.run.smithi137.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-17T22:57:20.085 INFO:teuthology.orchestra.run.smithi137.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-17T22:57:20.086 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-17T22:57:20.086 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-17T22:57:20.086 INFO:teuthology.orchestra.run.smithi137.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:57:20.087 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-01-17T22:57:20.087 INFO:teuthology.orchestra.run.smithi137.stdout: libssl3 2024-01-17T22:57:20.184 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-17T22:57:20.347 INFO:teuthology.orchestra.run.smithi137.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-17T22:57:20.347 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 54.6 MB of archives. 2024-01-17T22:57:20.347 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-17T22:57:20.347 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-17T22:57:20.453 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-17T22:57:20.578 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-17T22:57:20.704 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-17T22:57:20.777 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-17T22:57:20.832 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-17T22:57:21.023 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-17T22:57:21.090 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-17T22:57:21.125 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-17T22:57:21.126 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-17T22:57:21.131 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-17T22:57:21.135 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-17T22:57:21.136 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-17T22:57:21.138 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-17T22:57:21.141 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-17T22:57:21.149 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-17T22:57:21.306 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-17T22:57:21.306 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-17T22:57:21.551 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-17T22:57:21.592 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-17T22:57:21.869 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-17T22:57:21.995 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-17T22:57:22.271 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-17T22:57:22.447 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-17T22:57:22.727 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-17T22:57:22.732 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-17T22:57:22.735 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-17T22:57:22.738 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-17T22:57:22.739 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-17T22:57:22.750 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-17T22:57:22.754 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-17T22:57:22.771 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-17T22:57:22.781 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-17T22:57:22.935 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-17T22:57:23.099 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-17T22:57:23.384 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-17T22:57:23.614 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-17T22:57:23.663 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-17T22:57:23.664 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-17T22:57:23.690 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-17T22:57:23.767 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-17T22:57:23.776 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-17T22:57:23.777 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-17T22:57:23.779 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-17T22:57:23.779 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-17T22:57:23.806 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-17T22:57:23.809 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-17T22:57:23.890 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-17T22:57:24.174 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-17T22:57:24.451 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-17T22:57:24.519 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-17T22:57:24.602 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-17T22:57:24.602 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-17T22:57:24.602 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-17T22:57:24.694 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-17T22:57:24.708 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-17T22:57:24.836 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-17T22:57:25.137 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-17T22:57:25.156 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-17T22:57:25.159 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-17T22:57:25.490 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-17T22:57:25.557 INFO:teuthology.orchestra.run.smithi137.stdout:Preconfiguring packages ... 2024-01-17T22:57:25.616 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:25.740 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 54.6 MB in 5s (10.8 MB/s) 2024-01-17T22:57:25.783 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libsqlite3-mod-ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:25.886 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package flex. 2024-01-17T22:57:25.910 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-17T22:57:25.966 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138435 files and directories currently installed.) 2024-01-17T22:57:25.971 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:26.018 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-17T22:57:26.246 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:26.355 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:26.464 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-17T22:57:26.595 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:57:26.758 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:26.773 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-17T22:57:26.918 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:27.018 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:27.144 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:27.190 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:57:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:27.508 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:57:27.508 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-17T22:57:27.725 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package bison. 2024-01-17T22:57:27.814 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138508 files and directories currently installed.) 2024-01-17T22:57:27.819 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-17T22:57:27.860 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:57:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.252 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-17T22:57:28.274 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-17T22:57:28.281 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.319 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:57:28.407 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.533 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.638 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package dump. 2024-01-17T22:57:28.659 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.661 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-17T22:57:28.705 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking dump (0.4b47-3) ... 2024-01-17T22:57:28.760 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-top (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:28.877 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-17T22:57:28.983 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package indent. 2024-01-17T22:57:28.996 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:29.033 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:57:29.302 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-17T22:57:29.315 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-17T22:57:29.352 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:57:29.664 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-17T22:57:29.687 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-17T22:57:29.731 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:57:30.101 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-17T22:57:30.123 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-17T22:57:30.231 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.391 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.461 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:57:30.516 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.642 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.769 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-nbd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.895 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:30.913 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-17T22:57:30.935 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:30.979 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:31.029 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:31.147 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-nbd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:31.223 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-17T22:57:31.242 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:31.264 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-shell (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:31.282 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:31.432 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:31.518 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjson-perl. 2024-01-17T22:57:31.531 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-17T22:57:31.558 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:31.559 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-17T22:57:31.854 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-17T22:57:31.876 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-17T22:57:31.920 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:57:32.104 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2024-01-17T22:57:32.438 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2024-01-17T22:57:32.783 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2024-01-17T22:57:32.801 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-17T22:57:32.949 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-17T22:57:33.349 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-17T22:57:33.607 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-17T22:57:33.629 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:57:33.673 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:33.951 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-17T22:57:33.964 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:57:34.000 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:34.044 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephfs-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:34.277 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:57:34.277 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-17T22:57:34.278 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-17T22:57:34.301 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:57:34.345 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:57:34.698 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-17T22:57:34.720 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-17T22:57:34.764 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:57:34.961 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:35.117 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-17T22:57:35.140 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:57:35.142 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:35.184 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:57:35.486 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-17T22:57:35.509 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:35.544 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:35.794 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:57:35.794 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-17T22:57:36.150 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-17T22:57:36.172 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:36.216 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:57:36.509 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:36.518 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-17T22:57:36.541 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:36.585 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:57:36.804 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-17T22:57:36.817 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:57:36.846 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:57:36.875 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-17T22:57:37.332 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-17T22:57:37.355 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-17T22:57:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:57:37.551 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package modemmanager. 2024-01-17T22:57:37.774 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:57:37.787 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:57:37.788 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-17T22:57:37.818 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:57:38.445 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:38.459 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager. 2024-01-17T22:57:38.480 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:57:38.532 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:57:38.554 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-mirror (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:38.752 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:57:38.752 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-01-17T22:57:39.374 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ppp. 2024-01-17T22:57:39.381 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:39.396 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-17T22:57:39.600 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:57:39.600 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-17T22:57:39.684 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:57:40.004 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package pptp-linux. 2024-01-17T22:57:40.026 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-17T22:57:40.070 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-17T22:57:40.199 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:40.325 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:40.331 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-17T22:57:40.353 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-17T22:57:40.389 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-17T22:57:40.484 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:40.610 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:40.692 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-17T22:57:40.714 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-17T22:57:40.759 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-common (238) ... 2024-01-17T22:57:40.930 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:57:40.930 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-17T22:57:41.088 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-17T22:57:41.110 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:41.154 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:41.612 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:41.692 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-common. 2024-01-17T22:57:41.713 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:41.715 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-17T22:57:41.776 INFO:teuthology.orchestra.run.smithi137.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-17T22:57:41.806 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-common (238) ... 2024-01-17T22:57:41.831 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-mirror-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:41.957 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:42.083 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:42.234 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:42.283 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-14. 2024-01-17T22:57:42.305 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:42.352 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:42.455 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:57:42.455 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-17T22:57:43.060 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:43.203 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:43.329 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:43.488 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon-dbg (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:43.631 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-volume (19.0.0-653-g1ec1182e-1jammy) ... 2024-01-17T22:57:43.686 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql. 2024-01-17T22:57:43.699 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-17T22:57:43.744 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql (14+238) ... 2024-01-17T22:57:43.971 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-client. 2024-01-17T22:57:43.984 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-17T22:57:44.000 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-17T22:57:44.021 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-client (14+238) ... 2024-01-17T22:57:44.109 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:57:44.248 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-17T22:57:44.261 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-17T22:57:44.261 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:57:44.289 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-17T22:57:44.701 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl8.6. 2024-01-17T22:57:44.723 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-17T22:57:44.767 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:57:45.036 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package tcl. 2024-01-17T22:57:45.059 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-17T22:57:45.087 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:57:45.108 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-17T22:57:45.439 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package wpasupplicant. 2024-01-17T22:57:45.461 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-17T22:57:45.505 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:57:45.760 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:57:45.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-17T22:57:45.840 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2024-01-17T22:57:45.860 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-17T22:57:45.873 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-17T22:57:45.910 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-17T22:57:46.009 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2024-01-17T22:57:46.010 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-17T22:57:46.167 INFO:teuthology.orchestra.run.smithi067.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-17T22:57:46.168 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-17T22:57:46.168 INFO:teuthology.orchestra.run.smithi067.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-17T22:57:46.168 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-17T22:57:46.168 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2024-01-17T22:57:46.169 INFO:teuthology.orchestra.run.smithi067.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-17T22:57:46.169 INFO:teuthology.orchestra.run.smithi067.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-17T22:57:46.169 INFO:teuthology.orchestra.run.smithi067.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-17T22:57:46.169 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-17T22:57:46.169 INFO:teuthology.orchestra.run.smithi067.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:57:46.170 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2024-01-17T22:57:46.170 INFO:teuthology.orchestra.run.smithi067.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-17T22:57:46.170 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-17T22:57:46.170 INFO:teuthology.orchestra.run.smithi067.stdout: libengine-pkcs11-openssl 2024-01-17T22:57:46.221 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2024-01-17T22:57:46.221 INFO:teuthology.orchestra.run.smithi067.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-17T22:57:46.221 INFO:teuthology.orchestra.run.smithi067.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-17T22:57:46.222 INFO:teuthology.orchestra.run.smithi067.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-17T22:57:46.222 INFO:teuthology.orchestra.run.smithi067.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-17T22:57:46.222 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-17T22:57:46.222 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-17T22:57:46.222 INFO:teuthology.orchestra.run.smithi067.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-17T22:57:46.223 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2024-01-17T22:57:46.223 INFO:teuthology.orchestra.run.smithi067.stdout: libssl3 2024-01-17T22:57:46.296 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-17T22:57:46.319 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-17T22:57:46.371 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:57:46.408 INFO:teuthology.orchestra.run.smithi067.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-17T22:57:46.408 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 54.6 MB of archives. 2024-01-17T22:57:46.408 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-17T22:57:46.408 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-17T22:57:46.656 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-common (238) ... 2024-01-17T22:57:46.869 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-17T22:57:46.910 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-17T22:57:46.995 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:57:47.121 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:47.167 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-17T22:57:47.202 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-17T22:57:47.204 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-17T22:57:47.209 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-17T22:57:47.212 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-17T22:57:47.213 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-17T22:57:47.217 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-17T22:57:47.219 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-17T22:57:47.247 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:57:47.348 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:57:47.383 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-17T22:57:47.383 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-17T22:57:47.465 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:47.639 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-17T22:57:47.954 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-17T22:57:48.053 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:57:48.457 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:57:48.457 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:57:48.660 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-17T22:57:48.662 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-17T22:57:48.663 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-17T22:57:48.666 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-17T22:57:48.666 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-17T22:57:48.670 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-17T22:57:48.672 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-17T22:57:48.693 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-17T22:57:48.857 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-17T22:57:48.989 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:57:49.115 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:57:49.241 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-17T22:57:49.376 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:57:49.502 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:49.594 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-17T22:57:49.595 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-17T22:57:49.621 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-17T22:57:49.628 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:57:49.698 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-17T22:57:49.707 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-17T22:57:49.707 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-17T22:57:49.708 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-17T22:57:49.709 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-17T22:57:49.737 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-17T22:57:49.740 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-17T22:57:49.754 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:57:50.367 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-17T22:57:50.367 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:57:50.449 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-17T22:57:50.449 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-17T22:57:50.449 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-17T22:57:50.493 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up dump (0.4b47-3) ... 2024-01-17T22:57:50.540 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-17T22:57:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-17T22:57:50.587 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-17T22:57:50.653 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:57:50.796 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:57:50.922 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-17T22:57:51.009 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-17T22:57:51.011 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-17T22:57:51.039 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-17T22:57:51.140 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:57:51.289 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-17T22:57:51.415 INFO:teuthology.orchestra.run.smithi067.stdout:Preconfiguring packages ... 2024-01-17T22:57:51.562 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2024-01-17T22:57:51.737 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package flex. 2024-01-17T22:57:51.801 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:57:51.809 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140861 files and directories currently installed.) 2024-01-17T22:57:51.813 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:51.852 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-17T22:57:51.935 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:57:52.120 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:57:52.246 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:52.372 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-17T22:57:52.373 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:57:52.531 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-client (14+238) ... 2024-01-17T22:57:52.541 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-17T22:57:52.632 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:57:53.008 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:57:53.129 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:53.129 INFO:teuthology.orchestra.run.smithi137.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-17T22:57:53.129 INFO:teuthology.orchestra.run.smithi137.stdout:which means they are currently configured by ifupdown: 2024-01-17T22:57:53.129 INFO:teuthology.orchestra.run.smithi137.stdout:- enp3s0f1 2024-01-17T22:57:53.130 INFO:teuthology.orchestra.run.smithi137.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-17T22:57:53.130 INFO:teuthology.orchestra.run.smithi137.stdout:remove their configuration from /etc/network/interfaces. 2024-01-17T22:57:53.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:53.245 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-17T22:57:53.593 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package bison. 2024-01-17T22:57:53.603 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-17T22:57:53.666 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140934 files and directories currently installed.) 2024-01-17T22:57:53.670 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-17T22:57:53.711 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:57:53.979 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-17T22:57:54.162 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-17T22:57:54.177 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-17T22:57:54.229 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:57:54.518 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:54.557 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package dump. 2024-01-17T22:57:54.573 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-17T22:57:54.615 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking dump (0.4b47-3) ... 2024-01-17T22:57:54.678 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:54.838 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-17T22:57:54.902 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package indent. 2024-01-17T22:57:54.918 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:57:54.960 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:57:55.122 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-common (238) ... 2024-01-17T22:57:55.246 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-17T22:57:55.262 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-17T22:57:55.313 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:57:55.633 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-17T22:57:55.649 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-17T22:57:55.692 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:57:55.952 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-17T22:57:55.969 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-17T22:57:56.011 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:57:56.065 INFO:teuthology.orchestra.run.smithi137.stdout:Adding user postgres to group ssl-cert 2024-01-17T22:57:56.279 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:56.279 INFO:teuthology.orchestra.run.smithi137.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-17T22:57:56.397 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-17T22:57:56.414 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:56.456 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:56.461 INFO:teuthology.orchestra.run.smithi137.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-17T22:57:56.461 INFO:teuthology.orchestra.run.smithi137.stdout:Removing obsolete dictionary files: 2024-01-17T22:57:56.734 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-17T22:57:56.750 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-17T22:57:56.792 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:57:57.013 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-17T22:57:57.044 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjson-perl. 2024-01-17T22:57:57.061 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-17T22:57:57.102 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-17T22:57:57.423 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:57:57.448 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-17T22:57:57.464 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-17T22:57:57.506 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:57:57.768 INFO:teuthology.orchestra.run.smithi137.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-17T22:57:57.787 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-17T22:57:57.828 INFO:teuthology.orchestra.run.smithi137.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout:This user must also own the server process. 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout:The database cluster will be initialized with locale "en_US". 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout:The default text search configuration will be set to "english". 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:57.855 INFO:teuthology.orchestra.run.smithi137.stdout:Data page checksums are disabled. 2024-01-17T22:57:57.856 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:57:57.856 INFO:teuthology.orchestra.run.smithi137.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-17T22:57:57.856 INFO:teuthology.orchestra.run.smithi137.stdout:creating subdirectories ... ok 2024-01-17T22:57:57.856 INFO:teuthology.orchestra.run.smithi137.stdout:selecting dynamic shared memory implementation ... posix 2024-01-17T22:57:57.857 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default max_connections ... 100 2024-01-17T22:57:57.862 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default shared_buffers ... 128MB 2024-01-17T22:57:57.872 INFO:teuthology.orchestra.run.smithi137.stdout:selecting default time zone ... Etc/UTC 2024-01-17T22:57:57.872 INFO:teuthology.orchestra.run.smithi137.stdout:creating configuration files ... ok 2024-01-17T22:57:57.986 INFO:teuthology.orchestra.run.smithi137.stdout:running bootstrap script ... ok 2024-01-17T22:57:58.647 INFO:teuthology.orchestra.run.smithi137.stdout:performing post-bootstrap initialization ... ok 2024-01-17T22:57:58.842 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-17T22:57:58.858 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:57:58.900 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:59.144 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-17T22:57:59.161 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-17T22:57:59.202 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:57:59.444 INFO:teuthology.orchestra.run.smithi137.stdout:syncing data to disk ... ok 2024-01-17T22:57:59.530 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-17T22:57:59.547 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:57:59.588 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:57:59.834 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-17T22:57:59.958 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-17T22:57:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-17T22:58:00.016 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:58:00.327 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-17T22:58:00.343 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:58:00.385 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:58:00.763 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-17T22:58:00.780 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:58:00.821 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:01.158 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-17T22:58:01.174 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:58:01.216 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:01.501 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-17T22:58:01.518 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:58:01.559 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:01.920 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-17T22:58:01.937 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-17T22:58:01.996 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:58:02.525 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-17T22:58:02.541 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-17T22:58:02.583 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:58:02.688 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:02.839 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-17T22:58:02.894 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package modemmanager. 2024-01-17T22:58:02.910 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-17T22:58:02.944 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:58:02.990 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up postgresql (14+238) ... 2024-01-17T22:58:03.142 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:03.293 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:58:03.577 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:58:03.579 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:58:03.691 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager. 2024-01-17T22:58:03.708 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-17T22:58:03.758 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:58:04.203 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-17T22:58:04.424 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ppp. 2024-01-17T22:58:04.440 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-17T22:58:04.522 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:58:04.682 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:58:04.770 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:58:05.078 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package pptp-linux. 2024-01-17T22:58:05.093 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-17T22:58:05.136 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-17T22:58:05.422 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-17T22:58:05.437 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-17T22:58:05.480 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-17T22:58:05.783 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-17T22:58:05.798 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-17T22:58:05.842 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-common (238) ... 2024-01-17T22:58:06.146 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-17T22:58:06.160 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-17T22:58:06.161 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:58:06.204 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:06.268 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:58:06.788 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:58:06.794 DEBUG:teuthology.parallel:result is None 2024-01-17T22:58:06.794 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-common. 2024-01-17T22:58:06.807 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-17T22:58:06.868 INFO:teuthology.orchestra.run.smithi067.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-17T22:58:06.903 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-common (238) ... 2024-01-17T22:58:07.691 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-14. 2024-01-17T22:58:07.708 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-17T22:58:07.752 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:08.860 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql. 2024-01-17T22:58:08.875 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-17T22:58:08.918 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql (14+238) ... 2024-01-17T22:58:09.162 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-client. 2024-01-17T22:58:09.177 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-17T22:58:09.220 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-client (14+238) ... 2024-01-17T22:58:09.464 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-17T22:58:09.479 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-17T22:58:09.522 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-17T22:58:09.792 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl8.6. 2024-01-17T22:58:09.807 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-17T22:58:09.883 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:58:10.178 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package tcl. 2024-01-17T22:58:10.193 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-17T22:58:10.240 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-17T22:58:10.572 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package wpasupplicant. 2024-01-17T22:58:10.588 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-17T22:58:10.630 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:58:11.012 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-17T22:58:11.028 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-17T22:58:11.070 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-17T22:58:11.448 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-17T22:58:11.465 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-17T22:58:11.514 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:58:11.801 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-common (238) ... 2024-01-17T22:58:11.995 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-17T22:58:12.163 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-17T22:58:12.289 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:12.415 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-17T22:58:12.541 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-17T22:58:12.675 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:13.651 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-17T22:58:13.756 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-17T22:58:14.140 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:58:14.140 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-17T22:58:14.851 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-17T22:58:14.977 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-17T22:58:15.103 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-17T22:58:15.212 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-17T22:58:15.338 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-17T22:58:15.506 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-17T22:58:15.631 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-17T22:58:16.312 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-17T22:58:16.421 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up dump (0.4b47-3) ... 2024-01-17T22:58:16.516 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-17T22:58:16.614 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:58:16.740 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-17T22:58:16.866 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-17T22:58:17.001 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-17T22:58:17.127 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-17T22:58:17.609 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-17T22:58:17.679 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-17T22:58:17.838 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-17T22:58:17.990 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-17T22:58:18.115 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:58:18.241 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-17T22:58:18.410 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-client (14+238) ... 2024-01-17T22:58:18.536 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-17T22:58:19.157 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:19.157 INFO:teuthology.orchestra.run.smithi067.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-17T22:58:19.157 INFO:teuthology.orchestra.run.smithi067.stdout:which means they are currently configured by ifupdown: 2024-01-17T22:58:19.157 INFO:teuthology.orchestra.run.smithi067.stdout:- enp3s0f1 2024-01-17T22:58:19.158 INFO:teuthology.orchestra.run.smithi067.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-17T22:58:19.158 INFO:teuthology.orchestra.run.smithi067.stdout:remove their configuration from /etc/network/interfaces. 2024-01-17T22:58:19.158 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:19.295 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-17T22:58:19.689 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-17T22:58:20.101 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-17T22:58:20.773 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-17T22:58:20.906 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-17T22:58:21.032 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-17T22:58:21.209 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-common (238) ... 2024-01-17T22:58:22.130 INFO:teuthology.orchestra.run.smithi067.stdout:Adding user postgres to group ssl-cert 2024-01-17T22:58:22.439 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:22.439 INFO:teuthology.orchestra.run.smithi067.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-17T22:58:22.718 INFO:teuthology.orchestra.run.smithi067.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-17T22:58:22.718 INFO:teuthology.orchestra.run.smithi067.stdout:Removing obsolete dictionary files: 2024-01-17T22:58:23.438 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-17T22:58:23.919 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-17T22:58:24.293 INFO:teuthology.orchestra.run.smithi067.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-17T22:58:24.311 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:This user must also own the server process. 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:The database cluster will be initialized with locale "en_US". 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:The default text search configuration will be set to "english". 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:Data page checksums are disabled. 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:24.366 INFO:teuthology.orchestra.run.smithi067.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-17T22:58:24.367 INFO:teuthology.orchestra.run.smithi067.stdout:creating subdirectories ... ok 2024-01-17T22:58:24.367 INFO:teuthology.orchestra.run.smithi067.stdout:selecting dynamic shared memory implementation ... posix 2024-01-17T22:58:24.391 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default max_connections ... 100 2024-01-17T22:58:24.427 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default shared_buffers ... 128MB 2024-01-17T22:58:24.441 INFO:teuthology.orchestra.run.smithi067.stdout:selecting default time zone ... Etc/UTC 2024-01-17T22:58:24.442 INFO:teuthology.orchestra.run.smithi067.stdout:creating configuration files ... ok 2024-01-17T22:58:24.614 INFO:teuthology.orchestra.run.smithi067.stdout:running bootstrap script ... ok 2024-01-17T22:58:25.246 INFO:teuthology.orchestra.run.smithi067.stdout:performing post-bootstrap initialization ... ok 2024-01-17T22:58:25.789 INFO:teuthology.orchestra.run.smithi067.stdout:syncing data to disk ... ok 2024-01-17T22:58:26.301 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-17T22:58:29.360 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:29.477 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-17T22:58:29.603 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up postgresql (14+238) ... 2024-01-17T22:58:29.729 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-17T22:58:29.855 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-17T22:58:30.123 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:58:30.123 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-17T22:58:30.833 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-17T22:58:31.127 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-17T22:58:31.319 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-17T22:58:32.764 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-17T22:58:32.873 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-17T22:58:33.407 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-17T22:58:33.413 DEBUG:teuthology.parallel:result is None 2024-01-17T22:58:33.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:58:33.637 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2024-01-17T22:58:33.659 INFO:teuthology.orchestra.run.smithi067.stdout:19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:58:33.660 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:58:33.660 INFO:teuthology.task.install:The correct ceph version 19.0.0-653-g1ec1182e-1jammy is installed. 2024-01-17T22:58:33.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T22:58:33.935 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-01-17T22:58:33.954 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:58:33.954 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-653-g1ec1182e-1jammy 2024-01-17T22:58:33.954 INFO:teuthology.task.install:The correct ceph version 19.0.0-653-g1ec1182e-1jammy is installed. 2024-01-17T22:58:33.956 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-17T22:58:33.956 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:33.956 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T22:58:33.977 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:33.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-17T22:58:34.011 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-17T22:58:34.011 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:34.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T22:58:34.038 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T22:58:34.098 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:34.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-01-17T22:58:34.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-17T22:58:34.161 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-17T22:58:34.162 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:34.162 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T22:58:34.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T22:58:34.246 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:34.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-17T22:58:34.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-17T22:58:34.314 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-17T22:58:34.314 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:34.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T22:58:34.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T22:58:34.394 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:34.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-01-17T22:58:34.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-17T22:58:34.463 INFO:teuthology.run_tasks:Running task ceph... 2024-01-17T22:58:34.539 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-17T22:58:34.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-01-17T22:58:34.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-01-17T22:58:34.559 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-17T22:58:34.559 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T22:58:34.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-17T22:58:34.622 INFO:tasks.ceph:Creating extra log directories... 2024-01-17T22:58:34.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T22:58:34.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-17T22:58:34.688 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-17T22:58:34.688 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-17T22:58:34.688 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-17T22:58:34.688 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:34.688 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-17T22:58:34.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:34.818 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:34.818 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-17T22:58:34.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-17T22:58:34.902 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-17T22:58:34.902 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-17T22:58:34.902 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7519277', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5791, 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'sleep_before_teardown': 0, 'subset': '209/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbBVX91fPWhWEghfT3/vYO8wim162SMfESdMeAMbx9/dXHCllqg004UB9sL6cF6d4GFju8DsG+UQ2ZEAE0M/qg=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLRieEIZnvYpaO6HMlc5Cf6XrKn7zR3BvvkenFAPRg0SGXfz8POMzwLMBhzj09sKUNTDwP/igCcPggeiyx/BCo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-17_20:20:37', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-17T22:58:34.903 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T22:58:34.906 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-17T22:58:34.944 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T22:58:34.957 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-01-17T22:58:34.999 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:34.999 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T22:58:35.023 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T22:58:35.024 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-17 21:40:42.217508400 +0000 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-17 21:40:41.949510725 +0000 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-17 21:40:41.949510725 +0000 2024-01-17T22:58:35.075 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-17 21:40:41.949510725 +0000 2024-01-17T22:58:35.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T22:58:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-17T22:58:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-17T22:58:35.136 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000366504 s, 1.4 MB/s 2024-01-17T22:58:35.138 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T22:58:35.188 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-17 21:40:42.713504095 +0000 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-17 21:40:42.457506316 +0000 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-17 21:40:42.457506316 +0000 2024-01-17T22:58:35.240 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-17 21:40:42.457506316 +0000 2024-01-17T22:58:35.240 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T22:58:35.300 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-17T22:58:35.301 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-17T22:58:35.301 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000350884 s, 1.5 MB/s 2024-01-17T22:58:35.302 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T22:58:35.353 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-01-17T22:58:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T22:58:35.403 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-17 21:40:43.261499341 +0000 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-17 21:40:42.989501701 +0000 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-17 21:40:42.989501701 +0000 2024-01-17T22:58:35.404 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-17 21:40:42.989501701 +0000 2024-01-17T22:58:35.404 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T22:58:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-17T22:58:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-17T22:58:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000373671 s, 1.4 MB/s 2024-01-17T22:58:35.467 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T22:58:35.521 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-01-17 21:40:43.765494967 +0000 2024-01-17T22:58:35.571 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-17 21:40:43.481497432 +0000 2024-01-17T22:58:35.572 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-17 21:40:43.481497432 +0000 2024-01-17T22:58:35.572 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-17 21:40:43.481497432 +0000 2024-01-17T22:58:35.572 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T22:58:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-01-17T22:58:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-01-17T22:58:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000369773 s, 1.4 MB/s 2024-01-17T22:58:35.635 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T22:58:35.689 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:35.689 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:35.689 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-01-17T22:58:35.694 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-17T22:58:35.694 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 21:40:26.844268395 +0000 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 21:40:26.592270807 +0000 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 21:40:26.592270807 +0000 2024-01-17T22:58:35.744 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-01-17T22:58:35.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-17T22:58:35.798 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T22:58:35.798 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T22:58:35.798 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000596177 s, 859 kB/s 2024-01-17T22:58:35.800 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-17T22:58:35.849 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-01-17T22:58:35.895 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 21:40:27.316263879 +0000 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 21:40:27.064266291 +0000 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 21:40:27.064266291 +0000 2024-01-17T22:58:35.896 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-01-17T22:58:35.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-17T22:58:35.949 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T22:58:35.949 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T22:58:35.950 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000499023 s, 1.0 MB/s 2024-01-17T22:58:35.951 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-17T22:58:36.001 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 21:40:27.824259020 +0000 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 21:40:27.564261508 +0000 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 21:40:27.564261508 +0000 2024-01-17T22:58:36.048 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-01-17T22:58:36.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-17T22:58:36.102 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T22:58:36.102 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T22:58:36.102 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000504722 s, 1.0 MB/s 2024-01-17T22:58:36.103 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-17T22:58:36.153 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-01-17T22:58:36.199 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-17T22:58:36.199 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 942 Links: 1 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-01-17 21:40:28.304254429 +0000 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-01-17 21:40:28.052256838 +0000 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-01-17 21:40:28.052256838 +0000 2024-01-17T22:58:36.200 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-01-17T22:58:36.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-17T22:58:36.254 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-01-17T22:58:36.254 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-01-17T22:58:36.254 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000508122 s, 1.0 MB/s 2024-01-17T22:58:36.255 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-17T22:58:36.305 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:36.305 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-17T22:58:36.305 INFO:tasks.ceph:Generating config... 2024-01-17T22:58:36.306 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-17T22:58:36.306 INFO:tasks.ceph:[client] debug client = 20 2024-01-17T22:58:36.306 INFO:tasks.ceph:[client] debug ms = 1 2024-01-17T22:58:36.306 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-17T22:58:36.306 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-17T22:58:36.306 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-17T22:58:36.306 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-17T22:58:36.307 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-17T22:58:36.307 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-17T22:58:36.307 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-17T22:58:36.308 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-17T22:58:36.308 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-17T22:58:36.308 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-17T22:58:36.308 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-17T22:58:36.308 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-17T22:58:36.309 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-17T22:58:36.309 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-17T22:58:36.309 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-17T22:58:36.309 INFO:tasks.ceph:Setting up mon.a... 2024-01-17T22:58:36.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-17T22:58:36.356 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-01-17T22:58:36.370 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-17T22:58:36.419 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:58:36.439 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.b', '172.21.15.137'), ('mon.c', '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]')] 2024-01-17T22:58:36.439 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-17T22:58:36.440 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:36.440 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T22:58:36.491 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --add b 172.21.15.137 --addv c '[v2:172.21.15.137:3301,v1:172.21.15.137:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:fsid cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-01-17T22:58:36.582420+0000 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-01-17T22:58:36.582420+0000 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.b 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] mon.c 2024-01-17T22:58:36.583 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-17T22:58:36.586 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-17T22:58:36.594 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1... 2024-01-17T22:58:36.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T22:58:36.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-01-17T22:58:36.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T22:58:36.670 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.67,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mds beacon grace = 60 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: mds heartbeat grace = 60 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-01-17T22:58:36.671 INFO:teuthology.orchestra.run.smithi137.stdout: osd heartbeat grace = 60 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-01-17T22:58:36.672 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-01-17T22:58:36.673 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore compression mode = aggressive 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: osd fast shutdown = False 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.674 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:58:36.675 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-01-17T22:58:36.676 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd crush smoke test = False 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-01-17T22:58:36.677 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.e] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.f] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: mds valgrind exit = True 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-01-17T22:58:36.678 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.679 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.680 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-01-17T22:58:36.681 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.137,[v2:172.21.15.137:3301,v1:172.21.15.137:6790]" 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: mds beacon grace = 60 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: mds heartbeat grace = 60 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: osd heartbeat grace = 60 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-01-17T22:58:36.682 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.683 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore compression mode = aggressive 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 20 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 20 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 10 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-01-17T22:58:36.684 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: osd fast shutdown = False 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-01-17T22:58:36.685 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-17T22:58:36.686 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd crush smoke test = False 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-17T22:58:36.687 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.e] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.f] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2024-01-17T22:58:36.688 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: mds valgrind exit = True 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2024-01-17T22:58:36.689 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2024-01-17T22:58:36.692 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-17T22:58:36.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-17T22:58:36.792 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-17T22:58:36.792 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:36.792 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-17T22:58:36.800 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:36.801 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-17T22:58:36.854 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T22:58:36.854 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:36.854 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T22:58:36.854 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:58:36.926 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:58:36.927 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:36.975 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T22:58:36.975 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:36.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-17T22:58:36.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-17T22:58:36.998 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:58:36.998 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:37.047 INFO:tasks.ceph:Setting up mon nodes... 2024-01-17T22:58:37.048 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-17T22:58:37.048 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-17T22:58:37.104 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-17T22:58:37.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T22:58:37.151 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-17T22:58:37.157 INFO:tasks.ceph:Setting up mds nodes... 2024-01-17T22:58:37.157 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-17T22:58:37.214 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-17T22:58:37.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-17T22:58:37.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-17T22:58:37.335 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-17T22:58:37.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-17T22:58:37.359 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-17T22:58:37.458 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-17T22:58:37.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-17T22:58:37.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-17T22:58:37.528 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-17T22:58:37.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-17T22:58:37.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-17T22:58:37.622 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-17T22:58:37.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-17T22:58:37.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-17T22:58:37.760 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-17T22:58:37.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-17T22:58:37.818 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-17T22:58:37.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-17T22:58:37.862 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-17T22:58:37.879 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-17T22:58:37.879 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-17T22:58:37.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-17T22:58:37.946 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:37.946 INFO:tasks.ceph:role: osd.0 2024-01-17T22:58:37.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T22:58:37.946 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:38.013 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:38.476 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-17T22:58:38.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-17T22:58:38.479 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-17T22:58:38.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-17T22:58:38.609 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:38.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:38.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-17T22:58:38.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:38.670 INFO:tasks.ceph:role: osd.1 2024-01-17T22:58:38.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T22:58:38.670 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:38.739 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:39.239 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-17T22:58:39.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-17T22:58:39.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-17T22:58:39.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-17T22:58:39.421 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:39.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:39.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-17T22:58:39.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:39.483 INFO:tasks.ceph:role: osd.2 2024-01-17T22:58:39.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T22:58:39.483 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-17T22:58:39.558 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:39.559 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:40.032 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-17T22:58:40.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-17T22:58:40.035 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-17T22:58:40.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-17T22:58:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:40.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:40.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-17T22:58:40.228 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:40.228 INFO:tasks.ceph:role: osd.3 2024-01-17T22:58:40.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T22:58:40.228 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:40.300 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:40.301 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:40.301 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:40.301 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:40.742 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-01-17T22:58:40.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-01-17T22:58:40.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-17T22:58:40.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-17T22:58:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:40.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:40.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:41.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:40.998+0000 7fdf2e9e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-17T22:58:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:41.002+0000 7fdf2e9e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-17T22:58:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:41.002+0000 7fdf2e9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:58:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:41.002+0000 7fdf2e9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:58:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:41.002+0000 7fdf2e9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-17T22:58:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:41.006+0000 7fdf2e9e8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-17T22:58:44.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-17T22:58:44.023 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:44.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.118+0000 7f368e9da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-17T22:58:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.118+0000 7f368e9da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-17T22:58:44.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.118+0000 7f368e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:58:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.118+0000 7f368e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:58:44.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.118+0000 7f368e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-17T22:58:44.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:44.122+0000 7f368e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-17T22:58:47.106 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-17T22:58:47.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:47.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-17T22:58:47.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-17T22:58:47.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:58:47.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:58:47.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-17T22:58:47.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:47.218+0000 7fb683e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-17T22:58:50.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-17T22:58:50.213 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:50.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-17T22:58:50.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:58:50.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:58:50.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-17T22:58:50.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:58:50.306+0000 7fd13fc29640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-17T22:58:53.285 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-17T22:58:53.306 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-17T22:58:53.320 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:53.320 INFO:tasks.ceph:role: osd.4 2024-01-17T22:58:53.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T22:58:53.320 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-17T22:58:53.385 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:53.385 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:53.386 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:53.831 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T22:58:53.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T22:58:53.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-17T22:58:53.923 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-17T22:58:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:53.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:53.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-17T22:58:54.029 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:54.029 INFO:tasks.ceph:role: osd.5 2024-01-17T22:58:54.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T22:58:54.029 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-17T22:58:54.093 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:54.093 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:54.093 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:54.093 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:54.093 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:54.094 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:54.094 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:54.094 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:54.094 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:54.094 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:54.577 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T22:58:54.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T22:58:54.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-17T22:58:54.713 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-17T22:58:54.723 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:54.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:54.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-17T22:58:54.779 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:54.779 INFO:tasks.ceph:role: osd.6 2024-01-17T22:58:54.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T22:58:54.779 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-17T22:58:54.842 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:54.842 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:54.842 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:54.842 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:54.842 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:54.843 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:54.843 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:54.843 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:54.843 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:54.843 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:55.320 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T22:58:55.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T22:58:55.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-17T22:58:55.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-17T22:58:55.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:55.464 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:55.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-17T22:58:55.519 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-17T22:58:55.519 INFO:tasks.ceph:role: osd.7 2024-01-17T22:58:55.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-17T22:58:55.519 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-01-17T22:58:55.583 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-17T22:58:55.584 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-17T22:58:55.584 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-17T22:58:55.584 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-17T22:58:56.006 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-01-17T22:58:56.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-01-17T22:58:56.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-17T22:58:56.107 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-17T22:58:56.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-17T22:58:56.118 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-01-17T22:58:56.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:56.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.336+0000 7fab78e7e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-17T22:58:56.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.336+0000 7fab78e7e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-17T22:58:56.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.336+0000 7fab78e7e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:58:56.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.336+0000 7fab78e7e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:58:56.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.336+0000 7fab78e7e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-17T22:58:56.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:56.340+0000 7fab78e7e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-17T22:58:59.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-17T22:58:59.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:58:59.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-17T22:58:59.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-17T22:58:59.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:58:59.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:58:59.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-17T22:58:59.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:58:59.400+0000 7f2c008b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-17T22:59:02.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-17T22:59:02.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:59:02.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-17T22:59:02.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-17T22:59:02.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:59:02.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:59:02.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-17T22:59:02.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:02.528+0000 7f1cb8c06640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-17T22:59:04.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:04.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:05.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-17T22:59:05.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:59:05.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-17T22:59:05.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-17T22:59:05.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:59:05.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:59:05.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-17T22:59:05.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:05.584+0000 7f4f8dad7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-17T22:59:08.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-17T22:59:08.624 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-17T22:59:08.624 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-17T22:59:08.647 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-17T22:59:08.712 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-17T22:59:08.776 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-17T22:59:08.839 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.840 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-17T22:59:08.903 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-17T22:59:08.967 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:08.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-17T22:59:09.032 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:09.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-17T22:59:09.095 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.095 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-17T22:59:09.108 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-17T22:59:09.162 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-17T22:59:09.219 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-17T22:59:09.274 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-17T22:59:09.331 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-17T22:59:09.386 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.386 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-17T22:59:09.443 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:09.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-17T22:59:09.499 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:09.499 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-17T22:59:09.508 INFO:tasks.ceph:Adding keys to all mons... 2024-01-17T22:59:09.509 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-17T22:59:09.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-17T22:59:09.569 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-01-17T22:59:09.569 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlBHEvBhAA1cJjVt6TXCprCH0nJQhKBQ== 2024-01-17T22:59:09.569 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlubG8DBAAGmWSAgtWvVuyt7tETC4oRg== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlXPvxExAAqH56y5QsecaE/Chit61Ajw== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.e] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlhTlCGxAAa3zc0xkQCsVYHO82owq9aw== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQChW6hlA/wmABAA3EDvDEdXlczmM6XJ6eagDQ== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCkW6hlrtI8BxAARO9qKCCcPjSkKu8kyvh67w== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCnW6hltd0mDRAAaAi3eRpqzSrdDcT+FW2UMQ== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCqW6hlazxbEhAAtrJFc9Nc1Khg/YplEpD+aw== 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-01-17T22:59:09.570 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlc6AMCRAAInJFlp3DhZvXFmkbsmGT3w== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hl/mOCHxAAik3DT+X1aKG78XWtUm+Agg== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlShknJRAARaUP5d0cgtAO4zGYW/J5ug== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.f] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlM6ldLRAAP006XrXOMRoMkOZbRiRPow== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCwW6hlLANFFBAAQy3TfxK4RTBm4knKj1/Mqw== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCzW6hl5VI4GBAArRrsMy4qf+AKKWkJZvbP7A== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQC2W6hlFCHFHxAAedd4IHyJllzoTRqFlTxfyw== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQC5W6hlB10jIxAAkl7jaK0iNfIEpKZfdeWXnw== 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-01-17T22:59:09.571 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCdW6hlPaZhMxAAenQ/MXxgRBa3hYeRGDXY2w== 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlBHEvBhAA1cJjVt6TXCprCH0nJQhKBQ== 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlubG8DBAAGmWSAgtWvVuyt7tETC4oRg== 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlXPvxExAAqH56y5QsecaE/Chit61Ajw== 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.e] 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlhTlCGxAAa3zc0xkQCsVYHO82owq9aw== 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-01-17T22:59:09.574 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQChW6hlA/wmABAA3EDvDEdXlczmM6XJ6eagDQ== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCkW6hlrtI8BxAARO9qKCCcPjSkKu8kyvh67w== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCnW6hltd0mDRAAaAi3eRpqzSrdDcT+FW2UMQ== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCqW6hlazxbEhAAtrJFc9Nc1Khg/YplEpD+aw== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlc6AMCRAAInJFlp3DhZvXFmkbsmGT3w== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hl/mOCHxAAik3DT+X1aKG78XWtUm+Agg== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlShknJRAARaUP5d0cgtAO4zGYW/J5ug== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.f] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlM6ldLRAAP006XrXOMRoMkOZbRiRPow== 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-01-17T22:59:09.575 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCwW6hlLANFFBAAQy3TfxK4RTBm4knKj1/Mqw== 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCzW6hl5VI4GBAArRrsMy4qf+AKKWkJZvbP7A== 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQC2W6hlFCHFHxAAedd4IHyJllzoTRqFlTxfyw== 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQC5W6hlB10jIxAAkl7jaK0iNfIEpKZfdeWXnw== 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-01-17T22:59:09.576 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCdW6hlPaZhMxAAenQ/MXxgRBa3hYeRGDXY2w== 2024-01-17T22:59:09.577 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:59:09.622 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:59:09.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.741 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:09.897 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:09.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:09.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:09.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.223 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:59:10.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-17T22:59:10.380 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.554 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-17T22:59:10.613 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.616 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.690 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.777 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-17T22:59:10.947 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T22:59:10.950 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-17T22:59:11.037 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-17T22:59:11.037 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-17T22:59:11.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:59:11.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-17T22:59:11.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-17T22:59:11.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:59:11.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-17T22:59:11.304 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-17T22:59:11.356 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-17T22:59:11.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-17T22:59:11.458 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:59:11.461 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-17T22:59:11.503 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-17T22:59:11.503 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:59:11.504 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-17T22:59:11.504 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-17T22:59:11.514 INFO:tasks.ceph.mon.a:Started 2024-01-17T22:59:11.514 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:59:11.514 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-17T22:59:11.514 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-17T22:59:11.548 INFO:tasks.ceph.mon.b:Started 2024-01-17T22:59:11.548 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-17T22:59:11.549 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-17T22:59:11.549 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-17T22:59:11.551 INFO:tasks.ceph.mon.c:Started 2024-01-17T22:59:11.551 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-17T22:59:11.551 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-17T22:59:11.551 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-17T22:59:11.555 INFO:tasks.ceph.mgr.y:Started 2024-01-17T22:59:11.555 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-17T22:59:11.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-17T22:59:11.558 INFO:tasks.ceph.mgr.x:Started 2024-01-17T22:59:11.558 INFO:tasks.ceph:Setting crush tunables to default 2024-01-17T22:59:11.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-01-17T22:59:11.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 Processor -- start 2024-01-17T22:59:11.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 -- start start 2024-01-17T22:59:11.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:11.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c7120 con 0x7f098c0c6cc0 2024-01-17T22:59:11.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f098c06e090 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0993400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1573c0 con 0x7f098c1516c0 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 msgr2=0x7f098c0c6780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f098c0b0640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0990a00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f098c06db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:11.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.693+0000 7f0990a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.897+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 msgr2=0x7f098c0c6780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.897+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.897+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f098c0b0640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.897+0000 7f0990a00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f098c06db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:11.897+0000 7f0990a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:12.301+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 msgr2=0x7f098c0c6780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:12.301+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:12.301+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f098c0b0640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:12.301+0000 7f0990a00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f098c06db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:12.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:12.301+0000 7f0990a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:13.105+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 msgr2=0x7f098c0c6780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:13.105+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:13.105+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f098c0b0640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:13.105+0000 7f0990a00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f098c06db50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:13.105+0000 7f0990a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:14.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f098c06db50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f098c06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 msgr2=0x7f098c0c6780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f098c06e090 0x7f098c0c6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f098c0b0640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c5cc0 con 0x7f0964006230 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f09640036d0 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f098be00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964006230 legacy=0x7f09640086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:14.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.693+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.897+0000 7f098be00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964006230 legacy=0x7f09640086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.897+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:14.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:14.897+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:15.301+0000 7f098be00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964006230 legacy=0x7f09640086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:15.301+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:15.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:15.301+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:16.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:16.105+0000 7f098be00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964006230 legacy=0x7f09640086f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:16.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:16.105+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:16.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:16.105+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964006230 legacy=0x7f09640086f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f0991400640 1 -- reap_dead start 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c7120 con 0x7f098c0c6cc0 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f09640036d0 2024-01-17T22:59:17.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096400acf0 con 0x7f098c1516c0 2024-01-17T22:59:17.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f096400a510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:17.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:17.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098be00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f0964009f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:17.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:17.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.693+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.897+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f096400a510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.897+0000 7f098be00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f0964009f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.897+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.897+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:17.897+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:18.301+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f096400a510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:18.301+0000 7f098be00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f0964009f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:18.301+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:18.301+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:18.301+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:19.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:19.105+0000 7f0991400640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f096400a510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.137:6789/0 2024-01-17T22:59:19.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:19.105+0000 7f0990a00640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3300/0 2024-01-17T22:59:19.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:19.105+0000 7f098be00640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f0964009f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.137:3301/0 2024-01-17T22:59:19.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:19.105+0000 7f0990a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:19.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:19.105+0000 7f098be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:20.015 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:00:08.323 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.043 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:00:08.351 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.373 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:00:08.681 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.394 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:00:08.703 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.520 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:00:08.736 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 -- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 msgr2=0x7f0964009f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c1516c0 0x7f0964009f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 -- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 msgr2=0x7f0964005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09640036d0 0x7f0964005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 -- >> v1:172.21.15.137:6789/0 conn(0x7f098c0c6cc0 legacy=0x7f096400a510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c5cc0 con 0x7f0964008e20 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f0964009200 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 msgr2=0x7f0964009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f0990a00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964008e20 legacy=0x7f09640086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:20.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.693+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:20.875 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:00:09.091 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T22:59:20.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.897+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 msgr2=0x7f0964009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:20.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.897+0000 7f0990a00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964008e20 legacy=0x7f09640086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:20.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:20.897+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:21.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:21.301+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 msgr2=0x7f0964009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:21.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:21.301+0000 7f0990a00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964008e20 legacy=0x7f09640086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:21.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:21.301+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:22.105+0000 7f0990a00640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964008e20 legacy=0x7f09640086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.67:6789/0 2024-01-17T22:59:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:22.105+0000 7f098be00640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 msgr2=0x7f0964009670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.67:3300/0 2024-01-17T22:59:22.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:22.105+0000 7f098be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 -- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 msgr2=0x7f0964009670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0964009200 0x7f0964009670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 -- >> v1:172.21.15.67:6789/0 conn(0x7f0964008e20 legacy=0x7f09640086d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f0991400640 1 -- reap_dead start 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c7120 con 0x7f09640131a0 2024-01-17T22:59:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f0964009f90 2024-01-17T22:59:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.693+0000 7f098a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096400acf0 con 0x7f096400a370 2024-01-17T22:59:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.697+0000 7f0991400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.697+0000 7f0991400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:44766/0 (socket says 172.21.15.67:44766) 2024-01-17T22:59:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.697+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 learned_addr learned my addr 172.21.15.67:0/3268931281 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:23.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.697+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.701+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:59:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.701+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.701+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.701+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.709+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-17T22:59:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.709+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.709+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.709+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-17T22:59:23.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.905+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.913+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.913+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-17T22:59:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.913+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.913+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:23.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.913+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:23.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.925+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:59:23.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.925+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:23.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.925+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:23.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:23.925+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-17T22:59:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.317+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.317+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:59:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.317+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.317+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.317+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:24.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.329+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.333+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:59:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.333+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.333+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:24.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:24.333+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-17T22:59:25.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.181+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.197+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-17T22:59:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.197+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.197+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:25.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.197+0000 7f0991400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.201+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:25.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.273+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-17T22:59:25.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.273+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-17T22:59:25.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.273+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-17T22:59:25.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:25.273+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-17T22:59:26.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.649+0000 7f098b400640 1 -- 172.21.15.67:0/3268931281 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783716991 0 0) 0x7f098c0c7120 con 0x7f09640131a0 2024-01-17T22:59:26.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.649+0000 7f098b400640 1 -- 172.21.15.67:0/3268931281 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f096c003530 con 0x7f09640131a0 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 msgr2=0x7f0964003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f096400a370 0x7f0964003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 -- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 msgr2=0x7f0964009640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.137:3300/0 conn(0x7f0964009f90 0x7f0964009640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 -- 172.21.15.67:0/3268931281 >> v1:172.21.15.67:6789/0 conn(0x7f09640131a0 legacy=0x7f0964006640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:26.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.67:3300/0 conn(0x7f0964005b80 0x7f096400f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 -- 172.21.15.67:0/3268931281 --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c5cc0 con 0x7f0964004080 2024-01-17T22:59:26.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.693+0000 7f098a000640 1 -- 172.21.15.67:0/3268931281 --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c158410 con 0x7f0964005b80 2024-01-17T22:59:26.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.713+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> v2:172.21.15.67:3300/0 conn(0x7f0964005b80 0x7f096400f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:26.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.737+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 >> v1:172.21.15.137:6789/0 conn(0x7f0964004080 legacy=0x7f0964004460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:26.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.737+0000 7f098be00640 1 -- 172.21.15.67:0/3268931281 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096400f6e0 con 0x7f0964005b80 2024-01-17T22:59:26.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.757+0000 7f098be00640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0964005b80 0x7f096400f170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0974003990 tx=0x7f097401d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0b17119e0662ca server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:26.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f098b400640 1 -- 172.21.15.67:0/3268931281 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740ae410 con 0x7f0964005b80 2024-01-17T22:59:26.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f098b400640 1 -- 172.21.15.67:0/3268931281 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09740a8070 con 0x7f0964005b80 2024-01-17T22:59:26.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f098b400640 1 -- 172.21.15.67:0/3268931281 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740ae830 con 0x7f0964005b80 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- 172.21.15.67:0/3268931281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0964005b80 msgr2=0x7f096400f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0964005b80 0x7f096400f170 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0974003990 tx=0x7f097401d560 comp rx=0 tx=0).stop 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0991400640 1 -- 172.21.15.67:0/3268931281 reap_dead start 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- 172.21.15.67:0/3268931281 shutdown_connections 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 --2- 172.21.15.67:0/3268931281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0964005b80 0x7f096400f170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:26.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- 172.21.15.67:0/3268931281 >> 172.21.15.67:0/3268931281 conn(0x7f098c0c7a90 msgr2=0x7f098c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:26.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- 172.21.15.67:0/3268931281 shutdown_connections 2024-01-17T22:59:26.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- 172.21.15.67:0/3268931281 wait complete. 2024-01-17T22:59:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 Processor -- start 2024-01-17T22:59:26.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.809+0000 7f0993400640 1 -- start start 2024-01-17T22:59:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0964005b80 0x7f098c1e5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c14ea20 0x7f098c0c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:26.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c14f770 con 0x7f098c0c4190 2024-01-17T22:59:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0c5520 con 0x7f0964005b80 2024-01-17T22:59:26.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.813+0000 7f0993400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0c4910 con 0x7f098c14ea20 2024-01-17T22:59:26.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.821+0000 7f098be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.829+0000 7f098be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36986/0 (socket says 172.21.15.67:36986) 2024-01-17T22:59:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.829+0000 7f098be00640 1 -- 172.21.15.67:0/3731305478 learned_addr learned my addr 172.21.15.67:0/3731305478 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:26.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.841+0000 7f0990a00640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0964005b80 0x7f098c1e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.845+0000 7f098be00640 1 -- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c14ea20 msgr2=0x7f098c0c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.845+0000 7f098be00640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c14ea20 0x7f098c0c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.845+0000 7f098be00640 1 -- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0964005b80 msgr2=0x7f098c1e5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.845+0000 7f098be00640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0964005b80 0x7f098c1e5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:26.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.845+0000 7f098be00640 1 -- 172.21.15.67:0/3731305478 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974009b10 con 0x7f098c0c4190 2024-01-17T22:59:26.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.857+0000 7f098be00640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f097401d5a0 tx=0x7f097401a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974003970 con 0x7f098c0c4190 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974014000 con 0x7f098c0c4190 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740b8690 con 0x7f098c0c4190 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c0c4bf0 con 0x7f098c0c4190 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c0c51b0 con 0x7f098c0c4190 2024-01-17T22:59:26.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:26.905+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c0746a0 con 0x7f098c0c4190 2024-01-17T22:59:27.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.101+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f09740b5040 con 0x7f098c0c4190 2024-01-17T22:59:27.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.101+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f09740c4c50 con 0x7f098c0c4190 2024-01-17T22:59:27.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.101+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f09740bf030 con 0x7f098c0c4190 2024-01-17T22:59:27.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.177+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f098c14d970 con 0x7f098c0c4190 2024-01-17T22:59:27.225 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:27.220+0000 7f563d054180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-17T22:59:27.378 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:27.373+0000 7ff8b6a4c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-17T22:59:27.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0988c00640 1 -- 172.21.15.67:0/3731305478 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f09740b3070 con 0x7f098c0c4190 2024-01-17T22:59:27.472 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-01-17T22:59:27.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 msgr2=0x7f098c0c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:27.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f097401d5a0 tx=0x7f097401a300 comp rx=0 tx=0).stop 2024-01-17T22:59:27.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 shutdown_connections 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f098c14ea20 0x7f098c0c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f098c0c4190 0x7f098c0c12b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 --2- 172.21.15.67:0/3731305478 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0964005b80 0x7f098c1e5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 >> 172.21.15.67:0/3731305478 conn(0x7f098c0c7a90 msgr2=0x7f098c0c7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 shutdown_connections 2024-01-17T22:59:27.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:27.469+0000 7f0993400640 1 -- 172.21.15.67:0/3731305478 wait complete. 2024-01-17T22:59:27.494 INFO:tasks.ceph:check_enable_crimson: False 2024-01-17T22:59:27.494 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-17T22:59:27.495 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:27.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-17T22:59:27.515 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:27.515 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-17T22:59:27.574 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:27.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-17T22:59:27.634 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T22:59:27.634 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-17T22:59:27.699 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:27.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-17T22:59:27.711 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:27.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-17T22:59:27.746 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:27.740+0000 7f563d054180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-17T22:59:27.757 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:27.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-17T22:59:27.808 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-01-17T22:59:27.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-17T22:59:27.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 737cbe53-a176-4dd6-b75a-58bcd81c59f0 0 2024-01-17T22:59:27.912 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:27.909+0000 7ff8b6a4c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-17T22:59:27.943 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:27.940+0000 7f563d054180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-17T22:59:28.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 Processor -- start 2024-01-17T22:59:28.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 -- start start 2024-01-17T22:59:28.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 0x7f2f1c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c061340 con 0x7f2f1c0c62d0 2024-01-17T22:59:28.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0c6ce0 con 0x7f2f1c162240 2024-01-17T22:59:28.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f2104b640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0c3370 con 0x7f2f1c153bf0 2024-01-17T22:59:28.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f1b59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2f1c162240 0x7f2f1c164630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58886/0 (socket says 172.21.15.137:58886) 2024-01-17T22:59:28.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f1b59e640 1 -- 172.21.15.137:0/1590397943 learned_addr learned my addr 172.21.15.137:0/1590397943 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-01-17T22:59:28.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.024+0000 7f2f1ad9d640 1 --2- 172.21.15.137:0/1590397943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 0x7f2f1c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.028+0000 7f2f19d9b640 1 -- 172.21.15.137:0/1590397943 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94683067 0 0) 0x7f2f1c061340 con 0x7f2f1c0c62d0 2024-01-17T22:59:28.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.028+0000 7f2f19d9b640 1 -- 172.21.15.137:0/1590397943 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f04003530 con 0x7f2f1c0c62d0 2024-01-17T22:59:28.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.028+0000 7f2f1ad9d640 1 -- 172.21.15.137:0/1590397943 >> v1:172.21.15.137:6789/0 conn(0x7f2f1c162240 legacy=0x7f2f1c164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.028+0000 7f2f1ad9d640 1 -- 172.21.15.137:0/1590397943 >> v1:172.21.15.67:6789/0 conn(0x7f2f1c0c62d0 legacy=0x7f2f1c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.028+0000 7f2f1ad9d640 1 -- 172.21.15.137:0/1590397943 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0c5a30 con 0x7f2f1c153bf0 2024-01-17T22:59:28.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.032+0000 7f2f1ad9d640 1 --2- 172.21.15.137:0/1590397943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 0x7f2f1c15cf20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f100097f0 tx=0x7f2f1001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d8b2953607293c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f19d9b640 1 -- 172.21.15.137:0/1590397943 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100a7070 con 0x7f2f1c153bf0 2024-01-17T22:59:28.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f19d9b640 1 -- 172.21.15.137:0/1590397943 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f100ab430 con 0x7f2f1c153bf0 2024-01-17T22:59:28.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f19d9b640 1 -- 172.21.15.137:0/1590397943 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100ab7c0 con 0x7f2f1c153bf0 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- 172.21.15.137:0/1590397943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 msgr2=0x7f2f1c15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1590397943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 0x7f2f1c15cf20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f100097f0 tx=0x7f2f1001c430 comp rx=0 tx=0).stop 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- 172.21.15.137:0/1590397943 shutdown_connections 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1590397943 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c153bf0 0x7f2f1c15cf20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- 172.21.15.137:0/1590397943 >> 172.21.15.137:0/1590397943 conn(0x7f2f1c071af0 msgr2=0x7f2f1c071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- 172.21.15.137:0/1590397943 shutdown_connections 2024-01-17T22:59:28.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- 172.21.15.137:0/1590397943 wait complete. 2024-01-17T22:59:28.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 Processor -- start 2024-01-17T22:59:28.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- start start 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c0c62d0 0x7f2f1c142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f1c153bf0 0x7f2f1c151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c146ff0 con 0x7f2f1c162240 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1534a0 con 0x7f2f1c153bf0 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.044+0000 7f2f2104b640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1529d0 con 0x7f2f1c0c62d0 2024-01-17T22:59:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.048+0000 7f2f1b59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.048+0000 7f2f1b59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.137:42316/0 (socket says 172.21.15.137:42316) 2024-01-17T22:59:28.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.048+0000 7f2f1b59e640 1 -- 172.21.15.137:0/1251510242 learned_addr learned my addr 172.21.15.137:0/1251510242 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:28.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.048+0000 7f2f1a59c640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f1c153bf0 0x7f2f1c151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 -- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c0c62d0 msgr2=0x7f2f1c142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c0c62d0 0x7f2f1c142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 -- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f1c153bf0 msgr2=0x7f2f1c151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f1c153bf0 0x7f2f1c151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 -- 172.21.15.137:0/1251510242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f10009420 con 0x7f2f1c162240 2024-01-17T22:59:28.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.052+0000 7f2f1b59e640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400caa0 tx=0x7f2f1400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400aba0 con 0x7f2f1c162240 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400ad00 con 0x7f2f1c162240 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14012600 con 0x7f2f1c162240 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c152cb0 con 0x7f2f1c162240 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c159300 con 0x7f2f1c162240 2024-01-17T22:59:28.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.056+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c06c100 con 0x7f2f1c162240 2024-01-17T22:59:28.125 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:28.121+0000 7ff8b6a4c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-17T22:59:28.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.160+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2f14012760 con 0x7f2f1c162240 2024-01-17T22:59:28.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.164+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f1401cda0 con 0x7f2f1c162240 2024-01-17T22:59:28.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.168+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f2f14021060 con 0x7f2f1c162240 2024-01-17T22:59:28.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.244+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "737cbe53-a176-4dd6-b75a-58bcd81c59f0", "id": 0} v 0) v1 -- 0x7f2f1c072940 con 0x7f2f1c162240 2024-01-17T22:59:28.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f037fe640 1 -- 172.21.15.137:0/1251510242 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "737cbe53-a176-4dd6-b75a-58bcd81c59f0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f14017070 con 0x7f2f1c162240 2024-01-17T22:59:28.376 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-01-17T22:59:28.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 msgr2=0x7f2f1c143d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400caa0 tx=0x7f2f1400cf60 comp rx=0 tx=0).stop 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 shutdown_connections 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f1c162240 0x7f2f1c143d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f1c153bf0 0x7f2f1c151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 --2- 172.21.15.137:0/1251510242 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f1c0c62d0 0x7f2f1c142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 >> 172.21.15.137:0/1251510242 conn(0x7f2f1c071af0 msgr2=0x7f2f1c145640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 shutdown_connections 2024-01-17T22:59:28.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.372+0000 7f2f2104b640 1 -- 172.21.15.137:0/1251510242 wait complete. 2024-01-17T22:59:28.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 821fecd1-9c6f-4c70-804f-cfc665c49c20 1 2024-01-17T22:59:28.534 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.528+0000 7f563d054180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 Processor -- start 2024-01-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 -- start start 2024-01-17T22:59:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 0x7f2cc015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cc0162240 0x7f2cc0164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00612c0 con 0x7f2cc00c62d0 2024-01-17T22:59:28.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00c3370 con 0x7f2cc0153bf0 2024-01-17T22:59:28.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cc4994640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00c6ce0 con 0x7f2cc0162240 2024-01-17T22:59:28.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cbed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cc0162240 0x7f2cc0164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cbed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cc0162240 0x7f2cc0164630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43232/0 (socket says 172.21.15.137:43232) 2024-01-17T22:59:28.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cbed9d640 1 -- 172.21.15.137:0/4239807143 learned_addr learned my addr 172.21.15.137:0/4239807143 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:28.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.544+0000 7f2cbe59c640 1 --2- 172.21.15.137:0/4239807143 >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 0x7f2cc015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.548+0000 7f2cbed9d640 1 -- 172.21.15.137:0/4239807143 >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 msgr2=0x7f2cc015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.548+0000 7f2cbed9d640 1 --2- 172.21.15.137:0/4239807143 >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 0x7f2cc015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.548+0000 7f2cbed9d640 1 -- 172.21.15.137:0/4239807143 >> v1:172.21.15.137:6789/0 conn(0x7f2cc00c62d0 legacy=0x7f2cc015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.548+0000 7f2cbed9d640 1 -- 172.21.15.137:0/4239807143 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00c5a30 con 0x7f2cc0162240 2024-01-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.548+0000 7f2cbe59c640 1 --2- 172.21.15.137:0/4239807143 >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 0x7f2cc015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:59:28.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.556+0000 7f2cbed9d640 1 --2- 172.21.15.137:0/4239807143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0164630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00c3f90 tx=0x7f2cb801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb895d408070ca4b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.592 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.588+0000 7f563d054180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-17T22:59:28.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cbd59a640 1 -- 172.21.15.137:0/4239807143 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a5800 con 0x7f2cc0162240 2024-01-17T22:59:28.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cbd59a640 1 -- 172.21.15.137:0/4239807143 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80a5960 con 0x7f2cc0162240 2024-01-17T22:59:28.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cbd59a640 1 -- 172.21.15.137:0/4239807143 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80a5cf0 con 0x7f2cc0162240 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 -- 172.21.15.137:0/4239807143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 msgr2=0x7f2cc0164630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 --2- 172.21.15.137:0/4239807143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0164630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00c3f90 tx=0x7f2cb801c940 comp rx=0 tx=0).stop 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 -- 172.21.15.137:0/4239807143 shutdown_connections 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 --2- 172.21.15.137:0/4239807143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0164630 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 --2- 172.21.15.137:0/4239807143 >> v2:172.21.15.67:3300/0 conn(0x7f2cc0153bf0 0x7f2cc015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 -- 172.21.15.137:0/4239807143 >> 172.21.15.137:0/4239807143 conn(0x7f2cc0071af0 msgr2=0x7f2cc0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 -- 172.21.15.137:0/4239807143 shutdown_connections 2024-01-17T22:59:28.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.604+0000 7f2cc4994640 1 -- 172.21.15.137:0/4239807143 wait complete. 2024-01-17T22:59:28.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 Processor -- start 2024-01-17T22:59:28.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 -- start start 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc00c62d0 0x7f2cc00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 0x7f2cc01f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0157f90 con 0x7f2cc00c62d0 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc01f6220 con 0x7f2cc0162240 2024-01-17T22:59:28.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cc4994640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0145a10 con 0x7f2cc0153bf0 2024-01-17T22:59:28.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cbed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cbdd9b640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 0x7f2cc01f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cbe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc00c62d0 0x7f2cc00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:28.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cbed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43242/0 (socket says 172.21.15.137:43242) 2024-01-17T22:59:28.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.608+0000 7f2cbed9d640 1 -- 172.21.15.137:0/2444244823 learned_addr learned my addr 172.21.15.137:0/2444244823 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:28.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.612+0000 7f2cbdd9b640 1 -- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 msgr2=0x7f2cc0144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.612+0000 7f2cbdd9b640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.612+0000 7f2cbdd9b640 1 -- 172.21.15.137:0/2444244823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc00c62d0 msgr2=0x7f2cc00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:28.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.612+0000 7f2cbdd9b640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc00c62d0 0x7f2cc00cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:28.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.612+0000 7f2cbdd9b640 1 -- 172.21.15.137:0/2444244823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009420 con 0x7f2cc0153bf0 2024-01-17T22:59:28.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.616+0000 7f2cbdd9b640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 0x7f2cc01f2270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0063ce0 tx=0x7f2cb400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:28.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.620+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40052d0 con 0x7f2cc0153bf0 2024-01-17T22:59:28.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.620+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb8009b30 con 0x7f2cc0153bf0 2024-01-17T22:59:28.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.620+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0145730 con 0x7f2cc0153bf0 2024-01-17T22:59:28.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.620+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0072940 con 0x7f2cc0153bf0 2024-01-17T22:59:28.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.624+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4005430 con 0x7f2cc0153bf0 2024-01-17T22:59:28.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.624+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4007220 con 0x7f2cc0153bf0 2024-01-17T22:59:28.653 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.648+0000 7f563d054180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-17T22:59:28.736 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.732+0000 7f563d054180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-17T22:59:28.764 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:28.761+0000 7ff8b6a4c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-17T22:59:28.792 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.788+0000 7f563d054180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-17T22:59:28.829 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:28.825+0000 7ff8b6a4c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-17T22:59:28.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.828+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2cb40067e0 con 0x7f2cc0153bf0 2024-01-17T22:59:28.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.828+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2cb4003d50 con 0x7f2cc0153bf0 2024-01-17T22:59:28.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.828+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f2cb4020060 con 0x7f2cc0153bf0 2024-01-17T22:59:28.874 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.868+0000 7f563d054180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-17T22:59:28.895 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:28.889+0000 7ff8b6a4c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-17T22:59:28.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:28.912+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "821fecd1-9c6f-4c70-804f-cfc665c49c20", "id": 1} v 0) v1 -- 0x7f2cc00746a0 con 0x7f2cc0153bf0 2024-01-17T22:59:28.927 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:28.924+0000 7f563d054180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-17T22:59:28.996 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:28.993+0000 7ff8b6a4c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-17T22:59:29.070 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:29.064+0000 7f563d054180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-17T22:59:29.070 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:29.065+0000 7ff8b6a4c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-17T22:59:29.133 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:29.128+0000 7f563d054180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-17T22:59:29.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2caeffd640 1 -- 172.21.15.137:0/2444244823 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "821fecd1-9c6f-4c70-804f-cfc665c49c20", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2cb4006c20 con 0x7f2cc0153bf0 2024-01-17T22:59:29.145 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 msgr2=0x7f2cc01f2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 0x7f2cc01f2270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0063ce0 tx=0x7f2cb400c820 comp rx=0 tx=0).stop 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 shutdown_connections 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cc0162240 0x7f2cc0144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cc0153bf0 0x7f2cc01f2270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 --2- 172.21.15.137:0/2444244823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc00c62d0 0x7f2cc00cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 >> 172.21.15.137:0/2444244823 conn(0x7f2cc0071af0 msgr2=0x7f2cc0071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 shutdown_connections 2024-01-17T22:59:29.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.140+0000 7f2cc4994640 1 -- 172.21.15.137:0/2444244823 wait complete. 2024-01-17T22:59:29.164 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:29.161+0000 7ff8b6a4c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-17T22:59:29.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 4c27f159-264f-4f37-96dd-a6d63f8e48f8 2 2024-01-17T22:59:29.226 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:29.221+0000 7ff8b6a4c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-17T22:59:29.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 Processor -- start 2024-01-17T22:59:29.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 -- start start 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7d4c0ca520 0x7f7d4c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d4c0ca960 0x7f7d4c071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c15a8e0 con 0x7f7d4c0ca520 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0c7f00 con 0x7f7d4c0ca960 2024-01-17T22:59:29.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d5268d640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c15d040 con 0x7f7d4c153bb0 2024-01-17T22:59:29.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.276+0000 7f7d50c2a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d4c0ca960 0x7f7d4c071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7d4c0ca520 0x7f7d4c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:35918/0 (socket says 172.21.15.137:35918) 2024-01-17T22:59:29.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 -- 172.21.15.137:0/1125448744 learned_addr learned my addr 172.21.15.137:0/1125448744 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:29.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 -- 172.21.15.137:0/1125448744 >> v2:172.21.15.137:3300/0 conn(0x7f7d4c0ca960 msgr2=0x7f7d4c071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 --2- 172.21.15.137:0/1125448744 >> v2:172.21.15.137:3300/0 conn(0x7f7d4c0ca960 0x7f7d4c071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 -- 172.21.15.137:0/1125448744 >> v2:172.21.15.67:3300/0 conn(0x7f7d4c0ca520 msgr2=0x7f7d4c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 --2- 172.21.15.137:0/1125448744 >> v2:172.21.15.67:3300/0 conn(0x7f7d4c0ca520 0x7f7d4c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.280+0000 7f7d4bfff640 1 -- 172.21.15.137:0/1125448744 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c15d320 con 0x7f7d4c153bb0 2024-01-17T22:59:29.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.284+0000 7f7d4bfff640 1 --2- 172.21.15.137:0/1125448744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cb060 tx=0x7f7d3c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e81885d9a39e61e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d4affd640 1 -- 172.21.15.137:0/1125448744 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0aa5f0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d4affd640 1 -- 172.21.15.137:0/1125448744 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c0aa750 con 0x7f7d4c153bb0 2024-01-17T22:59:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d4affd640 1 -- 172.21.15.137:0/1125448744 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0aaae0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 -- 172.21.15.137:0/1125448744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 msgr2=0x7f7d4c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 --2- 172.21.15.137:0/1125448744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cb060 tx=0x7f7d3c01c4d0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 -- 172.21.15.137:0/1125448744 shutdown_connections 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 --2- 172.21.15.137:0/1125448744 >> v2:172.21.15.137:3300/0 conn(0x7f7d4c0ca960 0x7f7d4c071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 --2- 172.21.15.137:0/1125448744 >> v2:172.21.15.67:3300/0 conn(0x7f7d4c0ca520 0x7f7d4c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 --2- 172.21.15.137:0/1125448744 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c153bb0 0x7f7d4c15a3a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 -- 172.21.15.137:0/1125448744 >> 172.21.15.137:0/1125448744 conn(0x7f7d4c070780 msgr2=0x7f7d4c06f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 -- 172.21.15.137:0/1125448744 shutdown_connections 2024-01-17T22:59:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.288+0000 7f7d5268d640 1 -- 172.21.15.137:0/1125448744 wait complete. 2024-01-17T22:59:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 Processor -- start 2024-01-17T22:59:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 -- start start 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 0x7f7d4c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 0x7f7d4c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 0x7f7d4c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c159020 con 0x7f7d4c153bb0 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c159210 con 0x7f7d4c0ca960 2024-01-17T22:59:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d5268d640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1594f0 con 0x7f7d4c0ca520 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 0x7f7d4c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 0x7f7d4c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d50c2a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 0x7f7d4c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 0x7f7d4c1525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43270/0 (socket says 172.21.15.137:43270) 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d4bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 0x7f7d4c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:35930/0 (socket says 172.21.15.137:35930) 2024-01-17T22:59:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.292+0000 7f7d4b7fe640 1 -- 172.21.15.137:0/2771292295 learned_addr learned my addr 172.21.15.137:0/2771292295 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 -- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 msgr2=0x7f7d4c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 0x7f7d4c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 -- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 msgr2=0x7f7d4c1525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 0x7f7d4c1525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 -- 172.21.15.137:0/2771292295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0094d0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.296+0000 7f7d50c2a640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 0x7f7d4c152af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400ef90 tx=0x7f7d4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44009c00 con 0x7f7d4c153bb0 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400f040 con 0x7f7d4c153bb0 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440146c0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1597d0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c159d90 con 0x7f7d4c153bb0 2024-01-17T22:59:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.304+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c0746a0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.463 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:29.461+0000 7ff8b6a4c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-17T22:59:29.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.488+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f7d44014ba0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.496+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7d44013800 con 0x7f7d4c153bb0 2024-01-17T22:59:29.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.496+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7d4403bcf0 con 0x7f7d4c153bb0 2024-01-17T22:59:29.549 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:29.545+0000 7ff8b6a4c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-17T22:59:29.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.560+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4c27f159-264f-4f37-96dd-a6d63f8e48f8", "id": 2} v 0) v1 -- 0x7f7d4c164080 con 0x7f7d4c153bb0 2024-01-17T22:59:29.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.604+0000 7f7d48ff9640 1 -- 172.21.15.137:0/2771292295 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c27f159-264f-4f37-96dd-a6d63f8e48f8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7d4402a070 con 0x7f7d4c153bb0 2024-01-17T22:59:29.611 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 msgr2=0x7f7d4c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 0x7f7d4c152af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400ef90 tx=0x7f7d4400c490 comp rx=0 tx=0).stop 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 shutdown_connections 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d4c153bb0 0x7f7d4c152af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d4c0ca960 0x7f7d4c1525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 --2- 172.21.15.137:0/2771292295 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7d4c0ca520 0x7f7d4c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 >> 172.21.15.137:0/2771292295 conn(0x7f7d4c070780 msgr2=0x7f7d4c0cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 shutdown_connections 2024-01-17T22:59:29.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.608+0000 7f7d5268d640 1 -- 172.21.15.137:0/2771292295 wait complete. 2024-01-17T22:59:29.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new b135c646-e754-4bfd-b04d-28624a242fe0 3 2024-01-17T22:59:29.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 Processor -- start 2024-01-17T22:59:29.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 -- start start 2024-01-17T22:59:29.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 0x7fab5006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab500c6bd0 0x7fab5006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab501573d0 con 0x7fab5006a6e0 2024-01-17T22:59:29.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5006b190 con 0x7fab500c6bd0 2024-01-17T22:59:29.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab5514e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5006b470 con 0x7fab50156ff0 2024-01-17T22:59:29.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.736+0000 7fab4ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 0x7fab5006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4e59c640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fab500c6bd0 0x7fab5006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 0x7fab5006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43280/0 (socket says 172.21.15.137:43280) 2024-01-17T22:59:29.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4ed9d640 1 -- 172.21.15.137:0/897572025 learned_addr learned my addr 172.21.15.137:0/897572025 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:29.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4e59c640 1 -- 172.21.15.137:0/897572025 >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 msgr2=0x7fab5006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4e59c640 1 --2- 172.21.15.137:0/897572025 >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 0x7fab5006e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4e59c640 1 -- 172.21.15.137:0/897572025 >> v1:172.21.15.137:6789/0 conn(0x7fab5006a6e0 legacy=0x7fab50159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:29.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.740+0000 7fab4e59c640 1 -- 172.21.15.137:0/897572025 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5006b750 con 0x7fab500c6bd0 2024-01-17T22:59:29.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.744+0000 7fab4e59c640 1 --2- 172.21.15.137:0/897572025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5006e730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab5006c920 tx=0x7fab4001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7757d0406f2eeb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab4dd9b640 1 -- 172.21.15.137:0/897572025 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400a8910 con 0x7fab500c6bd0 2024-01-17T22:59:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab4dd9b640 1 -- 172.21.15.137:0/897572025 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab400a8a70 con 0x7fab500c6bd0 2024-01-17T22:59:29.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab4dd9b640 1 -- 172.21.15.137:0/897572025 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400a8e00 con 0x7fab500c6bd0 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 -- 172.21.15.137:0/897572025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 msgr2=0x7fab5006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 --2- 172.21.15.137:0/897572025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5006e730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab5006c920 tx=0x7fab4001ec10 comp rx=0 tx=0).stop 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 -- 172.21.15.137:0/897572025 shutdown_connections 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 --2- 172.21.15.137:0/897572025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5006e730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 --2- 172.21.15.137:0/897572025 >> v2:172.21.15.137:3300/0 conn(0x7fab50156ff0 0x7fab5006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 -- 172.21.15.137:0/897572025 >> 172.21.15.137:0/897572025 conn(0x7fab50061820 msgr2=0x7fab50072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 -- 172.21.15.137:0/897572025 shutdown_connections 2024-01-17T22:59:29.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.748+0000 7fab5514e640 1 -- 172.21.15.137:0/897572025 wait complete. 2024-01-17T22:59:29.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 Processor -- start 2024-01-17T22:59:29.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 -- start start 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 0x7fab500cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50156ff0 0x7fab501584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50158040 con 0x7fab500c6bd0 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab501597d0 con 0x7fab5006a6e0 2024-01-17T22:59:29.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab5514e640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab501efd80 con 0x7fab50156ff0 2024-01-17T22:59:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab4ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 0x7fab500cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab4e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab4f59e640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50156ff0 0x7fab501584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab4ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 0x7fab500cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43282/0 (socket says 172.21.15.137:43282) 2024-01-17T22:59:29.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.752+0000 7fab4ed9d640 1 -- 172.21.15.137:0/1737944748 learned_addr learned my addr 172.21.15.137:0/1737944748 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:29.758 INFO:tasks.ceph.mgr.x.smithi137.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-17T22:59:29.758 INFO:tasks.ceph.mgr.x.smithi137.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-17T22:59:29.758 INFO:tasks.ceph.mgr.x.smithi137.stderr: from numpy import show_config as show_numpy_config 2024-01-17T22:59:29.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 -- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50156ff0 msgr2=0x7fab501584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50156ff0 0x7fab501584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 -- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 msgr2=0x7fab500cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:29.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 0x7fab500cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:29.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 -- 172.21.15.137:0/1737944748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009420 con 0x7fab500c6bd0 2024-01-17T22:59:29.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.756+0000 7fab4e59c640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5014c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab400af000 tx=0x7fab4001b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:29.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.760+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400b19a0 con 0x7fab500c6bd0 2024-01-17T22:59:29.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.760+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab400b1b40 con 0x7fab500c6bd0 2024-01-17T22:59:29.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.760+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab501579f0 con 0x7fab500c6bd0 2024-01-17T22:59:29.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.760+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400b9410 con 0x7fab500c6bd0 2024-01-17T22:59:29.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.760+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c8370 con 0x7fab500c6bd0 2024-01-17T22:59:29.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.764+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50157ea0 con 0x7fab500c6bd0 2024-01-17T22:59:29.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.764+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fab400b7040 con 0x7fab500c6bd0 2024-01-17T22:59:29.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.764+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fab400c5cf0 con 0x7fab500c6bd0 2024-01-17T22:59:29.784 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:29.780+0000 7f563d054180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-17T22:59:29.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.892+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7fab50157ea0 con 0x7fab500c6bd0 2024-01-17T22:59:29.905 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:29.900+0000 7f563d054180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:59:29.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:29.968+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b135c646-e754-4bfd-b04d-28624a242fe0", "id": 3} v 0) v1 -- 0x7fab501581f0 con 0x7fab500c6bd0 2024-01-17T22:59:30.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.048+0000 7fab477fe640 1 -- 172.21.15.137:0/1737944748 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b135c646-e754-4bfd-b04d-28624a242fe0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab501581f0 con 0x7fab500c6bd0 2024-01-17T22:59:30.054 INFO:teuthology.orchestra.run.smithi137.stdout:3 2024-01-17T22:59:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 msgr2=0x7fab5014c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5014c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab400af000 tx=0x7fab4001b9b0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 shutdown_connections 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fab50156ff0 0x7fab501584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab500c6bd0 0x7fab5014c310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 --2- 172.21.15.137:0/1737944748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab5006a6e0 0x7fab500cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 >> 172.21.15.137:0/1737944748 conn(0x7fab50061820 msgr2=0x7fab501545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 shutdown_connections 2024-01-17T22:59:30.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.052+0000 7fab5514e640 1 -- 172.21.15.137:0/1737944748 wait complete. 2024-01-17T22:59:30.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new fc221eb3-1e0a-4ab9-8c88-7484b90f63e2 4 2024-01-17T22:59:30.088 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:30.084+0000 7f563d054180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-17T22:59:30.154 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:30.148+0000 7f563d054180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-17T22:59:30.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.180+0000 7f0651d8a640 1 Processor -- start 2024-01-17T22:59:30.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.180+0000 7f0651d8a640 1 -- start start 2024-01-17T22:59:30.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0651d8a640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c156ff0 0x7f064c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0651d8a640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f064c15a400 0x7f064c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0651d8a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c1573d0 con 0x7f064c0c6bd0 2024-01-17T22:59:30.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0651d8a640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c06b190 con 0x7f064c15a400 2024-01-17T22:59:30.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0651d8a640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c06b470 con 0x7f064c156ff0 2024-01-17T22:59:30.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0643fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f064c0c6bd0 0x7f064c159cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58912/0 (socket says 172.21.15.137:58912) 2024-01-17T22:59:30.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f0643fff640 1 -- 172.21.15.137:0/131256474 learned_addr learned my addr 172.21.15.137:0/131256474 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-01-17T22:59:30.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064b7fe640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c156ff0 0x7f064c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064bfff640 1 --2- 172.21.15.137:0/131256474 >> v2:172.21.15.67:3300/0 conn(0x7f064c15a400 0x7f064c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064bfff640 1 -- 172.21.15.137:0/131256474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c156ff0 msgr2=0x7f064c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:30.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064bfff640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c156ff0 0x7f064c06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064bfff640 1 -- 172.21.15.137:0/131256474 >> v1:172.21.15.137:6789/0 conn(0x7f064c0c6bd0 legacy=0x7f064c159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.184+0000 7f064bfff640 1 -- 172.21.15.137:0/131256474 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c06b750 con 0x7f064c15a400 2024-01-17T22:59:30.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.188+0000 7f064bfff640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c15a400 0x7f064c06e730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0644009d90 tx=0x7f064401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f408d61b10218142 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.192+0000 7f064affd640 1 -- 172.21.15.137:0/131256474 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440af600 con 0x7f064c15a400 2024-01-17T22:59:30.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.192+0000 7f064affd640 1 -- 172.21.15.137:0/131256474 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440ab050 con 0x7f064c15a400 2024-01-17T22:59:30.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.192+0000 7f064affd640 1 -- 172.21.15.137:0/131256474 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440af980 con 0x7f064c15a400 2024-01-17T22:59:30.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- 172.21.15.137:0/131256474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c15a400 msgr2=0x7f064c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c15a400 0x7f064c06e730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0644009d90 tx=0x7f064401f130 comp rx=0 tx=0).stop 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- 172.21.15.137:0/131256474 shutdown_connections 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c15a400 0x7f064c06e730 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- 172.21.15.137:0/131256474 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c156ff0 0x7f064c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- 172.21.15.137:0/131256474 >> 172.21.15.137:0/131256474 conn(0x7f064c061820 msgr2=0x7f064c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- 172.21.15.137:0/131256474 shutdown_connections 2024-01-17T22:59:30.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- 172.21.15.137:0/131256474 wait complete. 2024-01-17T22:59:30.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 Processor -- start 2024-01-17T22:59:30.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- start start 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 0x7f064c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c15a400 0x7f064c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1efb70 con 0x7f064c156ff0 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1f0060 con 0x7f064c0c6bd0 2024-01-17T22:59:30.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0651d8a640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c151870 con 0x7f064c15a400 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f064b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 0x7f064c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f064bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c15a400 0x7f064c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f064b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 0x7f064c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43298/0 (socket says 172.21.15.137:43298) 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f064b7fe640 1 -- 172.21.15.137:0/3229997546 learned_addr learned my addr 172.21.15.137:0/3229997546 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:30.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.196+0000 7f0643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.137:42382/0 (socket says 172.21.15.137:42382) 2024-01-17T22:59:30.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f0643fff640 1 -- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c15a400 msgr2=0x7f064c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f0643fff640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c15a400 0x7f064c152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f0643fff640 1 -- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 msgr2=0x7f064c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f0643fff640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 0x7f064c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.200+0000 7f0643fff640 1 -- 172.21.15.137:0/3229997546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644009a70 con 0x7f064c156ff0 2024-01-17T22:59:30.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.204+0000 7f0643fff640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f063400c390 tx=0x7f063400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634005cf0 con 0x7f064c156ff0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634005e50 con 0x7f064c156ff0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340072f0 con 0x7f064c156ff0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c152d80 con 0x7f064c156ff0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c151b10 con 0x7f064c156ff0 2024-01-17T22:59:30.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.208+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c151d50 con 0x7f064c156ff0 2024-01-17T22:59:30.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.212+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f063401c440 con 0x7f064c156ff0 2024-01-17T22:59:30.241 INFO:tasks.ceph.mgr.y.smithi067.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-17T22:59:30.241 INFO:tasks.ceph.mgr.y.smithi067.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-17T22:59:30.241 INFO:tasks.ceph.mgr.y.smithi067.stderr: from numpy import show_config as show_numpy_config 2024-01-17T22:59:30.283 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:30.280+0000 7f563d054180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:59:30.308 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:30.305+0000 7ff8b6a4c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-17T22:59:30.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.340+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f063401b8c0 con 0x7f064c156ff0 2024-01-17T22:59:30.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.340+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f064c151d50 con 0x7f064c156ff0 2024-01-17T22:59:30.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.412+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc221eb3-1e0a-4ab9-8c88-7484b90f63e2", "id": 4} v 0) v1 -- 0x7f064c0c7010 con 0x7f064c156ff0 2024-01-17T22:59:30.472 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:30.469+0000 7ff8b6a4c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:59:30.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.480+0000 7f0648ff9640 1 -- 172.21.15.137:0/3229997546 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc221eb3-1e0a-4ab9-8c88-7484b90f63e2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0634017070 con 0x7f064c156ff0 2024-01-17T22:59:30.485 INFO:teuthology.orchestra.run.smithi137.stdout:4 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.480+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 msgr2=0x7f064c152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.480+0000 7f0651d8a640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f063400c390 tx=0x7f063400c850 comp rx=0 tx=0).stop 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 shutdown_connections 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f064c15a400 0x7f064c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f064c156ff0 0x7f064c152030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 --2- 172.21.15.137:0/3229997546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f064c0c6bd0 0x7f064c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 >> 172.21.15.137:0/3229997546 conn(0x7f064c061820 msgr2=0x7f064c06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 shutdown_connections 2024-01-17T22:59:30.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.484+0000 7f0651d8a640 1 -- 172.21.15.137:0/3229997546 wait complete. 2024-01-17T22:59:30.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new b09b00bb-ac76-4574-80b0-c479538f84e9 5 2024-01-17T22:59:30.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 Processor -- start 2024-01-17T22:59:30.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 -- start start 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f44151810 0x7f3f4406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f440c7f50 0x7f3f44157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440c3ae0 con 0x7f3f440c7f50 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f44157770 con 0x7f3f44151810 2024-01-17T22:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.660+0000 7f3f4ae72640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c89b0 con 0x7f3f440c84c0 2024-01-17T22:59:30.667 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:30.661+0000 7ff8b6a4c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-17T22:59:30.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f48c0e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f44151810 0x7f3f4406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f4940f640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3f440c7f50 0x7f3f44157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:35968/0 (socket says 172.21.15.137:35968) 2024-01-17T22:59:30.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 -- 172.21.15.137:0/729843357 learned_addr learned my addr 172.21.15.137:0/729843357 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:30.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 -- 172.21.15.137:0/729843357 >> v2:172.21.15.137:3300/0 conn(0x7f3f44151810 msgr2=0x7f3f4406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:30.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 --2- 172.21.15.137:0/729843357 >> v2:172.21.15.137:3300/0 conn(0x7f3f44151810 0x7f3f4406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 -- 172.21.15.137:0/729843357 >> v2:172.21.15.67:3300/0 conn(0x7f3f440c7f50 msgr2=0x7f3f44157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:30.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 --2- 172.21.15.137:0/729843357 >> v2:172.21.15.67:3300/0 conn(0x7f3f440c7f50 0x7f3f44157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.664+0000 7f3f3bfff640 1 -- 172.21.15.137:0/729843357 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4406b200 con 0x7f3f440c84c0 2024-01-17T22:59:30.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.668+0000 7f3f3bfff640 1 --2- 172.21.15.137:0/729843357 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f440cd180 tx=0x7f3f3401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781d61b4c17fa0c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f3b7fe640 1 -- 172.21.15.137:0/729843357 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340a89b0 con 0x7f3f440c84c0 2024-01-17T22:59:30.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f3b7fe640 1 -- 172.21.15.137:0/729843357 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f340a8b10 con 0x7f3f440c84c0 2024-01-17T22:59:30.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f3b7fe640 1 -- 172.21.15.137:0/729843357 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340a8ea0 con 0x7f3f440c84c0 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 -- 172.21.15.137:0/729843357 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 msgr2=0x7f3f440c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/729843357 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3f440cd180 tx=0x7f3f3401ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 -- 172.21.15.137:0/729843357 shutdown_connections 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/729843357 >> v2:172.21.15.67:3300/0 conn(0x7f3f440c7f50 0x7f3f44157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/729843357 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f440c84c0 0x7f3f440c7a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/729843357 >> v2:172.21.15.137:3300/0 conn(0x7f3f44151810 0x7f3f4406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 -- 172.21.15.137:0/729843357 >> 172.21.15.137:0/729843357 conn(0x7f3f440617e0 msgr2=0x7f3f44072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:30.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 -- 172.21.15.137:0/729843357 shutdown_connections 2024-01-17T22:59:30.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.672+0000 7f3f4ae72640 1 -- 172.21.15.137:0/729843357 wait complete. 2024-01-17T22:59:30.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 Processor -- start 2024-01-17T22:59:30.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 -- start start 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f440c7f50 0x7f3f440c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f440c84c0 0x7f3f441564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c3ec0 con 0x7f3f440c7f50 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44155010 con 0x7f3f440c84c0 2024-01-17T22:59:30.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4ae72640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c4150 con 0x7f3f44151810 2024-01-17T22:59:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4940f640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f3bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f440c84c0 0x7f3f441564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f48c0e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f440c7f50 0x7f3f440c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4940f640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:35970/0 (socket says 172.21.15.137:35970) 2024-01-17T22:59:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.676+0000 7f3f4940f640 1 -- 172.21.15.137:0/825187194 learned_addr learned my addr 172.21.15.137:0/825187194 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:30.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.680+0000 7f3f4940f640 1 -- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f440c84c0 msgr2=0x7f3f441564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.680+0000 7f3f4940f640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f440c84c0 0x7f3f441564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.680+0000 7f3f4940f640 1 -- 172.21.15.137:0/825187194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f440c7f50 msgr2=0x7f3f440c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:30.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.680+0000 7f3f4940f640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f440c7f50 0x7f3f440c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:30.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.680+0000 7f3f4940f640 1 -- 172.21.15.137:0/825187194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340094d0 con 0x7f3f44151810 2024-01-17T22:59:30.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.684+0000 7f3f4940f640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00eed0 tx=0x7f3f3c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:30.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c010040 con 0x7f3f44151810 2024-01-17T22:59:30.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00bd20 con 0x7f3f44151810 2024-01-17T22:59:30.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440c4430 con 0x7f3f44151810 2024-01-17T22:59:30.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c014640 con 0x7f3f44151810 2024-01-17T22:59:30.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440c4cd0 con 0x7f3f44151810 2024-01-17T22:59:30.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f440c4ec0 con 0x7f3f44151810 2024-01-17T22:59:30.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f3f3c014b20 con 0x7f3f44151810 2024-01-17T22:59:30.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.688+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3f3c025950 con 0x7f3f44151810 2024-01-17T22:59:30.743 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:30.737+0000 7ff8b6a4c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-17T22:59:30.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.796+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f3f3c018020 con 0x7f3f44151810 2024-01-17T22:59:30.889 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:30.885+0000 7ff8b6a4c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-17T22:59:30.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:30.908+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b09b00bb-ac76-4574-80b0-c479538f84e9", "id": 5} v 0) v1 -- 0x7f3f440746a0 con 0x7f3f44151810 2024-01-17T22:59:30.958 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:30.952+0000 7f563d054180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-17T22:59:31.044 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:31.040+0000 7f563d054180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-17T22:59:31.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f397fa640 1 -- 172.21.15.137:0/825187194 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b09b00bb-ac76-4574-80b0-c479538f84e9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3f3c014dd0 con 0x7f3f44151810 2024-01-17T22:59:31.048 INFO:teuthology.orchestra.run.smithi137.stdout:5 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 msgr2=0x7f3f441569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00eed0 tx=0x7f3f3c00b480 comp rx=0 tx=0).stop 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 shutdown_connections 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3f44151810 0x7f3f441569f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f440c84c0 0x7f3f441564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 --2- 172.21.15.137:0/825187194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f440c7f50 0x7f3f440c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 >> 172.21.15.137:0/825187194 conn(0x7f3f440617e0 msgr2=0x7f3f441509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 shutdown_connections 2024-01-17T22:59:31.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.044+0000 7f3f4ae72640 1 -- 172.21.15.137:0/825187194 wait complete. 2024-01-17T22:59:31.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 45c7a720-d042-4c1f-8c7c-0c670f1a344e 6 2024-01-17T22:59:31.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 Processor -- start 2024-01-17T22:59:31.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 -- start start 2024-01-17T22:59:31.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f542c0c5620 0x7f542c151500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 0x7f542c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c06b2c0 con 0x7f542c0c5240 2024-01-17T22:59:31.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c15ad90 con 0x7f542c0c5620 2024-01-17T22:59:31.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.184+0000 7f5432926640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c06b510 con 0x7f542c06abc0 2024-01-17T22:59:31.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f5430ec3640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 0x7f542c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f542b7fe640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f542c0c5620 0x7f542c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f5430ec3640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 0x7f542c151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43320/0 (socket says 172.21.15.137:43320) 2024-01-17T22:59:31.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f5430ec3640 1 -- 172.21.15.137:0/333270517 learned_addr learned my addr 172.21.15.137:0/333270517 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:31.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f542b7fe640 1 -- 172.21.15.137:0/333270517 >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 msgr2=0x7f542c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:31.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f542b7fe640 1 --2- 172.21.15.137:0/333270517 >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 0x7f542c151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f542b7fe640 1 -- 172.21.15.137:0/333270517 >> v1:172.21.15.137:6789/0 conn(0x7f542c0c5240 legacy=0x7f542c0611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.188+0000 7f542b7fe640 1 -- 172.21.15.137:0/333270517 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c06b7f0 con 0x7f542c0c5620 2024-01-17T22:59:31.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.192+0000 7f542b7fe640 1 --2- 172.21.15.137:0/333270517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c151500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f542c0c8380 tx=0x7f542001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89de055476ea20e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f542affd640 1 -- 172.21.15.137:0/333270517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200a8950 con 0x7f542c0c5620 2024-01-17T22:59:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f542affd640 1 -- 172.21.15.137:0/333270517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200a8ab0 con 0x7f542c0c5620 2024-01-17T22:59:31.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f542affd640 1 -- 172.21.15.137:0/333270517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200a8e40 con 0x7f542c0c5620 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 -- 172.21.15.137:0/333270517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 msgr2=0x7f542c151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 --2- 172.21.15.137:0/333270517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c151500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f542c0c8380 tx=0x7f542001ec50 comp rx=0 tx=0).stop 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 -- 172.21.15.137:0/333270517 shutdown_connections 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 --2- 172.21.15.137:0/333270517 >> v2:172.21.15.137:3300/0 conn(0x7f542c06abc0 0x7f542c151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 --2- 172.21.15.137:0/333270517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c151500 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 -- 172.21.15.137:0/333270517 >> 172.21.15.137:0/333270517 conn(0x7f542c0c83d0 msgr2=0x7f542c0c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 -- 172.21.15.137:0/333270517 shutdown_connections 2024-01-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.196+0000 7f5432926640 1 -- 172.21.15.137:0/333270517 wait complete. 2024-01-17T22:59:31.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 Processor -- start 2024-01-17T22:59:31.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 -- start start 2024-01-17T22:59:31.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 0x7f542c1f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 0x7f542c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c1ede70 con 0x7f542c0c5620 2024-01-17T22:59:31.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c1f17c0 con 0x7f542c0c5240 2024-01-17T22:59:31.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5432926640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c148a20 con 0x7f542c06abc0 2024-01-17T22:59:31.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 0x7f542c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f542bfff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 0x7f542c1f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f5430ec3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f542b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 0x7f542c0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43332/0 (socket says 172.21.15.137:43332) 2024-01-17T22:59:31.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.200+0000 7f542b7fe640 1 -- 172.21.15.137:0/4271729795 learned_addr learned my addr 172.21.15.137:0/4271729795 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f5430ec3640 1 -- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 msgr2=0x7f542c1f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f5430ec3640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 0x7f542c1f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f5430ec3640 1 -- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 msgr2=0x7f542c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f5430ec3640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 0x7f542c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f5430ec3640 1 -- 172.21.15.137:0/4271729795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009420 con 0x7f542c0c5620 2024-01-17T22:59:31.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.204+0000 7f542bfff640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 0x7f542c1f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:59:31.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.208+0000 7f5430ec3640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c143d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f541c009ce0 tx=0x7f541c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00cd20 con 0x7f542c0c5620 2024-01-17T22:59:31.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00f040 con 0x7f542c0c5620 2024-01-17T22:59:31.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c003bc0 con 0x7f542c0c5620 2024-01-17T22:59:31.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c1ed280 con 0x7f542c0c5620 2024-01-17T22:59:31.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c1ed820 con 0x7f542c0c5620 2024-01-17T22:59:31.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.212+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c1ee020 con 0x7f542c0c5620 2024-01-17T22:59:31.231 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:31.228+0000 7f563d054180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-17T22:59:31.304 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:31.300+0000 7f563d054180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-17T22:59:31.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.380+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f541c0043b0 con 0x7f542c0c5620 2024-01-17T22:59:31.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.384+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f541c01d400 con 0x7f542c0c5620 2024-01-17T22:59:31.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.388+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f542c1ee020 con 0x7f542c0c5620 2024-01-17T22:59:31.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.464+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45c7a720-d042-4c1f-8c7c-0c670f1a344e", "id": 6} v 0) v1 -- 0x7f542c0746a0 con 0x7f542c0c5620 2024-01-17T22:59:31.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5428ff9640 1 -- 172.21.15.137:0/4271729795 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45c7a720-d042-4c1f-8c7c-0c670f1a344e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f541c02c0b0 con 0x7f542c0c5620 2024-01-17T22:59:31.508 INFO:teuthology.orchestra.run.smithi137.stdout:6 2024-01-17T22:59:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 msgr2=0x7f542c143d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c143d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f541c009ce0 tx=0x7f541c00c490 comp rx=0 tx=0).stop 2024-01-17T22:59:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 shutdown_connections 2024-01-17T22:59:31.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f542c0c5620 0x7f542c143d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f542c0c5240 0x7f542c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 --2- 172.21.15.137:0/4271729795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f542c06abc0 0x7f542c1f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 >> 172.21.15.137:0/4271729795 conn(0x7f542c0c83d0 msgr2=0x7f542c0611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.504+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 shutdown_connections 2024-01-17T22:59:31.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.508+0000 7f5432926640 1 -- 172.21.15.137:0/4271729795 wait complete. 2024-01-17T22:59:31.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 828a6f76-53ec-4ac6-aa74-43b884808b4e 7 2024-01-17T22:59:31.607 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:31.604+0000 7f563d054180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-17T22:59:31.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.640+0000 7ff2c5fe1640 1 Processor -- start 2024-01-17T22:59:31.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.640+0000 7ff2c5fe1640 1 -- start start 2024-01-17T22:59:31.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.640+0000 7ff2c5fe1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2c00c84c0 0x7ff2c006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2c5fe1640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2c5fe1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c0157770 con 0x7ff2c0151810 2024-01-17T22:59:31.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2c5fe1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c00c3ae0 con 0x7ff2c00c84c0 2024-01-17T22:59:31.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2c5fe1640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00c89b0 con 0x7ff2c0157c20 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2beffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2c00c84c0 0x7ff2c006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.137:35996/0 (socket says 172.21.15.137:35996) 2024-01-17T22:59:31.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 -- 172.21.15.137:0/2309592780 learned_addr learned my addr 172.21.15.137:0/2309592780 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 -- 172.21.15.137:0/2309592780 >> v2:172.21.15.137:3300/0 conn(0x7ff2c00c84c0 msgr2=0x7ff2c006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 --2- 172.21.15.137:0/2309592780 >> v2:172.21.15.137:3300/0 conn(0x7ff2c00c84c0 0x7ff2c006a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 -- 172.21.15.137:0/2309592780 >> v1:172.21.15.137:6789/0 conn(0x7ff2c0151810 legacy=0x7ff2c00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.644+0000 7ff2bffff640 1 -- 172.21.15.137:0/2309592780 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c01585d0 con 0x7ff2c0157c20 2024-01-17T22:59:31.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.648+0000 7ff2bffff640 1 --2- 172.21.15.137:0/2309592780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dfbaafe93405b88 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.652+0000 7ff2be7fc640 1 -- 172.21.15.137:0/2309592780 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80af400 con 0x7ff2c0157c20 2024-01-17T22:59:31.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.652+0000 7ff2be7fc640 1 -- 172.21.15.137:0/2309592780 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b80ab050 con 0x7ff2c0157c20 2024-01-17T22:59:31.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.652+0000 7ff2be7fc640 1 -- 172.21.15.137:0/2309592780 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80af780 con 0x7ff2c0157c20 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2309592780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 msgr2=0x7ff2c0158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2309592780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009e50 tx=0x7ff2b801f1f0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2309592780 shutdown_connections 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2309592780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c0158090 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2309592780 >> v2:172.21.15.137:3300/0 conn(0x7ff2c00c84c0 0x7ff2c006a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2309592780 >> 172.21.15.137:0/2309592780 conn(0x7ff2c00617e0 msgr2=0x7ff2c0072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2309592780 shutdown_connections 2024-01-17T22:59:31.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2309592780 wait complete. 2024-01-17T22:59:31.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 Processor -- start 2024-01-17T22:59:31.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- start start 2024-01-17T22:59:31.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 0x7ff2c00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c0151810 0x7ff2c00c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c01ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:31.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c01478f0 con 0x7ff2c0151810 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0147bd0 con 0x7ff2c00c84c0 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.656+0000 7ff2c5fe1640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00c24f0 con 0x7ff2c0157c20 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.660+0000 7ff2bffff640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c01ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.660+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 0x7ff2c00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.660+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c0151810 0x7ff2c00c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:31.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.660+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 0x7ff2c00c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43342/0 (socket says 172.21.15.137:43342) 2024-01-17T22:59:31.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.660+0000 7ff2bf7fe640 1 -- 172.21.15.137:0/2967790701 learned_addr learned my addr 172.21.15.137:0/2967790701 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-01-17T22:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 -- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 msgr2=0x7ff2c00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 0x7ff2c00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 -- 172.21.15.137:0/2967790701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c0151810 msgr2=0x7ff2c00c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c0151810 0x7ff2c00c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 -- 172.21.15.137:0/2967790701 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009b30 con 0x7ff2c0157c20 2024-01-17T22:59:31.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.664+0000 7ff2bffff640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c01ef400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80ae000 tx=0x7ff2b801bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:31.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.668+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80c0070 con 0x7ff2c0157c20 2024-01-17T22:59:31.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.668+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8009510 con 0x7ff2c0157c20 2024-01-17T22:59:31.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.668+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80afdd0 con 0x7ff2c0157c20 2024-01-17T22:59:31.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.668+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c00c27d0 con 0x7ff2c0157c20 2024-01-17T22:59:31.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.668+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c006e710 con 0x7ff2c0157c20 2024-01-17T22:59:31.674 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:31.668+0000 7f563d054180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-17T22:59:31.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.672+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c01476c0 con 0x7ff2c0157c20 2024-01-17T22:59:31.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.672+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ff2b80b6040 con 0x7ff2c0157c20 2024-01-17T22:59:31.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.672+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff2b80b8c40 con 0x7ff2c0157c20 2024-01-17T22:59:31.688 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:31.685+0000 7ff8b6a4c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-17T22:59:31.780 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:31.777+0000 7ff8b6a4c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-17T22:59:31.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.784+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7ff2b80b4070 con 0x7ff2c0157c20 2024-01-17T22:59:31.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:31.860+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd new", "uuid": "828a6f76-53ec-4ac6-aa74-43b884808b4e", "id": 7} v 0) v1 -- 0x7ff2c00c2630 con 0x7ff2c0157c20 2024-01-17T22:59:31.981 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:31.977+0000 7ff8b6a4c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-17T22:59:32.071 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:32.065+0000 7ff8b6a4c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-17T22:59:32.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.068+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mgrmap(e 2) v1 ==== 43034+0+0 (secure 0 0 0) 0x7ff2b80b85e0 con 0x7ff2c0157c20 2024-01-17T22:59:32.419 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:32.417+0000 7ff8b6a4c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-17T22:59:32.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2a7fff640 1 -- 172.21.15.137:0/2967790701 <== mon.2 v2:172.21.15.137:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "828a6f76-53ec-4ac6-aa74-43b884808b4e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2b80ce480 con 0x7ff2c0157c20 2024-01-17T22:59:32.448 INFO:teuthology.orchestra.run.smithi137.stdout:7 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 msgr2=0x7ff2c01ef400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c01ef400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80ae000 tx=0x7ff2b801bf90 comp rx=0 tx=0).stop 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 shutdown_connections 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff2c0157c20 0x7ff2c01ef400 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c0151810 0x7ff2c00c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 --2- 172.21.15.137:0/2967790701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c00c84c0 0x7ff2c00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 >> 172.21.15.137:0/2967790701 conn(0x7ff2c00617e0 msgr2=0x7ff2c00c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 shutdown_connections 2024-01-17T22:59:32.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-01-17T22:59:32.444+0000 7ff2c5fe1640 1 -- 172.21.15.137:0/2967790701 wait complete. 2024-01-17T22:59:32.471 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-17T22:59:32.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-17T22:59:32.475 INFO:tasks.ceph.osd.0:Started 2024-01-17T22:59:32.475 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-17T22:59:32.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-17T22:59:32.482 INFO:tasks.ceph.osd.1:Started 2024-01-17T22:59:32.482 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-17T22:59:32.482 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-17T22:59:32.486 INFO:tasks.ceph.osd.2:Started 2024-01-17T22:59:32.487 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-17T22:59:32.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-17T22:59:32.491 INFO:tasks.ceph.osd.3:Started 2024-01-17T22:59:32.491 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-17T22:59:32.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-17T22:59:32.493 INFO:tasks.ceph.osd.4:Started 2024-01-17T22:59:32.494 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-17T22:59:32.494 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-17T22:59:32.496 INFO:tasks.ceph.osd.5:Started 2024-01-17T22:59:32.496 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-17T22:59:32.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-17T22:59:32.498 INFO:tasks.ceph.osd.6:Started 2024-01-17T22:59:32.498 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-17T22:59:32.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-17T22:59:32.500 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-17T22:59:32.497+0000 7ff8b6a4c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-17T22:59:32.501 INFO:tasks.ceph.osd.7:Started 2024-01-17T22:59:32.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:32.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 Processor -- start 2024-01-17T22:59:32.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 -- start start 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 0x7f39e0061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e00c7d10 con 0x7f39e0061640 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e01576d0 con 0x7f39e01517f0 2024-01-17T22:59:32.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.673+0000 7f39e4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e0157970 con 0x7f39e015b620 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.677+0000 7f39dde00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f39e01517f0 0x7f39e00ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:45252/0 (socket says 172.21.15.67:45252) 2024-01-17T22:59:32.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.677+0000 7f39dde00640 1 -- 172.21.15.67:0/878348459 learned_addr learned my addr 172.21.15.67:0/878348459 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:32.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.677+0000 7f39dd400640 1 --2- 172.21.15.67:0/878348459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 0x7f39e0061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.681+0000 7f39dd400640 1 -- 172.21.15.67:0/878348459 >> v1:172.21.15.137:6789/0 conn(0x7f39e01517f0 legacy=0x7f39e00ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.681+0000 7f39dd400640 1 -- 172.21.15.67:0/878348459 >> v1:172.21.15.67:6789/0 conn(0x7f39e0061640 legacy=0x7f39e00c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:32.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.681+0000 7f39dd400640 1 -- 172.21.15.67:0/878348459 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0157c50 con 0x7f39e015b620 2024-01-17T22:59:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.685+0000 7f39dd400640 1 --2- 172.21.15.67:0/878348459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 0x7f39e0061100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097f0 tx=0x7f39c801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b409aaaeffc60c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39dca00640 1 -- 172.21.15.67:0/878348459 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ab680 con 0x7f39e015b620 2024-01-17T22:59:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39dca00640 1 -- 172.21.15.67:0/878348459 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80ab7e0 con 0x7f39e015b620 2024-01-17T22:59:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39dca00640 1 -- 172.21.15.67:0/878348459 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80abb70 con 0x7f39e015b620 2024-01-17T22:59:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- 172.21.15.67:0/878348459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 msgr2=0x7f39e0061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 --2- 172.21.15.67:0/878348459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 0x7f39e0061100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097f0 tx=0x7f39c801c480 comp rx=0 tx=0).stop 2024-01-17T22:59:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- 172.21.15.67:0/878348459 shutdown_connections 2024-01-17T22:59:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 --2- 172.21.15.67:0/878348459 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e015b620 0x7f39e0061100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- 172.21.15.67:0/878348459 >> 172.21.15.67:0/878348459 conn(0x7f39e006ad40 msgr2=0x7f39e006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- 172.21.15.67:0/878348459 shutdown_connections 2024-01-17T22:59:32.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- 172.21.15.67:0/878348459 wait complete. 2024-01-17T22:59:32.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 Processor -- start 2024-01-17T22:59:32.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- start start 2024-01-17T22:59:32.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 0x7f39e00b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39e01517f0 0x7f39e013e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00b1000 con 0x7f39e01517f0 2024-01-17T22:59:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00b02a0 con 0x7f39e015b620 2024-01-17T22:59:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.689+0000 7f39e4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e006b890 con 0x7f39e0061640 2024-01-17T22:59:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.693+0000 7f39de800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.693+0000 7f39dde00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 0x7f39e00b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:32.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.693+0000 7f39de800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:39680/0 (socket says 172.21.15.67:39680) 2024-01-17T22:59:32.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.693+0000 7f39de800640 1 -- 172.21.15.67:0/156699043 learned_addr learned my addr 172.21.15.67:0/156699043 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 -- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 msgr2=0x7f39e00b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 0x7f39e00b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 -- 172.21.15.67:0/156699043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39e01517f0 msgr2=0x7f39e013e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39e01517f0 0x7f39e013e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 -- 172.21.15.67:0/156699043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009420 con 0x7f39e015b620 2024-01-17T22:59:32.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39dde00640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 0x7f39e00b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T22:59:32.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.697+0000 7f39de800640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c7b0 tx=0x7f39d800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:32.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.701+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003d90 con 0x7f39e015b620 2024-01-17T22:59:32.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.701+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8005070 con 0x7f39e015b620 2024-01-17T22:59:32.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.701+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8005420 con 0x7f39e015b620 2024-01-17T22:59:32.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.701+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e01587b0 con 0x7f39e015b620 2024-01-17T22:59:32.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.701+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e006bb00 con 0x7f39e015b620 2024-01-17T22:59:32.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.705+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e006b620 con 0x7f39e015b620 2024-01-17T22:59:32.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.721+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 2) v1 ==== 43034+0+0 (secure 0 0 0) 0x7f39d8005580 con 0x7f39e015b620 2024-01-17T22:59:32.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.725+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f39d800a5e0 con 0x7f39e015b620 2024-01-17T22:59:32.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:32.961+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f39d801b3b0 con 0x7f39e015b620 2024-01-17T22:59:33.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.021+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39e00746a0 con 0x7f39e015b620 2024-01-17T22:59:33.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.161+0000 7f39d6000640 1 -- 172.21.15.67:0/156699043 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f39d8017090 con 0x7f39e015b620 2024-01-17T22:59:33.167 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:59:33.167 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T22:59:32.091866+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 msgr2=0x7f39e013ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c7b0 tx=0x7f39d800cc70 comp rx=0 tx=0).stop 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 shutdown_connections 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39e015b620 0x7f39e013ee90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f39e01517f0 0x7f39e013e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 --2- 172.21.15.67:0/156699043 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f39e0061640 0x7f39e00b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:33.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 >> 172.21.15.67:0/156699043 conn(0x7f39e006ad40 msgr2=0x7f39e01553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:33.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 shutdown_connections 2024-01-17T22:59:33.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:33.165+0000 7f39e4c00640 1 -- 172.21.15.67:0/156699043 wait complete. 2024-01-17T22:59:33.172 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-17T22:59:33.168+0000 7f76177c6640 -1 Falling back to public interface 2024-01-17T22:59:33.180 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-17T22:59:33.176+0000 7fed7a177640 -1 Falling back to public interface 2024-01-17T22:59:33.184 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-17T22:59:33.180+0000 7f8a5cfa3640 -1 Falling back to public interface 2024-01-17T22:59:33.184 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-17T22:59:33.180+0000 7fdfc3c4b640 -1 Falling back to public interface 2024-01-17T22:59:33.188 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-17T22:59:33.188 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-17T22:59:33.201 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-17T22:59:33.197+0000 7f8ef4a54640 -1 Falling back to public interface 2024-01-17T22:59:33.224 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-17T22:59:33.221+0000 7f4f30f6e640 -1 Falling back to public interface 2024-01-17T22:59:33.233 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-17T22:59:33.229+0000 7f12a9236640 -1 Falling back to public interface 2024-01-17T22:59:33.240 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-17T22:59:33.237+0000 7f45e2588640 -1 Falling back to public interface 2024-01-17T22:59:33.886 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:33.880+0000 7f55e48a1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-17T22:59:33.938 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-17T22:59:33.932+0000 7f55e48a1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-17T22:59:33.994 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:34.124 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 Processor -- start 2024-01-17T22:59:34.124 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 -- start start 2024-01-17T22:59:34.125 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 0x7fb0c8162e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.125 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80721f0 con 0x7fb0c8151630 2024-01-17T22:59:34.125 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c80c5d80 con 0x7fb0c80c51a0 2024-01-17T22:59:34.125 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0cd200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8072cc0 con 0x7fb0c8157f30 2024-01-17T22:59:34.126 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0c5e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb0c8151630 0x7fb0c80c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:39874/0 (socket says 172.21.15.67:39874) 2024-01-17T22:59:34.126 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0c5e00640 1 -- 172.21.15.67:0/3858483239 learned_addr learned my addr 172.21.15.67:0/3858483239 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:34.126 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.121+0000 7fb0c6800640 1 --2- 172.21.15.67:0/3858483239 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 0x7fb0c8162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.128 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.125+0000 7fb0c4a00640 1 -- 172.21.15.67:0/3858483239 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301341035 0 0) 0x7fb0c80721f0 con 0x7fb0c8151630 2024-01-17T22:59:34.129 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.125+0000 7fb0c4a00640 1 -- 172.21.15.67:0/3858483239 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a8003530 con 0x7fb0c8151630 2024-01-17T22:59:34.130 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.125+0000 7fb0c6800640 1 -- 172.21.15.67:0/3858483239 >> v1:172.21.15.137:6789/0 conn(0x7fb0c80c51a0 legacy=0x7fb0c8066540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.131 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.125+0000 7fb0c6800640 1 -- 172.21.15.67:0/3858483239 >> v1:172.21.15.67:6789/0 conn(0x7fb0c8151630 legacy=0x7fb0c80c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.131 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.125+0000 7fb0c6800640 1 -- 172.21.15.67:0/3858483239 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c806a6b0 con 0x7fb0c8157f30 2024-01-17T22:59:34.135 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.129+0000 7fb0c6800640 1 --2- 172.21.15.67:0/3858483239 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 0x7fb0c8162e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009dc0 tx=0x7fb0c001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04d217bee70e3e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.140 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0c4a00640 1 -- 172.21.15.67:0/3858483239 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00af600 con 0x7fb0c8157f30 2024-01-17T22:59:34.140 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0c4a00640 1 -- 172.21.15.67:0/3858483239 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c00ab050 con 0x7fb0c8157f30 2024-01-17T22:59:34.140 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0c4a00640 1 -- 172.21.15.67:0/3858483239 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00af980 con 0x7fb0c8157f30 2024-01-17T22:59:34.141 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- 172.21.15.67:0/3858483239 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 msgr2=0x7fb0c8162e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.141 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3858483239 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 0x7fb0c8162e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009dc0 tx=0x7fb0c001f150 comp rx=0 tx=0).stop 2024-01-17T22:59:34.141 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- 172.21.15.67:0/3858483239 shutdown_connections 2024-01-17T22:59:34.142 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3858483239 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c8157f30 0x7fb0c8162e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.142 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- 172.21.15.67:0/3858483239 >> 172.21.15.67:0/3858483239 conn(0x7fb0c80716d0 msgr2=0x7fb0c8071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.142 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- 172.21.15.67:0/3858483239 shutdown_connections 2024-01-17T22:59:34.142 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- 172.21.15.67:0/3858483239 wait complete. 2024-01-17T22:59:34.143 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 Processor -- start 2024-01-17T22:59:34.143 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.137+0000 7fb0cd200640 1 -- start start 2024-01-17T22:59:34.144 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c80c51a0 0x7fb0c80c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.144 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.144 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0c8157f30 0x7fb0c80bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.144 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80c3040 con 0x7fb0c8151630 2024-01-17T22:59:34.145 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80c32e0 con 0x7fb0c8157f30 2024-01-17T22:59:34.145 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0cd200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80c1370 con 0x7fb0c80c51a0 2024-01-17T22:59:34.145 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0c5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.145 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0c5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60190/0 (socket says 172.21.15.67:60190) 2024-01-17T22:59:34.145 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0c5400640 1 -- 172.21.15.67:0/3395280687 learned_addr learned my addr 172.21.15.67:0/3395280687 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:34.146 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0c5e00640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c80c51a0 0x7fb0c80c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.146 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.141+0000 7fb0c6800640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0c8157f30 0x7fb0c80bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 -- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c80c51a0 msgr2=0x7fb0c80c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c80c51a0 0x7fb0c80c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 -- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0c8157f30 msgr2=0x7fb0c80bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0c8157f30 0x7fb0c80bd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 -- 172.21.15.67:0/3395280687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c0009a70 con 0x7fb0c8151630 2024-01-17T22:59:34.151 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.145+0000 7fb0c5400640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c340 tx=0x7fb0b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.155 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.149+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00052d0 con 0x7fb0c8151630 2024-01-17T22:59:34.155 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.149+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0005430 con 0x7fb0c8151630 2024-01-17T22:59:34.155 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.149+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0007260 con 0x7fb0c8151630 2024-01-17T22:59:34.155 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.149+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c80c1650 con 0x7fb0c8151630 2024-01-17T22:59:34.156 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.149+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c80bb9e0 con 0x7fb0c8151630 2024-01-17T22:59:34.157 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.153+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c80c1890 con 0x7fb0c8151630 2024-01-17T22:59:34.176 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.173+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 3) v1 ==== 85831+0+0 (secure 0 0 0) 0x7fb0b00073c0 con 0x7fb0c8151630 2024-01-17T22:59:34.176 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.173+0000 7fb0be000640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 0x7fb0a0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:34.177 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.173+0000 7fb0c5e00640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 0x7fb0a0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:34.178 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.173+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb0b0007670 con 0x7fb0c8151630 2024-01-17T22:59:34.178 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.173+0000 7fb0c5e00640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 0x7fb0a0068ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8007fd0 tx=0x7fb0b8009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:34.421 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.417+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb0b00509b0 con 0x7fb0c8151630 2024-01-17T22:59:34.586 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.581+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0c80c1890 con 0x7fb0c8151630 2024-01-17T22:59:34.763 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.757+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb0c80c1890 con 0x7fb0c8151630 2024-01-17T22:59:34.764 INFO:teuthology.misc.health.smithi067.stdout: 2024-01-17T22:59:34.764 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T22:59:32.091866+0000","last_up_change":"0.000000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:34.764 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0be000640 1 -- 172.21.15.67:0/3395280687 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7fb0b0050d80 con 0x7fb0c8151630 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 msgr2=0x7fb0a0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 0x7fb0a0068ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8007fd0 tx=0x7fb0b8009040 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 msgr2=0x7fb0c80bc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c340 tx=0x7fb0b000c800 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 shutdown_connections 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0a00666e0 0x7fb0a0068ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0c8157f30 0x7fb0c80bd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0c8151630 0x7fb0c80bc490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 --2- 172.21.15.67:0/3395280687 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0c80c51a0 0x7fb0c80c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 >> 172.21.15.67:0/3395280687 conn(0x7fb0c80716d0 msgr2=0x7fb0c814feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 shutdown_connections 2024-01-17T22:59:34.767 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:34.761+0000 7fb0cd200640 1 -- 172.21.15.67:0/3395280687 wait complete. 2024-01-17T22:59:34.786 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-17T22:59:35.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:35.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T22:59:36.975 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-17T22:59:36.968+0000 7f76177c6640 -1 osd.4 0 log_to_monitors true 2024-01-17T22:59:36.975 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-17T22:59:36.969+0000 7f8ef4a54640 -1 osd.2 0 log_to_monitors true 2024-01-17T22:59:37.129 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-17T22:59:37.124+0000 7f8a5cfa3640 -1 osd.6 0 log_to_monitors true 2024-01-17T22:59:37.139 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-17T22:59:37.136+0000 7fdfc3c4b640 -1 osd.5 0 log_to_monitors true 2024-01-17T22:59:37.141 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-17T22:59:37.136+0000 7fed7a177640 -1 osd.7 0 log_to_monitors true 2024-01-17T22:59:37.164 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-17T22:59:37.161+0000 7f12a9236640 -1 osd.1 0 log_to_monitors true 2024-01-17T22:59:37.200 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-17T22:59:37.197+0000 7f45e2588640 -1 osd.3 0 log_to_monitors true 2024-01-17T22:59:37.345 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-17T22:59:37.341+0000 7f4f30f6e640 -1 osd.0 0 log_to_monitors true 2024-01-17T22:59:38.993 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-17T22:59:38.988+0000 7f761376f640 -1 osd.4 0 waiting for initial osdmap 2024-01-17T22:59:39.072 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-17T22:59:39.068+0000 7f760b5aa640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:39.100 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-17T22:59:39.097+0000 7f8eefa00640 -1 osd.2 0 waiting for initial osdmap 2024-01-17T22:59:39.129 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-17T22:59:39.125+0000 7f8ee5a00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:40.765 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-17T22:59:40.760+0000 7fdfbfbf4640 -1 osd.5 0 waiting for initial osdmap 2024-01-17T22:59:40.800 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-17T22:59:40.796+0000 7fdfb7a2f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:40.839 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-17T22:59:40.836+0000 7f8a58f4c640 -1 osd.6 0 waiting for initial osdmap 2024-01-17T22:59:40.856 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-17T22:59:40.852+0000 7fed76932640 -1 osd.7 0 waiting for initial osdmap 2024-01-17T22:59:40.881 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-17T22:59:40.876+0000 7fed6df5b640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:40.891 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-17T22:59:40.888+0000 7f8a50d87640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:41.044 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-17T22:59:41.041+0000 7f12a4000640 -1 osd.1 0 waiting for initial osdmap 2024-01-17T22:59:41.081 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-17T22:59:41.077+0000 7f129a000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:41.087 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-17T22:59:41.081+0000 7f4f2be00640 -1 osd.0 0 waiting for initial osdmap 2024-01-17T22:59:41.091 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-17T22:59:41.085+0000 7f45dd400640 -1 osd.3 0 waiting for initial osdmap 2024-01-17T22:59:41.129 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-17T22:59:41.125+0000 7f45d3400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:41.160 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-17T22:59:41.157+0000 7f4f21e00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-17T22:59:41.594 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:41.727 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.721+0000 7fd898a00640 1 Processor -- start 2024-01-17T22:59:41.727 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.721+0000 7fd898a00640 1 -- start start 2024-01-17T22:59:41.728 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.725+0000 7fd898a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 0x7fd8900cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.728 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.725+0000 7fd898a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8900cc0f0 0x7fd8900c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.728 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.725+0000 7fd898a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89015a770 con 0x7fd8901539d0 2024-01-17T22:59:41.728 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.725+0000 7fd898a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89006c660 con 0x7fd8900cc0f0 2024-01-17T22:59:41.728 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.725+0000 7fd898a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890159c90 con 0x7fd890159750 2024-01-17T22:59:41.753 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.749+0000 7fd895600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 0x7fd8900cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.760 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.757+0000 7fd896a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8900cc0f0 0x7fd8900c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.761 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.757+0000 7fd896a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8900cc0f0 0x7fd8900c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:52216/0 (socket says 172.21.15.67:52216) 2024-01-17T22:59:41.761 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.757+0000 7fd896a00640 1 -- 172.21.15.67:0/1226640044 learned_addr learned my addr 172.21.15.67:0/1226640044 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:41.766 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.761+0000 7fd896a00640 1 -- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 msgr2=0x7fd8900cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:41.766 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.761+0000 7fd896a00640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 0x7fd8900cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.766 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.761+0000 7fd896a00640 1 -- 172.21.15.67:0/1226640044 >> v1:172.21.15.137:6789/0 conn(0x7fd8901539d0 legacy=0x7fd8900c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.766 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.761+0000 7fd896a00640 1 -- 172.21.15.67:0/1226640044 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890159f30 con 0x7fd8900cc0f0 2024-01-17T22:59:41.766 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.761+0000 7fd895600640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 0x7fd8900cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-17T22:59:41.772 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.769+0000 7fd896a00640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8900cc0f0 0x7fd8900c8aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e50 tx=0x7fd88801f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639791f4d981fc93 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:41.777 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd894c00640 1 -- 172.21.15.67:0/1226640044 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880af400 con 0x7fd8900cc0f0 2024-01-17T22:59:41.777 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd894c00640 1 -- 172.21.15.67:0/1226640044 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8880ab050 con 0x7fd8900cc0f0 2024-01-17T22:59:41.777 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd894c00640 1 -- 172.21.15.67:0/1226640044 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880af780 con 0x7fd8900cc0f0 2024-01-17T22:59:41.778 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 -- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8900cc0f0 msgr2=0x7fd8900c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.778 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8900cc0f0 0x7fd8900c8aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd888009e50 tx=0x7fd88801f1f0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.778 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 -- 172.21.15.67:0/1226640044 shutdown_connections 2024-01-17T22:59:41.779 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8900cc0f0 0x7fd8900c8aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.779 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 --2- 172.21.15.67:0/1226640044 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd890159750 0x7fd8900cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.779 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 -- 172.21.15.67:0/1226640044 >> 172.21.15.67:0/1226640044 conn(0x7fd890066b40 msgr2=0x7fd890071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:41.779 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 -- 172.21.15.67:0/1226640044 shutdown_connections 2024-01-17T22:59:41.779 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.773+0000 7fd898a00640 1 -- 172.21.15.67:0/1226640044 wait complete. 2024-01-17T22:59:41.780 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 Processor -- start 2024-01-17T22:59:41.780 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 -- start start 2024-01-17T22:59:41.781 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8900cc0f0 0x7fd89015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.781 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.781 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd890159750 0x7fd8901ef860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89015d900 con 0x7fd8900cc0f0 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890156af0 con 0x7fd890159750 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd898a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890157070 con 0x7fd8901539d0 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd895600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd896a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd890159750 0x7fd8901ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.782 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd895600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:39250/0 (socket says 172.21.15.67:39250) 2024-01-17T22:59:41.783 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.777+0000 7fd895600640 1 -- 172.21.15.67:0/2331040303 learned_addr learned my addr 172.21.15.67:0/2331040303 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:41.787 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.781+0000 7fd895600640 1 -- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd890159750 msgr2=0x7fd8901ef860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.787 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.781+0000 7fd895600640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd890159750 0x7fd8901ef860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.787 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.781+0000 7fd895600640 1 -- 172.21.15.67:0/2331040303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8900cc0f0 msgr2=0x7fd89015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:41.787 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.781+0000 7fd895600640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8900cc0f0 0x7fd89015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:41.787 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.781+0000 7fd895600640 1 -- 172.21.15.67:0/2331040303 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009b30 con 0x7fd8901539d0 2024-01-17T22:59:41.791 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.785+0000 7fd895600640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7f0 tx=0x7fd87800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:41.797 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007820 con 0x7fd8901539d0 2024-01-17T22:59:41.797 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878007980 con 0x7fd8901539d0 2024-01-17T22:59:41.797 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007d30 con 0x7fd8901539d0 2024-01-17T22:59:41.797 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89015b000 con 0x7fd8901539d0 2024-01-17T22:59:41.797 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8901eee00 con 0x7fd8901539d0 2024-01-17T22:59:41.798 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.793+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8900673f0 con 0x7fd8901539d0 2024-01-17T22:59:41.825 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.821+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7fd878024480 con 0x7fd8901539d0 2024-01-17T22:59:41.825 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.821+0000 7fd88e000640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 0x7fd868068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:41.825 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.821+0000 7fd896000640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 0x7fd868068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:41.826 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:41.821+0000 7fd896000640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 0x7fd868068cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd880000f70 tx=0x7fd8800079e0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.110 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.105+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7fd878055800 con 0x7fd8901539d0 2024-01-17T22:59:42.149 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.145+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd878051b40 con 0x7fd8901539d0 2024-01-17T22:59:42.318 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.313+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8901eec60 con 0x7fd8901539d0 2024-01-17T22:59:42.662 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.657+0000 7fd88e000640 1 -- 172.21.15.67:0/2331040303 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10943 (secure 0 0 0) 0x7fd8901eec60 con 0x7fd8901539d0 2024-01-17T22:59:42.662 INFO:teuthology.misc.health.smithi067.stdout: 2024-01-17T22:59:42.662 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":15,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T22:59:41.625725+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:42.664 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 msgr2=0x7fd868068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.664 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 0x7fd868068cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd880000f70 tx=0x7fd8800079e0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 msgr2=0x7fd8901ef320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c7f0 tx=0x7fd87800ccb0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 shutdown_connections 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd868066800 0x7fd868068cc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd890159750 0x7fd8901ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd8901539d0 0x7fd8901ef320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 --2- 172.21.15.67:0/2331040303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8900cc0f0 0x7fd89015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 >> 172.21.15.67:0/2331040303 conn(0x7fd890066b40 msgr2=0x7fd8900cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 shutdown_connections 2024-01-17T22:59:42.665 INFO:teuthology.misc.health.smithi067.stderr:2024-01-17T22:59:42.661+0000 7fd898a00640 1 -- 172.21.15.67:0/2331040303 wait complete. 2024-01-17T22:59:42.681 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-17T22:59:42.682 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-17T22:59:42.682 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.682 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-17T22:59:42.682 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-17T22:59:42.685 INFO:tasks.ceph.mds.a:Started 2024-01-17T22:59:42.685 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.685 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-17T22:59:42.685 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-17T22:59:42.688 INFO:tasks.ceph.mds.c:Started 2024-01-17T22:59:42.688 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.689 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-17T22:59:42.689 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-17T22:59:42.692 INFO:tasks.ceph.mds.e:Started 2024-01-17T22:59:42.692 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.692 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-17T22:59:42.692 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-17T22:59:42.695 INFO:tasks.ceph.mds.b:Started 2024-01-17T22:59:42.695 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.695 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-17T22:59:42.695 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-17T22:59:42.698 INFO:tasks.ceph.mds.d:Started 2024-01-17T22:59:42.698 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-01-17T22:59:42.698 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-17T22:59:42.698 DEBUG:teuthology.orchestra.run.smithi137:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-17T22:59:42.701 INFO:tasks.ceph.mds.f:Started 2024-01-17T22:59:42.701 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-17T22:59:42.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T22:59:42.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.885+0000 7f9782400640 1 Processor -- start 2024-01-17T22:59:42.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.885+0000 7f9782400640 1 -- start start 2024-01-17T22:59:42.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f9782400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f9782400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c06b5c0 con 0x7f977c0718c0 2024-01-17T22:59:42.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f9782400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c159940 con 0x7f977c06ba50 2024-01-17T22:59:42.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f9782400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c153e60 con 0x7f977c153a80 2024-01-17T22:59:42.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f977aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f977c06ba50 0x7f977c159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:47106/0 (socket says 172.21.15.67:47106) 2024-01-17T22:59:42.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f977aa00640 1 -- 172.21.15.67:0/3062355240 learned_addr learned my addr 172.21.15.67:0/3062355240 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:42.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.889+0000 7f977b400640 1 --2- 172.21.15.67:0/3062355240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.897+0000 7f977b400640 1 -- 172.21.15.67:0/3062355240 >> v1:172.21.15.137:6789/0 conn(0x7f977c06ba50 legacy=0x7f977c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.897+0000 7f977b400640 1 -- 172.21.15.67:0/3062355240 >> v1:172.21.15.67:6789/0 conn(0x7f977c0718c0 legacy=0x7f977c164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:42.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.897+0000 7f977b400640 1 -- 172.21.15.67:0/3062355240 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c06aa40 con 0x7f977c153a80 2024-01-17T22:59:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.901+0000 7f977b400640 1 --2- 172.21.15.67:0/3062355240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c0c66e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f976c0097f0 tx=0x7f976c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce49a9f55347258e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.909+0000 7f977a000640 1 -- 172.21.15.67:0/3062355240 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0a8970 con 0x7f977c153a80 2024-01-17T22:59:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.909+0000 7f977a000640 1 -- 172.21.15.67:0/3062355240 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c0a8ad0 con 0x7f977c153a80 2024-01-17T22:59:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.909+0000 7f977a000640 1 -- 172.21.15.67:0/3062355240 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0a8e60 con 0x7f977c153a80 2024-01-17T22:59:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.909+0000 7f9782400640 1 -- 172.21.15.67:0/3062355240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 msgr2=0x7f977c0c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.909+0000 7f9782400640 1 --2- 172.21.15.67:0/3062355240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c0c66e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f976c0097f0 tx=0x7f976c01ec70 comp rx=0 tx=0).stop 2024-01-17T22:59:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 -- 172.21.15.67:0/3062355240 shutdown_connections 2024-01-17T22:59:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 --2- 172.21.15.67:0/3062355240 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c0c66e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 -- 172.21.15.67:0/3062355240 >> 172.21.15.67:0/3062355240 conn(0x7f977c06fba0 msgr2=0x7f977c0cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 -- 172.21.15.67:0/3062355240 shutdown_connections 2024-01-17T22:59:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 -- 172.21.15.67:0/3062355240 wait complete. 2024-01-17T22:59:42.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 Processor -- start 2024-01-17T22:59:42.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.913+0000 7f9782400640 1 -- start start 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f977c06ba50 0x7f977c147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f977c0718c0 0x7f977c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c4d60 con 0x7f977c0718c0 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c153320 con 0x7f977c06ba50 2024-01-17T22:59:42.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f9782400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1570e0 con 0x7f977c153a80 2024-01-17T22:59:42.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f977b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f977c06ba50 0x7f977c147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f977be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f977be00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:39260/0 (socket says 172.21.15.67:39260) 2024-01-17T22:59:42.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.917+0000 7f977be00640 1 -- 172.21.15.67:0/3283571946 learned_addr learned my addr 172.21.15.67:0/3283571946 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:42.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.921+0000 7f977be00640 1 -- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f977c06ba50 msgr2=0x7f977c147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.921+0000 7f977be00640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f977c06ba50 0x7f977c147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.921+0000 7f977be00640 1 -- 172.21.15.67:0/3283571946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f977c0718c0 msgr2=0x7f977c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:42.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.921+0000 7f977be00640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f977c0718c0 0x7f977c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:42.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.921+0000 7f977be00640 1 -- 172.21.15.67:0/3283571946 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009420 con 0x7f977c153a80 2024-01-17T22:59:42.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.933+0000 7f977be00640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f977400c7b0 tx=0x7f977400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774003d90 con 0x7f977c153a80 2024-01-17T22:59:42.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774005070 con 0x7f977c153a80 2024-01-17T22:59:42.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774005420 con 0x7f977c153a80 2024-01-17T22:59:42.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c1f41c0 con 0x7f977c153a80 2024-01-17T22:59:42.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0caf50 con 0x7f977c153a80 2024-01-17T22:59:42.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.941+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c0746a0 con 0x7f977c153a80 2024-01-17T22:59:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.977+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7f9774005580 con 0x7f977c153a80 2024-01-17T22:59:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.981+0000 7f9773400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 0x7f9754068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.981+0000 7f977b400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 0x7f9754068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:42.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.981+0000 7f977b400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 0x7f9754068c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b2000 tx=0x7f976c0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:42.981+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9774054660 con 0x7f977c153a80 2024-01-17T22:59:43.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.305+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f97740509a0 con 0x7f977c153a80 2024-01-17T22:59:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.501+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f977c068340 con 0x7f977c153a80 2024-01-17T22:59:43.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.809+0000 7f9773400640 1 -- 172.21.15.67:0/3283571946 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f9774017020 con 0x7f977c153a80 2024-01-17T22:59:43.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:59:43.816 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T22:59:42.792711+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 msgr2=0x7f9754068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 0x7f9754068c70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f976c0b2000 tx=0x7f976c0aa070 comp rx=0 tx=0).stop 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 msgr2=0x7f977c158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f977400c7b0 tx=0x7f977400cc70 comp rx=0 tx=0).stop 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 shutdown_connections 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f97540667b0 0x7f9754068c70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f977c153a80 0x7f977c158ea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f977c0718c0 0x7f977c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 --2- 172.21.15.67:0/3283571946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f977c06ba50 0x7f977c147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:43.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 >> 172.21.15.67:0/3283571946 conn(0x7f977c06fba0 msgr2=0x7f977c0c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:43.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 shutdown_connections 2024-01-17T22:59:43.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:43.813+0000 7f9782400640 1 -- 172.21.15.67:0/3283571946 wait complete. 2024-01-17T22:59:43.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-17T22:59:43.848 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T22:59:44.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.009+0000 7f91f8000640 1 Processor -- start 2024-01-17T22:59:44.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.009+0000 7f91f8000640 1 -- start start 2024-01-17T22:59:44.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f8000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91f0153940 0x7f91f006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f8000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f8000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f006d660 con 0x7f91f00c94e0 2024-01-17T22:59:44.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f8000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f0159970 con 0x7f91f0153940 2024-01-17T22:59:44.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f8000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0159c50 con 0x7f91f00c22e0 2024-01-17T22:59:44.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f5600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f91f0153940 0x7f91f006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f4c00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f91f00c94e0 0x7f91f006a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:47112/0 (socket says 172.21.15.67:47112) 2024-01-17T22:59:44.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f4c00640 1 -- 172.21.15.67:0/2381820485 learned_addr learned my addr 172.21.15.67:0/2381820485 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:44.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.013+0000 7f91f6000640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.017+0000 7f91efe00640 1 -- 172.21.15.67:0/2381820485 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983010074 0 0) 0x7f91f006d660 con 0x7f91f00c94e0 2024-01-17T22:59:44.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.017+0000 7f91f5600640 1 -- 172.21.15.67:0/2381820485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 msgr2=0x7f91f006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:44.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.017+0000 7f91f5600640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.017+0000 7f91f5600640 1 -- 172.21.15.67:0/2381820485 >> v1:172.21.15.137:6789/0 conn(0x7f91f00c94e0 legacy=0x7f91f006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.017+0000 7f91f5600640 1 -- 172.21.15.67:0/2381820485 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0159f30 con 0x7f91f0153940 2024-01-17T22:59:44.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.025+0000 7f91f5600640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f006daf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097c0 tx=0x7f91e001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09fdb1f3b58e5e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.029+0000 7f91efe00640 1 -- 172.21.15.67:0/2381820485 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00a8970 con 0x7f91f0153940 2024-01-17T22:59:44.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.029+0000 7f91efe00640 1 -- 172.21.15.67:0/2381820485 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00a8ad0 con 0x7f91f0153940 2024-01-17T22:59:44.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.029+0000 7f91efe00640 1 -- 172.21.15.67:0/2381820485 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00a8e60 con 0x7f91f0153940 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.029+0000 7f91f8000640 1 -- 172.21.15.67:0/2381820485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 msgr2=0x7f91f006daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.029+0000 7f91f8000640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f006daf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097c0 tx=0x7f91e001ec70 comp rx=0 tx=0).stop 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 -- 172.21.15.67:0/2381820485 shutdown_connections 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 --2- 172.21.15.67:0/2381820485 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f006daf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 -- 172.21.15.67:0/2381820485 >> 172.21.15.67:0/2381820485 conn(0x7f91f00c89c0 msgr2=0x7f91f00c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 -- 172.21.15.67:0/2381820485 shutdown_connections 2024-01-17T22:59:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.033+0000 7f91f8000640 1 -- 172.21.15.67:0/2381820485 wait complete. 2024-01-17T22:59:44.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 Processor -- start 2024-01-17T22:59:44.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 -- start start 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f00c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 0x7f91f00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f01e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f01f22b0 con 0x7f91f0153940 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c5d20 con 0x7f91f00c94e0 2024-01-17T22:59:44.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f8000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c6000 con 0x7f91f00c22e0 2024-01-17T22:59:44.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f00c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.037+0000 7f91f4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 0x7f91f00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.041+0000 7f91f5600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f00c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:39264/0 (socket says 172.21.15.67:39264) 2024-01-17T22:59:44.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.041+0000 7f91f5600640 1 -- 172.21.15.67:0/956754172 learned_addr learned my addr 172.21.15.67:0/956754172 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:44.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.041+0000 7f91f6000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f01e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.045+0000 7f91f4c00640 1 -- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 msgr2=0x7f91f00c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.045+0000 7f91f4c00640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f00c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.045+0000 7f91f4c00640 1 -- 172.21.15.67:0/956754172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 msgr2=0x7f91f01e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.045+0000 7f91f4c00640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f01e4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.045+0000 7f91f4c00640 1 -- 172.21.15.67:0/956754172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0009420 con 0x7f91f00c94e0 2024-01-17T22:59:44.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.049+0000 7f91f4c00640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 0x7f91f00ca9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c10 tx=0x7f91d800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80074e0 con 0x7f91f00c94e0 2024-01-17T22:59:44.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8007640 con 0x7f91f00c94e0 2024-01-17T22:59:44.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8004a30 con 0x7f91f00c94e0 2024-01-17T22:59:44.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f01f24c0 con 0x7f91f00c94e0 2024-01-17T22:59:44.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f01f2a80 con 0x7f91f00c94e0 2024-01-17T22:59:44.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.061+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f0061f60 con 0x7f91f00c94e0 2024-01-17T22:59:44.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.365+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7f91d8004b90 con 0x7f91f00c94e0 2024-01-17T22:59:44.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.365+0000 7f91ed600640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 0x7f91c8068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.365+0000 7f91f5600640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 0x7f91c8068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.365+0000 7f91f5600640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 0x7f91c8068c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91e001c8a0 tx=0x7f91e00aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.369+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f91d8055360 con 0x7f91f00c94e0 2024-01-17T22:59:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.381+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f91d80516a0 con 0x7f91f00c94e0 2024-01-17T22:59:44.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.633+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91f00746a0 con 0x7f91f00c94e0 2024-01-17T22:59:44.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.661+0000 7f91ed600640 1 -- 172.21.15.67:0/956754172 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91d8054cc0 con 0x7f91f00c94e0 2024-01-17T22:59:44.667 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T22:59:44.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 msgr2=0x7f91c8068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 0x7f91c8068c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91e001c8a0 tx=0x7f91e00aa070 comp rx=0 tx=0).stop 2024-01-17T22:59:44.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 msgr2=0x7f91f00ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 0x7f91f00ca9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c10 tx=0x7f91d800c8e0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 shutdown_connections 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91c80667b0 0x7f91c8068c70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f0153940 0x7f91f01e4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00c94e0 0x7f91f00ca9d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 --2- 172.21.15.67:0/956754172 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f00c22e0 0x7f91f00c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.665+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 >> 172.21.15.67:0/956754172 conn(0x7f91f00c89c0 msgr2=0x7f91f006a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.669+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 shutdown_connections 2024-01-17T22:59:44.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.669+0000 7f91f8000640 1 -- 172.21.15.67:0/956754172 wait complete. 2024-01-17T22:59:44.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:44.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 Processor -- start 2024-01-17T22:59:44.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 -- start start 2024-01-17T22:59:44.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe580c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5815db50 con 0x7efe580c2a00 2024-01-17T22:59:44.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5815ccf0 con 0x7efe58153bb0 2024-01-17T22:59:44.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.885+0000 7efe5e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5815cf40 con 0x7efe5806f1f0 2024-01-17T22:59:44.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.889+0000 7efe57e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efe580c2a00 0x7efe58159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59172/0 (socket says 172.21.15.67:59172) 2024-01-17T22:59:44.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.889+0000 7efe57e00640 1 -- 172.21.15.67:0/2613603184 learned_addr learned my addr 172.21.15.67:0/2613603184 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:44.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.889+0000 7efe56a00640 1 --2- 172.21.15.67:0/2613603184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe580c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.893+0000 7efe56a00640 1 -- 172.21.15.67:0/2613603184 >> v1:172.21.15.137:6789/0 conn(0x7efe58153bb0 legacy=0x7efe5806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:44.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.893+0000 7efe56a00640 1 -- 172.21.15.67:0/2613603184 >> v1:172.21.15.67:6789/0 conn(0x7efe580c2a00 legacy=0x7efe58159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.893+0000 7efe56a00640 1 -- 172.21.15.67:0/2613603184 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5815d220 con 0x7efe5806f1f0 2024-01-17T22:59:44.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.901+0000 7efe56a00640 1 --2- 172.21.15.67:0/2613603184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe580c24c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe400097f0 tx=0x7efe4001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa5e72f0b428459 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe56000640 1 -- 172.21.15.67:0/2613603184 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400ad660 con 0x7efe5806f1f0 2024-01-17T22:59:44.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe56000640 1 -- 172.21.15.67:0/2613603184 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe400ad7c0 con 0x7efe5806f1f0 2024-01-17T22:59:44.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe56000640 1 -- 172.21.15.67:0/2613603184 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400adb50 con 0x7efe5806f1f0 2024-01-17T22:59:44.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 -- 172.21.15.67:0/2613603184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 msgr2=0x7efe580c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 --2- 172.21.15.67:0/2613603184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe580c24c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe400097f0 tx=0x7efe4001c450 comp rx=0 tx=0).stop 2024-01-17T22:59:44.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 -- 172.21.15.67:0/2613603184 shutdown_connections 2024-01-17T22:59:44.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 --2- 172.21.15.67:0/2613603184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe580c24c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 -- 172.21.15.67:0/2613603184 >> 172.21.15.67:0/2613603184 conn(0x7efe5806fc50 msgr2=0x7efe58070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:44.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 -- 172.21.15.67:0/2613603184 shutdown_connections 2024-01-17T22:59:44.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.909+0000 7efe5e400640 1 -- 172.21.15.67:0/2613603184 wait complete. 2024-01-17T22:59:44.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 Processor -- start 2024-01-17T22:59:44.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 -- start start 2024-01-17T22:59:44.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe580c2a00 0x7efe581581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe58153bb0 0x7efe5814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe581541f0 con 0x7efe580c2a00 2024-01-17T22:59:44.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe581547f0 con 0x7efe58153bb0 2024-01-17T22:59:44.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.913+0000 7efe5e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5814f590 con 0x7efe5806f1f0 2024-01-17T22:59:44.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.917+0000 7efe57400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.917+0000 7efe57e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe58153bb0 0x7efe5814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.917+0000 7efe57400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:39276/0 (socket says 172.21.15.67:39276) 2024-01-17T22:59:44.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.917+0000 7efe57400640 1 -- 172.21.15.67:0/912839618 learned_addr learned my addr 172.21.15.67:0/912839618 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:44.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.929+0000 7efe57400640 1 -- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe58153bb0 msgr2=0x7efe5814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.929+0000 7efe57400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe58153bb0 0x7efe5814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.929+0000 7efe57400640 1 -- 172.21.15.67:0/912839618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe580c2a00 msgr2=0x7efe581581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:44.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.929+0000 7efe57400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe580c2a00 0x7efe581581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:44.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.929+0000 7efe57400640 1 -- 172.21.15.67:0/912839618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009420 con 0x7efe5806f1f0 2024-01-17T22:59:44.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.937+0000 7efe57400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe4800b410 tx=0x7efe4800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:44.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48004020 con 0x7efe5806f1f0 2024-01-17T22:59:44.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48004180 con 0x7efe5806f1f0 2024-01-17T22:59:44.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48011630 con 0x7efe5806f1f0 2024-01-17T22:59:44.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe58158dd0 con 0x7efe5806f1f0 2024-01-17T22:59:44.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe58158af0 con 0x7efe5806f1f0 2024-01-17T22:59:44.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.945+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe58067c90 con 0x7efe5806f1f0 2024-01-17T22:59:44.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.989+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7efe48011790 con 0x7efe5806f1f0 2024-01-17T22:59:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.993+0000 7efe4f400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 0x7efe30068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:44.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.993+0000 7efe56a00640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 0x7efe30068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:44.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.993+0000 7efe56a00640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 0x7efe30068cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe400af000 tx=0x7efe40004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:45.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:44.997+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe48055c20 con 0x7efe5806f1f0 2024-01-17T22:59:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.333+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7efe48051860 con 0x7efe5806f1f0 2024-01-17T22:59:45.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.717+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe580746a0 con 0x7efe5806f1f0 2024-01-17T22:59:45.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.765+0000 7efe4f400640 1 -- 172.21.15.67:0/912839618 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7efe48015020 con 0x7efe5806f1f0 2024-01-17T22:59:45.771 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:59:45.772 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 1 2024-01-17T22:59:45.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.769+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 msgr2=0x7efe30068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.769+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 0x7efe30068cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe400af000 tx=0x7efe40004740 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.769+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 msgr2=0x7efe58150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.769+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efe4800b410 tx=0x7efe4800b8d0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 shutdown_connections 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efe30066800 0x7efe30068cc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe58153bb0 0x7efe5814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efe580c2a00 0x7efe581581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 --2- 172.21.15.67:0/912839618 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efe5806f1f0 0x7efe58150080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:45.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 >> 172.21.15.67:0/912839618 conn(0x7efe5806fc50 msgr2=0x7efe58151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:45.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 shutdown_connections 2024-01-17T22:59:45.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:45.773+0000 7efe5e400640 1 -- 172.21.15.67:0/912839618 wait complete. 2024-01-17T22:59:47.809 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:48.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.040+0000 7f8bfae00640 1 Processor -- start 2024-01-17T22:59:48.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.040+0000 7f8bfae00640 1 -- start start 2024-01-17T22:59:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bfae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bf40c9060 0x7f8bf40c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bfae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bf406aca0 0x7f8bf406b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bfae00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf4151c30 con 0x7f8bf4151850 2024-01-17T22:59:48.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bfae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf406b670 con 0x7f8bf406aca0 2024-01-17T22:59:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bfae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf415b890 con 0x7f8bf40c9060 2024-01-17T22:59:48.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bf3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bf40c9060 0x7f8bf40c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bf9800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8bf406aca0 0x7f8bf406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bf3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8bf40c9060 0x7f8bf40c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:52252/0 (socket says 172.21.15.67:52252) 2024-01-17T22:59:48.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.044+0000 7f8bf3400640 1 -- 172.21.15.67:0/1322535217 learned_addr learned my addr 172.21.15.67:0/1322535217 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:48.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.048+0000 7f8bf3400640 1 -- 172.21.15.67:0/1322535217 >> v2:172.21.15.67:3300/0 conn(0x7f8bf406aca0 msgr2=0x7f8bf406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T22:59:48.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.048+0000 7f8bf3400640 1 --2- 172.21.15.67:0/1322535217 >> v2:172.21.15.67:3300/0 conn(0x7f8bf406aca0 0x7f8bf406b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.048+0000 7f8bf3400640 1 -- 172.21.15.67:0/1322535217 >> v1:172.21.15.67:6789/0 conn(0x7f8bf4151850 legacy=0x7f8bf40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.048+0000 7f8bf3400640 1 -- 172.21.15.67:0/1322535217 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf415ad10 con 0x7f8bf40c9060 2024-01-17T22:59:48.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.056+0000 7f8bf3400640 1 --2- 172.21.15.67:0/1322535217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf40c9060 0x7f8bf40c9480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8bf408b410 tx=0x7f8bdc01ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef20fc8b00f8e38 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bf2a00640 1 -- 172.21.15.67:0/1322535217 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a89f0 con 0x7f8bf40c9060 2024-01-17T22:59:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bf2a00640 1 -- 172.21.15.67:0/1322535217 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0a8b50 con 0x7f8bf40c9060 2024-01-17T22:59:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bf2a00640 1 -- 172.21.15.67:0/1322535217 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0b0440 con 0x7f8bf40c9060 2024-01-17T22:59:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 -- 172.21.15.67:0/1322535217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf40c9060 msgr2=0x7f8bf40c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 --2- 172.21.15.67:0/1322535217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf40c9060 0x7f8bf40c9480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8bf408b410 tx=0x7f8bdc01ecf0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 -- 172.21.15.67:0/1322535217 shutdown_connections 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 --2- 172.21.15.67:0/1322535217 >> v2:172.21.15.67:3300/0 conn(0x7f8bf406aca0 0x7f8bf406b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 --2- 172.21.15.67:0/1322535217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf40c9060 0x7f8bf40c9480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 -- 172.21.15.67:0/1322535217 >> 172.21.15.67:0/1322535217 conn(0x7f8bf40705c0 msgr2=0x7f8bf40709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 -- 172.21.15.67:0/1322535217 shutdown_connections 2024-01-17T22:59:48.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.064+0000 7f8bfae00640 1 -- 172.21.15.67:0/1322535217 wait complete. 2024-01-17T22:59:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 Processor -- start 2024-01-17T22:59:48.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 -- start start 2024-01-17T22:59:48.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bf40c9060 0x7f8bf4150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf4151850 0x7f8bf41ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41f10f0 con 0x7f8bf40c9060 2024-01-17T22:59:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41f1510 con 0x7f8bf4151850 2024-01-17T22:59:48.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bfae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4145150 con 0x7f8bf406aca0 2024-01-17T22:59:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bf3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bf3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:39280/0 (socket says 172.21.15.67:39280) 2024-01-17T22:59:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bf3e00640 1 -- 172.21.15.67:0/4246727462 learned_addr learned my addr 172.21.15.67:0/4246727462 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:48.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.068+0000 7f8bf9800640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf4151850 0x7f8bf41ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.072+0000 7f8bf3400640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bf40c9060 0x7f8bf4150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.076+0000 7f8bf3e00640 1 -- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf4151850 msgr2=0x7f8bf41ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.076+0000 7f8bf3e00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf4151850 0x7f8bf41ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.076+0000 7f8bf3e00640 1 -- 172.21.15.67:0/4246727462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bf40c9060 msgr2=0x7f8bf4150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.076+0000 7f8bf3e00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bf40c9060 0x7f8bf4150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.076+0000 7f8bf3e00640 1 -- 172.21.15.67:0/4246727462 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0094d0 con 0x7f8bf406aca0 2024-01-17T22:59:48.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.080+0000 7f8bf3e00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c420 tx=0x7f8be400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.084+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40052d0 con 0x7f8bf406aca0 2024-01-17T22:59:48.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.084+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4005430 con 0x7f8bf406aca0 2024-01-17T22:59:48.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.084+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4007260 con 0x7f8bf406aca0 2024-01-17T22:59:48.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.084+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf41453a0 con 0x7f8bf406aca0 2024-01-17T22:59:48.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.084+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf41f0a30 con 0x7f8bf406aca0 2024-01-17T22:59:48.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.088+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf40746a0 con 0x7f8bf406aca0 2024-01-17T22:59:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.412+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 4) v1 ==== 85937+0+0 (secure 0 0 0) 0x7f8be40073c0 con 0x7f8bf406aca0 2024-01-17T22:59:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.412+0000 7f8bebe00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 0x7f8bcc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:48.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.412+0000 7f8bf3400640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 0x7f8bcc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.412+0000 7f8bf3400640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 0x7f8bcc068c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0b2000 tx=0x7f8bdc0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:48.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.412+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8be4007670 con 0x7f8bf406aca0 2024-01-17T22:59:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.432+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8be4051000 con 0x7f8bf406aca0 2024-01-17T22:59:48.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.848+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bf414da70 con 0x7f8bf406aca0 2024-01-17T22:59:48.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.864+0000 7f8bebe00640 1 -- 172.21.15.67:0/4246727462 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8be4020020 con 0x7f8bf406aca0 2024-01-17T22:59:48.872 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:59:48.872 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:59:48.872 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 1 2024-01-17T22:59:48.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 msgr2=0x7f8bcc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 0x7f8bcc068c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0b2000 tx=0x7f8bdc0aa070 comp rx=0 tx=0).stop 2024-01-17T22:59:48.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 msgr2=0x7f8bf40b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:48.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8be400c420 tx=0x7f8be400c8e0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 shutdown_connections 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8bcc0667b0 0x7f8bcc068c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bf4151850 0x7f8bf41ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bf40c9060 0x7f8bf4150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 --2- 172.21.15.67:0/4246727462 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8bf406aca0 0x7f8bf40b18d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 >> 172.21.15.67:0/4246727462 conn(0x7f8bf40705c0 msgr2=0x7f8bf406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:48.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 shutdown_connections 2024-01-17T22:59:48.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:48.868+0000 7f8bfae00640 1 -- 172.21.15.67:0/4246727462 wait complete. 2024-01-17T22:59:50.652 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2024-01-17T22:59:50.773 INFO:tasks.ceph.mds.e.smithi067.stdout:starting mds.e at 2024-01-17T22:59:50.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T22:59:51.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.044+0000 7f836e200640 1 Processor -- start 2024-01-17T22:59:51.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.044+0000 7f836e200640 1 -- start start 2024-01-17T22:59:51.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f836e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f836e200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836815db50 con 0x7f8368159920 2024-01-17T22:59:51.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f836e200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836815ccf0 con 0x7f836806f1f0 2024-01-17T22:59:51.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f836e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836815cf40 con 0x7f8368153bb0 2024-01-17T22:59:51.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f8367e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8368159920 0x7f8368159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36660/0 (socket says 172.21.15.67:36660) 2024-01-17T22:59:51.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f8367e00640 1 -- 172.21.15.67:0/2945440180 learned_addr learned my addr 172.21.15.67:0/2945440180 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T22:59:51.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.048+0000 7f8367400640 1 --2- 172.21.15.67:0/2945440180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.056+0000 7f8367400640 1 -- 172.21.15.67:0/2945440180 >> v1:172.21.15.137:6789/0 conn(0x7f836806f1f0 legacy=0x7f83680c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.056+0000 7f8367400640 1 -- 172.21.15.67:0/2945440180 >> v1:172.21.15.67:6789/0 conn(0x7f8368159920 legacy=0x7f8368159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.056+0000 7f8367400640 1 -- 172.21.15.67:0/2945440180 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836815d220 con 0x7f8368153bb0 2024-01-17T22:59:51.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.060+0000 7f8367400640 1 --2- 172.21.15.67:0/2945440180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836806df70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83580097f0 tx=0x7f835801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8760b8bfa0b68fe server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:51.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f8366000640 1 -- 172.21.15.67:0/2945440180 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580a89b0 con 0x7f8368153bb0 2024-01-17T22:59:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f8366000640 1 -- 172.21.15.67:0/2945440180 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83580a8b10 con 0x7f8368153bb0 2024-01-17T22:59:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f8366000640 1 -- 172.21.15.67:0/2945440180 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580a8ea0 con 0x7f8368153bb0 2024-01-17T22:59:51.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- 172.21.15.67:0/2945440180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 msgr2=0x7f836806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 --2- 172.21.15.67:0/2945440180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836806df70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83580097f0 tx=0x7f835801ecb0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- 172.21.15.67:0/2945440180 shutdown_connections 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 --2- 172.21.15.67:0/2945440180 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836806df70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- 172.21.15.67:0/2945440180 >> 172.21.15.67:0/2945440180 conn(0x7f836806fc50 msgr2=0x7f8368070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- 172.21.15.67:0/2945440180 shutdown_connections 2024-01-17T22:59:51.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- 172.21.15.67:0/2945440180 wait complete. 2024-01-17T22:59:51.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 Processor -- start 2024-01-17T22:59:51.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- start start 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8368159920 0x7f836814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368149260 con 0x7f836806f1f0 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836814dab0 con 0x7f8368159920 2024-01-17T22:59:51.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.072+0000 7f836e200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83681f04b0 con 0x7f8368153bb0 2024-01-17T22:59:51.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.076+0000 7f8367400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.076+0000 7f8367400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60350/0 (socket says 172.21.15.67:60350) 2024-01-17T22:59:51.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.076+0000 7f8367400640 1 -- 172.21.15.67:0/2864163524 learned_addr learned my addr 172.21.15.67:0/2864163524 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T22:59:51.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.076+0000 7f8366a00640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.076+0000 7f8367e00640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8368159920 0x7f836814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.080+0000 7f8367400640 1 -- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 msgr2=0x7f836814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.080+0000 7f8367400640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.080+0000 7f8367400640 1 -- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8368159920 msgr2=0x7f836814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.080+0000 7f8367400640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8368159920 0x7f836814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.080+0000 7f8367400640 1 -- 172.21.15.67:0/2864163524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009420 con 0x7f836806f1f0 2024-01-17T22:59:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:51.084+0000 7f8367400640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f835801b8c0 tx=0x7f835801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:52.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580b9630 con 0x7f836806f1f0 2024-01-17T22:59:52.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83580b97d0 con 0x7f836806f1f0 2024-01-17T22:59:52.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580b9b80 con 0x7f836806f1f0 2024-01-17T22:59:52.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8368148b80 con 0x7f836806f1f0 2024-01-17T22:59:52.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83681efc10 con 0x7f836806f1f0 2024-01-17T22:59:52.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:52.176+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8368067c90 con 0x7f836806f1f0 2024-01-17T22:59:52.442 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2024-01-17T22:59:52.487 INFO:tasks.ceph.mds.b.smithi137.stdout:starting mds.b at 2024-01-17T22:59:52.544 INFO:tasks.ceph.mds.d.smithi137.stdout:starting mds.d at 2024-01-17T22:59:52.547 INFO:tasks.ceph.mds.f.smithi137.stdout:starting mds.f at 2024-01-17T22:59:58.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.180+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f83580b7040 con 0x7f836806f1f0 2024-01-17T22:59:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.180+0000 7f835f400640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 0x7f8340068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T22:59:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.180+0000 7f8366a00640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 0x7f8340068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T22:59:58.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.184+0000 7f8366a00640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 0x7f8340068d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83680c1b40 tx=0x7f8350009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T22:59:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.192+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83580f3d60 con 0x7f836806f1f0 2024-01-17T22:59:58.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.192+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f83580f00a0 con 0x7f836806f1f0 2024-01-17T22:59:58.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.388+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83680746a0 con 0x7f836806f1f0 2024-01-17T22:59:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f835f400640 1 -- 172.21.15.67:0/2864163524 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f83580b5090 con 0x7f836806f1f0 2024-01-17T22:59:58.997 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T22:59:58.997 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T22:59:58.997 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 1 2024-01-17T22:59:58.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 msgr2=0x7f8340068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:58.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 0x7f8340068d50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83680c1b40 tx=0x7f8350009040 comp rx=0 tx=0).stop 2024-01-17T22:59:58.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 msgr2=0x7f8368158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T22:59:58.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f835801b8c0 tx=0x7f835801ba50 comp rx=0 tx=0).stop 2024-01-17T22:59:58.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 shutdown_connections 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8340066890 0x7f8340068d50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8368159920 0x7f836814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8368153bb0 0x7f836814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 --2- 172.21.15.67:0/2864163524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f836806f1f0 0x7f8368158b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 >> 172.21.15.67:0/2864163524 conn(0x7f836806fc50 msgr2=0x7f8368151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 shutdown_connections 2024-01-17T22:59:59.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T22:59:58.992+0000 7f836e200640 1 -- 172.21.15.67:0/2864163524 wait complete. 2024-01-17T23:00:01.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:01.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 Processor -- start 2024-01-17T23:00:01.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 -- start start 2024-01-17T23:00:01.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fede40c6480 0x7fede406d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c68a0 0x7fede406dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede4159ad0 con 0x7fede414ff10 2024-01-17T23:00:01.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede406cc20 con 0x7fede40c6480 2024-01-17T23:00:01.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.172+0000 7fedeb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede406cf00 con 0x7fede40c68a0 2024-01-17T23:00:01.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fede40c6480 0x7fede406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fede40c6480 0x7fede406d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52076/0 (socket says 172.21.15.67:52076) 2024-01-17T23:00:01.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 -- 172.21.15.67:0/3170532779 learned_addr learned my addr 172.21.15.67:0/3170532779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:01.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede9800640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c68a0 0x7fede406dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 -- 172.21.15.67:0/3170532779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c68a0 msgr2=0x7fede406dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:01.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c68a0 0x7fede406dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 -- 172.21.15.67:0/3170532779 >> v1:172.21.15.137:6789/0 conn(0x7fede414ff10 legacy=0x7fede4156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:01.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.176+0000 7fede3e00640 1 -- 172.21.15.67:0/3170532779 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede41591a0 con 0x7fede40c6480 2024-01-17T23:00:01.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.180+0000 7fede3e00640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c6480 0x7fede406d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab1c5210f463ef1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.184+0000 7fede3400640 1 -- 172.21.15.67:0/3170532779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0a89b0 con 0x7fede40c6480 2024-01-17T23:00:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.184+0000 7fede3400640 1 -- 172.21.15.67:0/3170532779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0a8b10 con 0x7fede40c6480 2024-01-17T23:00:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.184+0000 7fede3400640 1 -- 172.21.15.67:0/3170532779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0a8ea0 con 0x7fede40c6480 2024-01-17T23:00:01.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.184+0000 7fedeb800640 1 -- 172.21.15.67:0/3170532779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c6480 msgr2=0x7fede406d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:01.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.184+0000 7fedeb800640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c6480 0x7fede406d730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009870 tx=0x7fedcc01ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- 172.21.15.67:0/3170532779 shutdown_connections 2024-01-17T23:00:01.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c68a0 0x7fede406dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 --2- 172.21.15.67:0/3170532779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c6480 0x7fede406d730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- 172.21.15.67:0/3170532779 >> 172.21.15.67:0/3170532779 conn(0x7fede40cb070 msgr2=0x7fede40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:01.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- 172.21.15.67:0/3170532779 shutdown_connections 2024-01-17T23:00:01.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- 172.21.15.67:0/3170532779 wait complete. 2024-01-17T23:00:01.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 Processor -- start 2024-01-17T23:00:01.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- start start 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c6480 0x7fede4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fede414ff10 0x7fede41ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4150fa0 con 0x7fede40c68a0 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede41f3370 con 0x7fede414ff10 2024-01-17T23:00:01.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.188+0000 7fedeb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede41f2ab0 con 0x7fede40c6480 2024-01-17T23:00:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.192+0000 7fede3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.192+0000 7fede3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52086/0 (socket says 172.21.15.67:52086) 2024-01-17T23:00:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.192+0000 7fede3e00640 1 -- 172.21.15.67:0/918552997 learned_addr learned my addr 172.21.15.67:0/918552997 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:01.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.192+0000 7fede8e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c6480 0x7fede4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.192+0000 7fede9800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fede414ff10 0x7fede41ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 -- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c6480 msgr2=0x7fede4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:01.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c6480 0x7fede4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 -- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fede414ff10 msgr2=0x7fede41ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:01.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fede414ff10 0x7fede41ef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 -- 172.21.15.67:0/918552997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0094d0 con 0x7fede40c68a0 2024-01-17T23:00:01.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.196+0000 7fede3e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fedcc01c920 tx=0x7fedcc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.200+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0b0db0 con 0x7fede40c68a0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.200+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc0ba440 con 0x7fede40c68a0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.200+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0ba7d0 con 0x7fede40c68a0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.200+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede4071d50 con 0x7fede40c68a0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.200+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede41f3000 con 0x7fede40c68a0 2024-01-17T23:00:01.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.204+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4159f40 con 0x7fede40c68a0 2024-01-17T23:00:01.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.220+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fedcc0ba930 con 0x7fede40c68a0 2024-01-17T23:00:01.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.224+0000 7fede0c00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 0x7fedbc068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:01.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.224+0000 7fede8e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 0x7fedbc068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:01.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.224+0000 7fede8e00640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 0x7fedbc068d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098e0 tx=0x7fedd4009060 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:01.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.224+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fedcc0f3710 con 0x7fede40c68a0 2024-01-17T23:00:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.472+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fedcc0efa50 con 0x7fede40c68a0 2024-01-17T23:00:01.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.664+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede4159f40 con 0x7fede40c68a0 2024-01-17T23:00:01.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fede0c00640 1 -- 172.21.15.67:0/918552997 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fede4159f40 con 0x7fede40c68a0 2024-01-17T23:00:01.677 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:01.677 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-17T23:00:01.677 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 1 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 msgr2=0x7fedbc068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 0x7fedbc068d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098e0 tx=0x7fedd4009060 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 msgr2=0x7fede414ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fedcc01c920 tx=0x7fedcc01ba90 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 shutdown_connections 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fedbc0668c0 0x7fedbc068d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fede414ff10 0x7fede41ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fede40c68a0 0x7fede414ec80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 --2- 172.21.15.67:0/918552997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fede40c6480 0x7fede4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 >> 172.21.15.67:0/918552997 conn(0x7fede40cb070 msgr2=0x7fede40c6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 shutdown_connections 2024-01-17T23:00:01.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:01.672+0000 7fedeb800640 1 -- 172.21.15.67:0/918552997 wait complete. 2024-01-17T23:00:03.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.836+0000 7f6f61000640 1 Processor -- start 2024-01-17T23:00:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.836+0000 7f6f61000640 1 -- start start 2024-01-17T23:00:03.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.836+0000 7f6f61000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 0x7f6f5c0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.836+0000 7f6f61000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f5c0b0ff0 0x7f6f5c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f61000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c158510 con 0x7f6f5c1515a0 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f61000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cd370 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f61000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0c2260 con 0x7f6f5c0c3830 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f59400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 0x7f6f5c0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:03.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f5a800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f5c0b0ff0 0x7f6f5c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f59400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 0x7f6f5c0cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:50962/0 (socket says 172.21.15.67:50962) 2024-01-17T23:00:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.840+0000 7f6f59400640 1 -- 172.21.15.67:0/2646569414 learned_addr learned my addr 172.21.15.67:0/2646569414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.844+0000 7f6f5a800640 1 -- 172.21.15.67:0/2646569414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 msgr2=0x7f6f5c0cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.844+0000 7f6f5a800640 1 --2- 172.21.15.67:0/2646569414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 0x7f6f5c0cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.844+0000 7f6f5a800640 1 -- 172.21.15.67:0/2646569414 >> v1:172.21.15.67:6789/0 conn(0x7f6f5c1515a0 legacy=0x7f6f5c0c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.844+0000 7f6f5a800640 1 -- 172.21.15.67:0/2646569414 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0c33a0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.848+0000 7f6f5a800640 1 --2- 172.21.15.67:0/2646569414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c157fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009d90 tx=0x7f6f5401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491256c181b369fc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:03.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f58a00640 1 -- 172.21.15.67:0/2646569414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f540af600 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f58a00640 1 -- 172.21.15.67:0/2646569414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f540ab050 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f58a00640 1 -- 172.21.15.67:0/2646569414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f540af980 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 -- 172.21.15.67:0/2646569414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 msgr2=0x7f6f5c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 --2- 172.21.15.67:0/2646569414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c157fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009d90 tx=0x7f6f5401f130 comp rx=0 tx=0).stop 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 -- 172.21.15.67:0/2646569414 shutdown_connections 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 --2- 172.21.15.67:0/2646569414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c157fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 --2- 172.21.15.67:0/2646569414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c0c3830 0x7f6f5c0cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 -- 172.21.15.67:0/2646569414 >> 172.21.15.67:0/2646569414 conn(0x7f6f5c061100 msgr2=0x7f6f5c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 -- 172.21.15.67:0/2646569414 shutdown_connections 2024-01-17T23:00:03.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.852+0000 7f6f61000640 1 -- 172.21.15.67:0/2646569414 wait complete. 2024-01-17T23:00:03.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 Processor -- start 2024-01-17T23:00:03.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 -- start start 2024-01-17T23:00:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c0c3830 0x7f6f5c1488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c1515a0 0x7f6f5c0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:03.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1f34c0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1ef350 con 0x7f6f5c0c3830 2024-01-17T23:00:03.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f61000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1ef630 con 0x7f6f5c1515a0 2024-01-17T23:00:03.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f59e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:03.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f59e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52102/0 (socket says 172.21.15.67:52102) 2024-01-17T23:00:03.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f59e00640 1 -- 172.21.15.67:0/3146775952 learned_addr learned my addr 172.21.15.67:0/3146775952 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:03.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f5a800640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c1515a0 0x7f6f5c0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:03.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.856+0000 7f6f59400640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c0c3830 0x7f6f5c1488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.860+0000 7f6f59e00640 1 -- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c1515a0 msgr2=0x7f6f5c0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.860+0000 7f6f59e00640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c1515a0 0x7f6f5c0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.860+0000 7f6f59e00640 1 -- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c0c3830 msgr2=0x7f6f5c1488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:03.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.860+0000 7f6f59e00640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c0c3830 0x7f6f5c1488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:03.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.860+0000 7f6f59e00640 1 -- 172.21.15.67:0/3146775952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009a70 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.864+0000 7f6f59e00640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c370 tx=0x7f6f4c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:03.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0052d0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c1ef910 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c1efed0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c005430 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0746a0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:03.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:03.868+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c007220 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.124+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6f4c007380 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.128+0000 7f6f52000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 0x7f6f34068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:04.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.128+0000 7f6f59400640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 0x7f6f34068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:04.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.128+0000 7f6f59400640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 0x7f6f34068d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c1505c0 tx=0x7f6f44009240 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.144+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f4c055070 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.144+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6f4c0513b0 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.340+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f5c0c3e40 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f52000640 1 -- 172.21.15.67:0/3146775952 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f6f4c020090 con 0x7f6f5c0b0ff0 2024-01-17T23:00:04.356 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:04.356 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T23:00:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 msgr2=0x7f6f34068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 0x7f6f34068d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c1505c0 tx=0x7f6f44009240 comp rx=0 tx=0).stop 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 msgr2=0x7f6f5c1f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c370 tx=0x7f6f4c00c830 comp rx=0 tx=0).stop 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 shutdown_connections 2024-01-17T23:00:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f34066840 0x7f6f34068d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f5c1515a0 0x7f6f5c0acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c0c3830 0x7f6f5c1488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 --2- 172.21.15.67:0/3146775952 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f5c0b0ff0 0x7f6f5c1f2f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 >> 172.21.15.67:0/3146775952 conn(0x7f6f5c061100 msgr2=0x7f6f5c14abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 shutdown_connections 2024-01-17T23:00:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:04.352+0000 7f6f61000640 1 -- 172.21.15.67:0/3146775952 wait complete. 2024-01-17T23:00:05.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:05.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:06.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:06.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 Processor -- start 2024-01-17T23:00:06.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 -- start start 2024-01-17T23:00:06.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1bc0c5a70 0x7fc1bc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc1bc0c0090 0x7fc1bc159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc06dc10 con 0x7fc1bc150560 2024-01-17T23:00:06.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc06d7e0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.524+0000 7fc1c4800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc1564c0 con 0x7fc1bc0c5a70 2024-01-17T23:00:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.528+0000 7fc1c2800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc1bc0c0090 0x7fc1bc159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.528+0000 7fc1c1400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1bc0c5a70 0x7fc1bc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.528+0000 7fc1c1e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc1bc150560 0x7fc1bc0722e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43640/0 (socket says 172.21.15.67:43640) 2024-01-17T23:00:06.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.528+0000 7fc1c1e00640 1 -- 172.21.15.67:0/3372166676 learned_addr learned my addr 172.21.15.67:0/3372166676 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:06.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.532+0000 7fc1c2800640 1 -- 172.21.15.67:0/3372166676 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc0c5a70 msgr2=0x7fc1bc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:06.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.532+0000 7fc1c2800640 1 --2- 172.21.15.67:0/3372166676 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc0c5a70 0x7fc1bc156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:06.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.532+0000 7fc1c2800640 1 -- 172.21.15.67:0/3372166676 >> v1:172.21.15.67:6789/0 conn(0x7fc1bc150560 legacy=0x7fc1bc0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:06.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.532+0000 7fc1c2800640 1 -- 172.21.15.67:0/3372166676 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc06d220 con 0x7fc1bc0c0090 2024-01-17T23:00:06.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.536+0000 7fc1c2800640 1 --2- 172.21.15.67:0/3372166676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc159910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0c5fb0 tx=0x7fc1b401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737672b8fcf39328 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:06.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c0a00640 1 -- 172.21.15.67:0/3372166676 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40a78f0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c0a00640 1 -- 172.21.15.67:0/3372166676 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b40a7a50 con 0x7fc1bc0c0090 2024-01-17T23:00:06.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c0a00640 1 -- 172.21.15.67:0/3372166676 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40a7de0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 -- 172.21.15.67:0/3372166676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 msgr2=0x7fc1bc159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:06.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3372166676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc159910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0c5fb0 tx=0x7fc1b401eb20 comp rx=0 tx=0).stop 2024-01-17T23:00:06.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 -- 172.21.15.67:0/3372166676 shutdown_connections 2024-01-17T23:00:06.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3372166676 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc159910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3372166676 >> v2:172.21.15.137:3300/0 conn(0x7fc1bc0c5a70 0x7fc1bc156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 -- 172.21.15.67:0/3372166676 >> 172.21.15.67:0/3372166676 conn(0x7fc1bc0cb070 msgr2=0x7fc1bc0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 -- 172.21.15.67:0/3372166676 shutdown_connections 2024-01-17T23:00:06.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.540+0000 7fc1c4800640 1 -- 172.21.15.67:0/3372166676 wait complete. 2024-01-17T23:00:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 Processor -- start 2024-01-17T23:00:06.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 -- start start 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc0c5a70 0x7fc1bc145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc150560 0x7fc1bc155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc157b20 con 0x7fc1bc0c0090 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc157840 con 0x7fc1bc150560 2024-01-17T23:00:06.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c4800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1542c0 con 0x7fc1bc0c5a70 2024-01-17T23:00:06.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc0c5a70 0x7fc1bc145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52110/0 (socket says 172.21.15.67:52110) 2024-01-17T23:00:06.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c1e00640 1 -- 172.21.15.67:0/3873544310 learned_addr learned my addr 172.21.15.67:0/3873544310 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:06.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.544+0000 7fc1c2800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc150560 0x7fc1bc155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.548+0000 7fc1c1e00640 1 -- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc0c5a70 msgr2=0x7fc1bc145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:06.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.548+0000 7fc1c1e00640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc0c5a70 0x7fc1bc145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:06.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.548+0000 7fc1c1e00640 1 -- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc150560 msgr2=0x7fc1bc155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:06.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.548+0000 7fc1c1e00640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc150560 0x7fc1bc155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:06.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.548+0000 7fc1c1e00640 1 -- 172.21.15.67:0/3873544310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b4009a70 con 0x7fc1bc0c0090 2024-01-17T23:00:06.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.552+0000 7fc1c1e00640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c370 tx=0x7fc1ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac005cf0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac005e50 con 0x7fc1bc0c0090 2024-01-17T23:00:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0072f0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc1545a0 con 0x7fc1bc0c0090 2024-01-17T23:00:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc154b60 con 0x7fc1bc0c0090 2024-01-17T23:00:06.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.556+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc06cb70 con 0x7fc1bc0c0090 2024-01-17T23:00:06.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.576+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc1ac007450 con 0x7fc1bc0c0090 2024-01-17T23:00:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.576+0000 7fc1ba000640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 0x7fc194068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:06.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.576+0000 7fc1c1400640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 0x7fc194068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:06.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.580+0000 7fc1c1400640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 0x7fc194068d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0c4d10 tx=0x7fc1a4009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:06.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.824+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1ac054a40 con 0x7fc1bc0c0090 2024-01-17T23:00:06.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:06.824+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc1ac050d80 con 0x7fc1bc0c0090 2024-01-17T23:00:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.016+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1bc0746a0 con 0x7fc1bc0c0090 2024-01-17T23:00:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1ba000640 1 -- 172.21.15.67:0/3873544310 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fc1ac017020 con 0x7fc1bc0c0090 2024-01-17T23:00:07.029 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:07.029 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T23:00:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 msgr2=0x7fc194068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 0x7fc194068d50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0c4d10 tx=0x7fc1a4009190 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 msgr2=0x7fc1bc1f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c370 tx=0x7fc1ac00c830 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 shutdown_connections 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc194066890 0x7fc194068d50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1bc150560 0x7fc1bc155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1bc0c5a70 0x7fc1bc145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.024+0000 7fc1c4800640 1 --2- 172.21.15.67:0/3873544310 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1bc0c0090 0x7fc1bc1f3d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.028+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 >> 172.21.15.67:0/3873544310 conn(0x7fc1bc0cb070 msgr2=0x7fc1bc0c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.028+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 shutdown_connections 2024-01-17T23:00:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:07.028+0000 7fc1c4800640 1 -- 172.21.15.67:0/3873544310 wait complete. 2024-01-17T23:00:09.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:09.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 Processor -- start 2024-01-17T23:00:09.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 -- start start 2024-01-17T23:00:09.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f472c1539a0 0x7f472c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c15d3f0 0x7f472c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0c9890 con 0x7f472c0c79c0 2024-01-17T23:00:09.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c06d570 con 0x7f472c1539a0 2024-01-17T23:00:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4734a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c159bf0 con 0x7f472c15d3f0 2024-01-17T23:00:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4732000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f472c1539a0 0x7f472c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4731600640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f472c0c79c0 0x7f472c061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:43650/0 (socket says 172.21.15.67:43650) 2024-01-17T23:00:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4731600640 1 -- 172.21.15.67:0/223071117 learned_addr learned my addr 172.21.15.67:0/223071117 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:09.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.200+0000 7f4732a00640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c15d3f0 0x7f472c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.204+0000 7f4732000640 1 -- 172.21.15.67:0/223071117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c15d3f0 msgr2=0x7f472c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.204+0000 7f4732000640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c15d3f0 0x7f472c15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.204+0000 7f4732000640 1 -- 172.21.15.67:0/223071117 >> v1:172.21.15.67:6789/0 conn(0x7f472c0c79c0 legacy=0x7f472c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.204+0000 7f4732000640 1 -- 172.21.15.67:0/223071117 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c15dd60 con 0x7f472c1539a0 2024-01-17T23:00:09.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.208+0000 7f4732000640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c1539a0 0x7f472c0ca410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097c0 tx=0x7f471c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11905b7cf28bbccd server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:09.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.212+0000 7f4730c00640 1 -- 172.21.15.67:0/223071117 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0ab650 con 0x7f472c1539a0 2024-01-17T23:00:09.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.212+0000 7f4730c00640 1 -- 172.21.15.67:0/223071117 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0ab7b0 con 0x7f472c1539a0 2024-01-17T23:00:09.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.212+0000 7f4730c00640 1 -- 172.21.15.67:0/223071117 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0abb40 con 0x7f472c1539a0 2024-01-17T23:00:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- 172.21.15.67:0/223071117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c1539a0 msgr2=0x7f472c0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c1539a0 0x7f472c0ca410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097c0 tx=0x7f471c01c450 comp rx=0 tx=0).stop 2024-01-17T23:00:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- 172.21.15.67:0/223071117 shutdown_connections 2024-01-17T23:00:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c15d3f0 0x7f472c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- 172.21.15.67:0/223071117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c1539a0 0x7f472c0ca410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- 172.21.15.67:0/223071117 >> 172.21.15.67:0/223071117 conn(0x7f472c06ad40 msgr2=0x7f472c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- 172.21.15.67:0/223071117 shutdown_connections 2024-01-17T23:00:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- 172.21.15.67:0/223071117 wait complete. 2024-01-17T23:00:09.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 Processor -- start 2024-01-17T23:00:09.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- start start 2024-01-17T23:00:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c1539a0 0x7f472c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f472c15d3f0 0x7f472c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c14ea60 con 0x7f472c0c79c0 2024-01-17T23:00:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0cd8d0 con 0x7f472c15d3f0 2024-01-17T23:00:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.216+0000 7f4734a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0cdb70 con 0x7f472c1539a0 2024-01-17T23:00:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.220+0000 7f4732000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.220+0000 7f4731600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c1539a0 0x7f472c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.220+0000 7f4732000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52142/0 (socket says 172.21.15.67:52142) 2024-01-17T23:00:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.220+0000 7f4732000640 1 -- 172.21.15.67:0/1471031245 learned_addr learned my addr 172.21.15.67:0/1471031245 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.220+0000 7f4732a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f472c15d3f0 0x7f472c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 -- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c1539a0 msgr2=0x7f472c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c1539a0 0x7f472c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 -- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f472c15d3f0 msgr2=0x7f472c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f472c15d3f0 0x7f472c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 -- 172.21.15.67:0/1471031245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009420 con 0x7f472c0c79c0 2024-01-17T23:00:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.224+0000 7f4732000640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f471c0ad040 tx=0x7f471c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.228+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b5810 con 0x7f472c0c79c0 2024-01-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.228+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0b5990 con 0x7f472c0c79c0 2024-01-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.228+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b5d40 con 0x7f472c0c79c0 2024-01-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.228+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c15c230 con 0x7f472c0c79c0 2024-01-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.228+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c14e680 con 0x7f472c0c79c0 2024-01-17T23:00:09.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.232+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c06b620 con 0x7f472c0c79c0 2024-01-17T23:00:09.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.488+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f471c0c83f0 con 0x7f472c0c79c0 2024-01-17T23:00:09.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.488+0000 7f472a000640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 0x7f4704068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:09.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.492+0000 7f4731600640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 0x7f4704068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.492+0000 7f4731600640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 0x7f4704068d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f472c1f6250 tx=0x7f4714007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:09.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.504+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f471c0f0650 con 0x7f472c0c79c0 2024-01-17T23:00:09.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.504+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f471c0ec990 con 0x7f472c0c79c0 2024-01-17T23:00:09.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.704+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472c0746a0 con 0x7f472c0c79c0 2024-01-17T23:00:09.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.712+0000 7f472a000640 1 -- 172.21.15.67:0/1471031245 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f471c0effb0 con 0x7f472c0c79c0 2024-01-17T23:00:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:09.719 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-17T23:00:09.719 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-01-17T23:00:09.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 msgr2=0x7f4704068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 0x7f4704068d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f472c1f6250 tx=0x7f4714007e90 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 msgr2=0x7f472c1f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f471c0ad040 tx=0x7f471c01ac90 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 shutdown_connections 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f47040668c0 0x7f4704068d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f472c15d3f0 0x7f472c0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f472c1539a0 0x7f472c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 --2- 172.21.15.67:0/1471031245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f472c0c79c0 0x7f472c1f5190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 >> 172.21.15.67:0/1471031245 conn(0x7f472c06ad40 msgr2=0x7f472c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 shutdown_connections 2024-01-17T23:00:09.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:09.716+0000 7f4734a00640 1 -- 172.21.15.67:0/1471031245 wait complete. 2024-01-17T23:00:11.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 Processor -- start 2024-01-17T23:00:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 -- start start 2024-01-17T23:00:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50c806f6e0 0x7f50c80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c80c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c806b9d0 con 0x7f50c8153a00 2024-01-17T23:00:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c806d1d0 con 0x7f50c806f6e0 2024-01-17T23:00:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.892+0000 7f50cf600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c806b7f0 con 0x7f50c80cd520 2024-01-17T23:00:11.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.896+0000 7f50c7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50c806f6e0 0x7f50c80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.896+0000 7f50ccc00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f50c8153a00 0x7f50c815a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38398/0 (socket says 172.21.15.67:38398) 2024-01-17T23:00:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.896+0000 7f50ccc00640 1 -- 172.21.15.67:0/3277209335 learned_addr learned my addr 172.21.15.67:0/3277209335 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.896+0000 7f50cd600640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c80c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.900+0000 7f50c7e00640 1 -- 172.21.15.67:0/3277209335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 msgr2=0x7f50c80c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:11.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.900+0000 7f50c7e00640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c80c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:11.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.900+0000 7f50c7e00640 1 -- 172.21.15.67:0/3277209335 >> v1:172.21.15.67:6789/0 conn(0x7f50c8153a00 legacy=0x7f50c815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:11.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.900+0000 7f50c7e00640 1 -- 172.21.15.67:0/3277209335 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c806bcb0 con 0x7f50c806f6e0 2024-01-17T23:00:11.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.904+0000 7f50c7e00640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c806f6e0 0x7f50c80ccfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097c0 tx=0x7f50b001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9907da1f40e5941f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:11.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50c7400640 1 -- 172.21.15.67:0/3277209335 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a8970 con 0x7f50c806f6e0 2024-01-17T23:00:11.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50c7400640 1 -- 172.21.15.67:0/3277209335 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00a8ad0 con 0x7f50c806f6e0 2024-01-17T23:00:11.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50c7400640 1 -- 172.21.15.67:0/3277209335 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a8e60 con 0x7f50c806f6e0 2024-01-17T23:00:11.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 -- 172.21.15.67:0/3277209335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c806f6e0 msgr2=0x7f50c80ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:11.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c806f6e0 0x7f50c80ccfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097c0 tx=0x7f50b001ec70 comp rx=0 tx=0).stop 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 -- 172.21.15.67:0/3277209335 shutdown_connections 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c80c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 --2- 172.21.15.67:0/3277209335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c806f6e0 0x7f50c80ccfe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 -- 172.21.15.67:0/3277209335 >> 172.21.15.67:0/3277209335 conn(0x7f50c8061100 msgr2=0x7f50c8061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 -- 172.21.15.67:0/3277209335 shutdown_connections 2024-01-17T23:00:11.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.908+0000 7f50cf600640 1 -- 172.21.15.67:0/3277209335 wait complete. 2024-01-17T23:00:11.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 Processor -- start 2024-01-17T23:00:11.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 -- start start 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 0x7f50c80c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c81f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 0x7f50c81f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c8650 con 0x7f50c8153a00 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81f0ab0 con 0x7f50c806f6e0 2024-01-17T23:00:11.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50cf600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80c8eb0 con 0x7f50c80cd520 2024-01-17T23:00:11.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.912+0000 7f50ccc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 0x7f50c80c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.916+0000 7f50ccc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 0x7f50c80c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:55502/0 (socket says 172.21.15.67:55502) 2024-01-17T23:00:11.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.916+0000 7f50ccc00640 1 -- 172.21.15.67:0/3019322758 learned_addr learned my addr 172.21.15.67:0/3019322758 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:11.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.916+0000 7f50cd600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 0x7f50c81f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.916+0000 7f50c7e00640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c81f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 -- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 msgr2=0x7f50c81f0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:11.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c81f0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:11.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 -- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 msgr2=0x7f50c80c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:11.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 0x7f50c80c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:11.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 -- 172.21.15.67:0/3019322758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009420 con 0x7f50c8153a00 2024-01-17T23:00:11.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.920+0000 7f50cd600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 0x7f50c81f0f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009d90 tx=0x7f50c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:11.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c000ced0 con 0x7f50c8153a00 2024-01-17T23:00:11.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c80ca3a0 con 0x7f50c8153a00 2024-01-17T23:00:11.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c80c8860 con 0x7f50c8153a00 2024-01-17T23:00:11.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c000f040 con 0x7f50c8153a00 2024-01-17T23:00:11.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0014680 con 0x7f50c8153a00 2024-01-17T23:00:11.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.924+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c80c9040 con 0x7f50c8153a00 2024-01-17T23:00:11.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.948+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f50c00147e0 con 0x7f50c8153a00 2024-01-17T23:00:11.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.948+0000 7f50c4c00640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 0x7f50a0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:11.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.948+0000 7f50ccc00640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 0x7f50a0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:11.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.948+0000 7f50ccc00640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 0x7f50a0068d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007fd0 tx=0x7f50b8007f20 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:11.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:11.952+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f50c0056390 con 0x7f50c8153a00 2024-01-17T23:00:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.196+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f50c00526d0 con 0x7f50c8153a00 2024-01-17T23:00:12.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.388+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50c80cccd0 con 0x7f50c8153a00 2024-01-17T23:00:12.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.400+0000 7f50c4c00640 1 -- 172.21.15.67:0/3019322758 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f50c0055cf0 con 0x7f50c8153a00 2024-01-17T23:00:12.406 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:12.407 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-17T23:00:12.407 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 3 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 msgr2=0x7f50a0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 0x7f50a0068d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007fd0 tx=0x7f50b8007f20 comp rx=0 tx=0).stop 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 msgr2=0x7f50c81f0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 0x7f50c81f0f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009d90 tx=0x7f50c000c490 comp rx=0 tx=0).stop 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 shutdown_connections 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50a0066870 0x7f50a0068d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50c8153a00 0x7f50c81f0f60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50c80cd520 0x7f50c81f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 --2- 172.21.15.67:0/3019322758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50c806f6e0 0x7f50c80c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 >> 172.21.15.67:0/3019322758 conn(0x7f50c8061100 msgr2=0x7f50c814f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 shutdown_connections 2024-01-17T23:00:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.404+0000 7f50cf600640 1 -- 172.21.15.67:0/3019322758 wait complete. 2024-01-17T23:00:12.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 Processor -- start 2024-01-17T23:00:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 -- start start 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c9650 0x7f5a500c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a500c8970 0x7f5a500c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5006efe0 con 0x7f5a50151a90 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5015b5d0 con 0x7f5a500c8970 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a56000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500c9340 con 0x7f5a500c9650 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a4fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5a500c8970 0x7f5a500c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a4f400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5a50151a90 0x7f5a50157ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:55826/0 (socket says 172.21.15.67:55826) 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a4f400640 1 -- 172.21.15.67:0/3323460228 learned_addr learned my addr 172.21.15.67:0/3323460228 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:12.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.564+0000 7f5a4ea00640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c9650 0x7f5a500c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.568+0000 7f5a4fe00640 1 -- 172.21.15.67:0/3323460228 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c9650 msgr2=0x7f5a500c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:12.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.568+0000 7f5a4fe00640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c9650 0x7f5a500c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.568+0000 7f5a4fe00640 1 -- 172.21.15.67:0/3323460228 >> v1:172.21.15.137:6789/0 conn(0x7f5a50151a90 legacy=0x7f5a50157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.568+0000 7f5a4fe00640 1 -- 172.21.15.67:0/3323460228 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5006ed00 con 0x7f5a500c8970 2024-01-17T23:00:12.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.572+0000 7f5a4fe00640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a500c8970 0x7f5a500c8e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009d90 tx=0x7f5a4801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb9abc006931c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:12.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a4e000640 1 -- 172.21.15.67:0/3323460228 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480af600 con 0x7f5a500c8970 2024-01-17T23:00:12.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a4e000640 1 -- 172.21.15.67:0/3323460228 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a480ab050 con 0x7f5a500c8970 2024-01-17T23:00:12.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a4e000640 1 -- 172.21.15.67:0/3323460228 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480af980 con 0x7f5a500c8970 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 -- 172.21.15.67:0/3323460228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a500c8970 msgr2=0x7f5a500c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a500c8970 0x7f5a500c8e00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009d90 tx=0x7f5a4801f130 comp rx=0 tx=0).stop 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 -- 172.21.15.67:0/3323460228 shutdown_connections 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a500c8970 0x7f5a500c8e00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 --2- 172.21.15.67:0/3323460228 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c9650 0x7f5a500c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 -- 172.21.15.67:0/3323460228 >> 172.21.15.67:0/3323460228 conn(0x7f5a5006fc50 msgr2=0x7f5a50070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 -- 172.21.15.67:0/3323460228 shutdown_connections 2024-01-17T23:00:12.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.576+0000 7f5a56000640 1 -- 172.21.15.67:0/3323460228 wait complete. 2024-01-17T23:00:12.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 Processor -- start 2024-01-17T23:00:12.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 -- start start 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c8970 0x7f5a5014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a500c9650 0x7f5a50152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a501542e0 con 0x7f5a50151a90 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50154800 con 0x7f5a500c9650 2024-01-17T23:00:12.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a56000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500c2360 con 0x7f5a500c8970 2024-01-17T23:00:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a4fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a4ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a500c9650 0x7f5a50152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a4fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46562/0 (socket says 172.21.15.67:46562) 2024-01-17T23:00:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a4fe00640 1 -- 172.21.15.67:0/195595686 learned_addr learned my addr 172.21.15.67:0/195595686 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:12.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.580+0000 7f5a4f400640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c8970 0x7f5a5014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.584+0000 7f5a4fe00640 1 -- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c8970 msgr2=0x7f5a5014e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.584+0000 7f5a4fe00640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c8970 0x7f5a5014e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.584+0000 7f5a4fe00640 1 -- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a500c9650 msgr2=0x7f5a50152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.584+0000 7f5a4fe00640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a500c9650 0x7f5a50152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:12.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.584+0000 7f5a4fe00640 1 -- 172.21.15.67:0/195595686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48009a70 con 0x7f5a50151a90 2024-01-17T23:00:12.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.588+0000 7f5a4fe00640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a4801cd60 tx=0x7f5a4801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480afd50 con 0x7f5a50151a90 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a480c4410 con 0x7f5a50151a90 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480c47c0 con 0x7f5a50151a90 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a50154a60 con 0x7f5a50151a90 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a500c28e0 con 0x7f5a50151a90 2024-01-17T23:00:12.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.592+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50150420 con 0x7f5a50151a90 2024-01-17T23:00:12.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.612+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5a480b6070 con 0x7f5a50151a90 2024-01-17T23:00:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.612+0000 7f5a47400640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 0x7f5a28068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:12.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.612+0000 7f5a4f400640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 0x7f5a28068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:12.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.616+0000 7f5a4f400640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 0x7f5a28068d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a40000f70 tx=0x7f5a40007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:12.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.860+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a480f3aa0 con 0x7f5a50151a90 2024-01-17T23:00:12.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:12.860+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5a480efde0 con 0x7f5a50151a90 2024-01-17T23:00:13.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.028+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a500c2ad0 con 0x7f5a50151a90 2024-01-17T23:00:13.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.116+0000 7f5a47400640 1 -- 172.21.15.67:0/195595686 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12839 (secure 0 0 0) 0x7f5a480c9090 con 0x7f5a50151a90 2024-01-17T23:00:13.123 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:13.123 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":18,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T22:59:45.434267+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 msgr2=0x7f5a28068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 0x7f5a28068d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a40000f70 tx=0x7f5a40007e90 comp rx=0 tx=0).stop 2024-01-17T23:00:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 msgr2=0x7f5a5014af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a4801cd60 tx=0x7f5a4801bed0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 shutdown_connections 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5a28066890 0x7f5a28068d50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a50151a90 0x7f5a5014af80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a500c9650 0x7f5a50152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 --2- 172.21.15.67:0/195595686 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5a500c8970 0x7f5a5014e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 >> 172.21.15.67:0/195595686 conn(0x7f5a5006fc50 msgr2=0x7f5a5014d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 shutdown_connections 2024-01-17T23:00:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.120+0000 7f5a56000640 1 -- 172.21.15.67:0/195595686 wait complete. 2024-01-17T23:00:13.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-17T23:00:13.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T23:00:13.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 Processor -- start 2024-01-17T23:00:13.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 -- start start 2024-01-17T23:00:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 0x7f4a440c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4a440c0c60 0x7f4a440c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440bffb0 con 0x7f4a44156300 2024-01-17T23:00:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a44150a90 con 0x7f4a440c0c60 2024-01-17T23:00:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a49400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440b1130 con 0x7f4a441506b0 2024-01-17T23:00:13.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a41e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4a44156300 0x7f4a4406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38404/0 (socket says 172.21.15.67:38404) 2024-01-17T23:00:13.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.284+0000 7f4a41e00640 1 -- 172.21.15.67:0/1822306833 learned_addr learned my addr 172.21.15.67:0/1822306833 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:13.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.288+0000 7f4a43200640 1 --2- 172.21.15.67:0/1822306833 >> v2:172.21.15.137:3300/0 conn(0x7f4a440c0c60 0x7f4a440c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.288+0000 7f4a42800640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 0x7f4a440c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.288+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055149812 0 0) 0x7f4a440bffb0 con 0x7f4a44156300 2024-01-17T23:00:13.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.288+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a24003530 con 0x7f4a44156300 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2305343437 0 0) 0x7f4a24003530 con 0x7f4a44156300 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 msgr2=0x7f4a440c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 0x7f4a440c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 >> v2:172.21.15.137:3300/0 conn(0x7f4a440c0c60 msgr2=0x7f4a440c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 --2- 172.21.15.67:0/1822306833 >> v2:172.21.15.137:3300/0 conn(0x7f4a440c0c60 0x7f4a440c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a441567b0 con 0x7f4a44156300 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f4a2c001680 con 0x7f4a44156300 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 >> v1:172.21.15.67:6789/0 conn(0x7f4a44156300 legacy=0x7f4a4406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 0x7f4a24003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24003f50 0x7f4a240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a24004d10 0x7f4a24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44150a90 con 0x7f4a24004d10 2024-01-17T23:00:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440b1130 con 0x7f4a24003f50 2024-01-17T23:00:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.292+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2400b990 con 0x7f4a441506b0 2024-01-17T23:00:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.296+0000 7f4a43200640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a24004d10 0x7f4a24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.300+0000 7f4a43200640 1 -- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 msgr2=0x7f4a24003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.300+0000 7f4a43200640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a441506b0 0x7f4a24003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.300+0000 7f4a43200640 1 -- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24003f50 msgr2=0x7f4a240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.300+0000 7f4a43200640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a24003f50 0x7f4a240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.300+0000 7f4a43200640 1 -- 172.21.15.67:0/1822306833 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24003530 con 0x7f4a24004d10 2024-01-17T23:00:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.304+0000 7f4a43200640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a24004d10 0x7f4a24005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00e170 tx=0x7f4a3c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f98fe2ccc4bd841 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0a5c90 con 0x7f4a24004d10 2024-01-17T23:00:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00f040 con 0x7f4a24004d10 2024-01-17T23:00:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a41400640 1 -- 172.21.15.67:0/1822306833 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0ad680 con 0x7f4a24004d10 2024-01-17T23:00:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- 172.21.15.67:0/1822306833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a24004d10 msgr2=0x7f4a24005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 --2- 172.21.15.67:0/1822306833 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a24004d10 0x7f4a24005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00e170 tx=0x7f4a3c01cc80 comp rx=0 tx=0).stop 2024-01-17T23:00:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a43200640 1 -- 172.21.15.67:0/1822306833 reap_dead start 2024-01-17T23:00:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- 172.21.15.67:0/1822306833 shutdown_connections 2024-01-17T23:00:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- 172.21.15.67:0/1822306833 >> 172.21.15.67:0/1822306833 conn(0x7f4a440c7a90 msgr2=0x7f4a440c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- 172.21.15.67:0/1822306833 shutdown_connections 2024-01-17T23:00:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- 172.21.15.67:0/1822306833 wait complete. 2024-01-17T23:00:13.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 Processor -- start 2024-01-17T23:00:13.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.308+0000 7f4a49400640 1 -- start start 2024-01-17T23:00:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a24004d10 0x7f4a4414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a441ef000 0x7f4a441ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441f31b0 con 0x7f4a4414b660 2024-01-17T23:00:13.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4414dfb0 con 0x7f4a441ef000 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a49400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441576f0 con 0x7f4a24004d10 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a41e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a43200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a441ef000 0x7f4a441ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a41e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46568/0 (socket says 172.21.15.67:46568) 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a41e00640 1 -- 172.21.15.67:0/233433844 learned_addr learned my addr 172.21.15.67:0/233433844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:13.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.312+0000 7f4a42800640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a24004d10 0x7f4a4414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 -- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a24004d10 msgr2=0x7f4a4414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a24004d10 0x7f4a4414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 -- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a441ef000 msgr2=0x7f4a441ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a441ef000 0x7f4a441ef480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 -- 172.21.15.67:0/233433844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a441f2570 con 0x7f4a4414b660 2024-01-17T23:00:13.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.316+0000 7f4a41e00640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c790 tx=0x7f4a2c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:13.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.320+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00cea0 con 0x7f4a4414b660 2024-01-17T23:00:13.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.320+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0074e0 con 0x7f4a4414b660 2024-01-17T23:00:13.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.320+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c004a30 con 0x7f4a4414b660 2024-01-17T23:00:13.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.320+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4414e8d0 con 0x7f4a4414b660 2024-01-17T23:00:13.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.324+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a441f2af0 con 0x7f4a4414b660 2024-01-17T23:00:13.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.324+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a441f32f0 con 0x7f4a4414b660 2024-01-17T23:00:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.344+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4a2c00a640 con 0x7f4a4414b660 2024-01-17T23:00:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.344+0000 7f4a3aa00640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 0x7f4a1c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.344+0000 7f4a42800640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 0x7f4a1c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.344+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a2c007650 con 0x7f4a4414b660 2024-01-17T23:00:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.348+0000 7f4a42800640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 0x7f4a1c068d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a340093b0 tx=0x7f4a34009320 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:13.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.592+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4a2c050f70 con 0x7f4a4414b660 2024-01-17T23:00:13.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.756+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a441f32f0 con 0x7f4a4414b660 2024-01-17T23:00:13.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.776+0000 7f4a3aa00640 1 -- 172.21.15.67:0/233433844 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a441f32f0 con 0x7f4a4414b660 2024-01-17T23:00:13.783 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 msgr2=0x7f4a1c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 0x7f4a1c068d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a340093b0 tx=0x7f4a34009320 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 msgr2=0x7f4a44155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c790 tx=0x7f4a2c00cc50 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 shutdown_connections 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4a1c0668c0 0x7f4a1c068d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a441ef000 0x7f4a441ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4a4414b660 0x7f4a44155930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 --2- 172.21.15.67:0/233433844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4a24004d10 0x7f4a4414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 >> 172.21.15.67:0/233433844 conn(0x7f4a440c7a90 msgr2=0x7f4a441497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 shutdown_connections 2024-01-17T23:00:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.780+0000 7f4a49400640 1 -- 172.21.15.67:0/233433844 wait complete. 2024-01-17T23:00:13.805 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-17T23:00:13.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.940+0000 7fa738400640 1 Processor -- start 2024-01-17T23:00:13.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.940+0000 7fa738400640 1 -- start start 2024-01-17T23:00:13.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa738400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa730153770 0x7fa73015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa738400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa730070d40 0x7fa730071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa738400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73015db30 con 0x7fa730153b50 2024-01-17T23:00:13.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa738400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73015a620 con 0x7fa730153770 2024-01-17T23:00:13.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa738400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73015ccf0 con 0x7fa730070d40 2024-01-17T23:00:13.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa735a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa730153770 0x7fa73015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa735a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa730153770 0x7fa73015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46582/0 (socket says 172.21.15.67:46582) 2024-01-17T23:00:13.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa735a00640 1 -- 172.21.15.67:0/1592227158 learned_addr learned my addr 172.21.15.67:0/1592227158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:13.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.944+0000 7fa736400640 1 --2- 172.21.15.67:0/1592227158 >> v2:172.21.15.137:3300/0 conn(0x7fa730070d40 0x7fa730071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.948+0000 7fa735a00640 1 -- 172.21.15.67:0/1592227158 >> v2:172.21.15.137:3300/0 conn(0x7fa730070d40 msgr2=0x7fa730071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.948+0000 7fa735a00640 1 --2- 172.21.15.67:0/1592227158 >> v2:172.21.15.137:3300/0 conn(0x7fa730070d40 0x7fa730071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.948+0000 7fa735a00640 1 -- 172.21.15.67:0/1592227158 >> v1:172.21.15.137:6789/0 conn(0x7fa730153b50 legacy=0x7fa7300ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:13.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.948+0000 7fa735a00640 1 -- 172.21.15.67:0/1592227158 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300c7ad0 con 0x7fa730153770 2024-01-17T23:00:13.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.952+0000 7fa735a00640 1 --2- 172.21.15.67:0/1592227158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730153770 0x7fa73015a0e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7301571a0 tx=0x7fa72001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d554c04708e754d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa72fe00640 1 -- 172.21.15.67:0/1592227158 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200a89b0 con 0x7fa730153770 2024-01-17T23:00:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa72fe00640 1 -- 172.21.15.67:0/1592227158 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200a8b10 con 0x7fa730153770 2024-01-17T23:00:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa72fe00640 1 -- 172.21.15.67:0/1592227158 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200a8ea0 con 0x7fa730153770 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- 172.21.15.67:0/1592227158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730153770 msgr2=0x7fa73015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 --2- 172.21.15.67:0/1592227158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730153770 0x7fa73015a0e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7301571a0 tx=0x7fa72001ecb0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- 172.21.15.67:0/1592227158 shutdown_connections 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 --2- 172.21.15.67:0/1592227158 >> v2:172.21.15.137:3300/0 conn(0x7fa730070d40 0x7fa730071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 --2- 172.21.15.67:0/1592227158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730153770 0x7fa73015a0e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- 172.21.15.67:0/1592227158 >> 172.21.15.67:0/1592227158 conn(0x7fa73006aae0 msgr2=0x7fa73006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- 172.21.15.67:0/1592227158 shutdown_connections 2024-01-17T23:00:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- 172.21.15.67:0/1592227158 wait complete. 2024-01-17T23:00:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 Processor -- start 2024-01-17T23:00:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.956+0000 7fa738400640 1 -- start start 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa730153770 0x7fa730155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa730153b50 0x7fa73014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73014ac10 con 0x7fa730070d40 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730154b90 con 0x7fa730153770 2024-01-17T23:00:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa738400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa730154e70 con 0x7fa730153b50 2024-01-17T23:00:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa735a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa735a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46598/0 (socket says 172.21.15.67:46598) 2024-01-17T23:00:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa735a00640 1 -- 172.21.15.67:0/3090303754 learned_addr learned my addr 172.21.15.67:0/3090303754 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.960+0000 7fa735000640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa730153770 0x7fa730155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.964+0000 7fa735a00640 1 -- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa730153b50 msgr2=0x7fa73014ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.964+0000 7fa735a00640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa730153b50 0x7fa73014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.964+0000 7fa735a00640 1 -- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa730153770 msgr2=0x7fa730155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.964+0000 7fa735a00640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa730153770 0x7fa730155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:13.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.964+0000 7fa735a00640 1 -- 172.21.15.67:0/3090303754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7200094d0 con 0x7fa730070d40 2024-01-17T23:00:13.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.968+0000 7fa735a00640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7200b3040 tx=0x7fa72001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:13.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200b0e80 con 0x7fa730070d40 2024-01-17T23:00:13.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200bb480 con 0x7fa730070d40 2024-01-17T23:00:13.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200bb810 con 0x7fa730070d40 2024-01-17T23:00:13.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa730155150 con 0x7fa730070d40 2024-01-17T23:00:13.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7301f0ad0 con 0x7fa730070d40 2024-01-17T23:00:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.972+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7300746a0 con 0x7fa730070d40 2024-01-17T23:00:13.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.992+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa7200bb970 con 0x7fa730070d40 2024-01-17T23:00:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.992+0000 7fa72d600640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 0x7fa708068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:13.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.992+0000 7fa735000640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 0x7fa708068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:13.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:13.996+0000 7fa735000640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 0x7fa708068d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa730154170 tx=0x7fa718009060 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:14.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.244+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7200f47d0 con 0x7fa730070d40 2024-01-17T23:00:14.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.244+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa7200f0410 con 0x7fa730070d40 2024-01-17T23:00:14.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.408+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7300746a0 con 0x7fa730070d40 2024-01-17T23:00:14.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.416+0000 7fa72d600640 1 -- 172.21.15.67:0/3090303754 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa7200b5030 con 0x7fa730070d40 2024-01-17T23:00:14.422 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:14.422 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-01-17T23:00:14.423 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-01-17T23:00:14.423 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-01-17T23:00:14.423 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-01-17T23:00:14.423 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-01-17T23:00:14.423 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 msgr2=0x7fa708068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 0x7fa708068d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa730154170 tx=0x7fa718009060 comp rx=0 tx=0).stop 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 msgr2=0x7fa730154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7200b3040 tx=0x7fa72001ba50 comp rx=0 tx=0).stop 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 shutdown_connections 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa708066890 0x7fa708068d50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa730153b50 0x7fa73014ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa730153770 0x7fa730155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 --2- 172.21.15.67:0/3090303754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa730070d40 0x7fa730154550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 >> 172.21.15.67:0/3090303754 conn(0x7fa73006aae0 msgr2=0x7fa7300ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:14.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 shutdown_connections 2024-01-17T23:00:14.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.420+0000 7fa738400640 1 -- 172.21.15.67:0/3090303754 wait complete. 2024-01-17T23:00:14.444 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-17T23:00:14.445 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-17T23:00:14.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 Processor -- start 2024-01-17T23:00:14.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 -- start start 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faba01518e0 0x7faba00c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 0x7faba006e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba01578c0 con 0x7faba00c66d0 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba006e610 con 0x7faba01518e0 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.584+0000 7faba7a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00c7770 con 0x7faba006dc40 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.588+0000 7fab9fe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faba00c66d0 0x7faba00cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38414/0 (socket says 172.21.15.67:38414) 2024-01-17T23:00:14.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.588+0000 7fab9fe00640 1 -- 172.21.15.67:0/2493327758 learned_addr learned my addr 172.21.15.67:0/2493327758 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:14.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.588+0000 7faba5000640 1 --2- 172.21.15.67:0/2493327758 >> v2:172.21.15.137:3300/0 conn(0x7faba01518e0 0x7faba00c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.588+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728716293 0 0) 0x7faba01578c0 con 0x7faba00c66d0 2024-01-17T23:00:14.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.588+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab80003530 con 0x7faba00c66d0 2024-01-17T23:00:14.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228055033 0 0) 0x7fab80003530 con 0x7faba00c66d0 2024-01-17T23:00:14.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 msgr2=0x7faba006e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 0x7faba006e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 >> v2:172.21.15.137:3300/0 conn(0x7faba01518e0 msgr2=0x7faba00c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 --2- 172.21.15.67:0/2493327758 >> v2:172.21.15.137:3300/0 conn(0x7faba01518e0 0x7faba00c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0157b80 con 0x7faba00c66d0 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fab88001680 con 0x7faba00c66d0 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 >> v1:172.21.15.67:6789/0 conn(0x7faba00c66d0 legacy=0x7faba00cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 0x7fab80003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7fab800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab80004d10 0x7fab80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba006e610 con 0x7fab80003f50 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00c7770 con 0x7fab80004d10 2024-01-17T23:00:14.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.592+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8000bbb0 con 0x7faba006dc40 2024-01-17T23:00:14.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.596+0000 7fab9fe00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7fab800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7faba5a00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab80004d10 0x7fab80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7fab9fe00640 1 -- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 msgr2=0x7fab80003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7fab9fe00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba006dc40 0x7fab80003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7fab9fe00640 1 -- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab80004d10 msgr2=0x7fab80005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7fab9fe00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab80004d10 0x7fab80005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.600+0000 7fab9fe00640 1 -- 172.21.15.67:0/2493327758 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80003530 con 0x7fab80003f50 2024-01-17T23:00:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.604+0000 7fab9fe00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7fab800047d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab8801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ee5fdb51f873e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:14.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab880058e0 con 0x7fab80003f50 2024-01-17T23:00:14.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88005a60 con 0x7fab80003f50 2024-01-17T23:00:14.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7fab9f400640 1 -- 172.21.15.67:0/2493327758 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88005e50 con 0x7fab80003f50 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 -- 172.21.15.67:0/2493327758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 msgr2=0x7fab800047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 --2- 172.21.15.67:0/2493327758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7fab800047d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c0e0 tx=0x7fab8801cb60 comp rx=0 tx=0).stop 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba5a00640 1 -- 172.21.15.67:0/2493327758 reap_dead start 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 -- 172.21.15.67:0/2493327758 shutdown_connections 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 -- 172.21.15.67:0/2493327758 >> 172.21.15.67:0/2493327758 conn(0x7faba006aae0 msgr2=0x7faba006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 -- 172.21.15.67:0/2493327758 shutdown_connections 2024-01-17T23:00:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 -- 172.21.15.67:0/2493327758 wait complete. 2024-01-17T23:00:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.608+0000 7faba7a00640 1 Processor -- start 2024-01-17T23:00:14.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 -- start start 2024-01-17T23:00:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba00c33e0 0x7faba014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba01f3090 0x7faba01ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01f2c70 con 0x7fab80003f50 2024-01-17T23:00:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01f28d0 con 0x7faba00c33e0 2024-01-17T23:00:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba7a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00c0f90 con 0x7faba01f3090 2024-01-17T23:00:14.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba5000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba5000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46608/0 (socket says 172.21.15.67:46608) 2024-01-17T23:00:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7faba5000640 1 -- 172.21.15.67:0/3505063932 learned_addr learned my addr 172.21.15.67:0/3505063932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:14.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.612+0000 7fab9fe00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba00c33e0 0x7faba014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.616+0000 7faba5000640 1 -- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba01f3090 msgr2=0x7faba01ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.616+0000 7faba5000640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba01f3090 0x7faba01ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.616+0000 7faba5000640 1 -- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba00c33e0 msgr2=0x7faba014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.616+0000 7faba5000640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba00c33e0 0x7faba014ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.616+0000 7faba5000640 1 -- 172.21.15.67:0/3505063932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00c1270 con 0x7fab80003f50 2024-01-17T23:00:14.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.620+0000 7faba5000640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab9000e840 tx=0x7fab9000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90009620 con 0x7fab80003f50 2024-01-17T23:00:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9000c940 con 0x7fab80003f50 2024-01-17T23:00:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000ccf0 con 0x7fab80003f50 2024-01-17T23:00:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00c1550 con 0x7fab80003f50 2024-01-17T23:00:14.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba00c1830 con 0x7fab80003f50 2024-01-17T23:00:14.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.624+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0157680 con 0x7fab80003f50 2024-01-17T23:00:14.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.644+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fab90013470 con 0x7fab80003f50 2024-01-17T23:00:14.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.644+0000 7fab9cc00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 0x7fab78068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.644+0000 7fab9fe00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 0x7fab78068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.644+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab90055880 con 0x7fab80003f50 2024-01-17T23:00:14.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.644+0000 7fab9fe00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 0x7fab78068d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab880aa000 tx=0x7fab880019b0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:14.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:14.896+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fab90055650 con 0x7fab80003f50 2024-01-17T23:00:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:15.064+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faba0157680 con 0x7fab80003f50 2024-01-17T23:00:16.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.240+0000 7fab9cc00640 1 -- 172.21.15.67:0/3505063932 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7faba0157680 con 0x7fab80003f50 2024-01-17T23:00:16.248 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 msgr2=0x7fab78068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 0x7fab78068d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fab880aa000 tx=0x7fab880019b0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 msgr2=0x7faba00c2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab9000e840 tx=0x7fab9000ed00 comp rx=0 tx=0).stop 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 shutdown_connections 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fab78066890 0x7fab78068d50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7faba01f3090 0x7faba01ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faba00c33e0 0x7faba014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 --2- 172.21.15.67:0/3505063932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab80003f50 0x7faba00c2e70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 >> 172.21.15.67:0/3505063932 conn(0x7faba006aae0 msgr2=0x7faba00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 shutdown_connections 2024-01-17T23:00:16.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.244+0000 7faba7a00640 1 -- 172.21.15.67:0/3505063932 wait complete. 2024-01-17T23:00:16.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-17T23:00:16.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 Processor -- start 2024-01-17T23:00:16.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 -- start start 2024-01-17T23:00:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c8710 0x7fc0c80c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c80c38c0 0x7fc0c80cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c80c7df0 con 0x7fc0c80cd570 2024-01-17T23:00:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c80c2640 con 0x7fc0c80c38c0 2024-01-17T23:00:16.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cf400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80c9030 con 0x7fc0c80c8710 2024-01-17T23:00:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0c7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c80c38c0 0x7fc0c80cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0c7e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc0c80c38c0 0x7fc0c80cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46620/0 (socket says 172.21.15.67:46620) 2024-01-17T23:00:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0c7e00640 1 -- 172.21.15.67:0/3066111600 learned_addr learned my addr 172.21.15.67:0/3066111600 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:16.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.428+0000 7fc0cca00640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c8710 0x7fc0c80c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.432+0000 7fc0c7e00640 1 -- 172.21.15.67:0/3066111600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c8710 msgr2=0x7fc0c80c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:16.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.432+0000 7fc0c7e00640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c8710 0x7fc0c80c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.432+0000 7fc0c7e00640 1 -- 172.21.15.67:0/3066111600 >> v1:172.21.15.137:6789/0 conn(0x7fc0c80cd570 legacy=0x7fc0c80c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.432+0000 7fc0c7e00640 1 -- 172.21.15.67:0/3066111600 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8153d60 con 0x7fc0c80c38c0 2024-01-17T23:00:16.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.436+0000 7fc0c7e00640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c38c0 0x7fc0c80cd030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009870 tx=0x7fc0b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ecd0513d43c84 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0c7400640 1 -- 172.21.15.67:0/3066111600 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00aa670 con 0x7fc0c80c38c0 2024-01-17T23:00:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0c7400640 1 -- 172.21.15.67:0/3066111600 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b00aa7d0 con 0x7fc0c80c38c0 2024-01-17T23:00:16.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0c7400640 1 -- 172.21.15.67:0/3066111600 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00aab60 con 0x7fc0c80c38c0 2024-01-17T23:00:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 -- 172.21.15.67:0/3066111600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c38c0 msgr2=0x7fc0c80cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c38c0 0x7fc0c80cd030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009870 tx=0x7fc0b001c510 comp rx=0 tx=0).stop 2024-01-17T23:00:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 -- 172.21.15.67:0/3066111600 shutdown_connections 2024-01-17T23:00:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c38c0 0x7fc0c80cd030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 --2- 172.21.15.67:0/3066111600 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c8710 0x7fc0c80c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 -- 172.21.15.67:0/3066111600 >> 172.21.15.67:0/3066111600 conn(0x7fc0c8061100 msgr2=0x7fc0c8061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 -- 172.21.15.67:0/3066111600 shutdown_connections 2024-01-17T23:00:16.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.440+0000 7fc0cf400640 1 -- 172.21.15.67:0/3066111600 wait complete. 2024-01-17T23:00:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 Processor -- start 2024-01-17T23:00:16.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 -- start start 2024-01-17T23:00:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c38c0 0x7fc0c81f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80cd570 0x7fc0c8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80acf60 con 0x7fc0c80c8710 2024-01-17T23:00:16.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c815c3c0 con 0x7fc0c80cd570 2024-01-17T23:00:16.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cf400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c815b840 con 0x7fc0c80c38c0 2024-01-17T23:00:16.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0c7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0c7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46630/0 (socket says 172.21.15.67:46630) 2024-01-17T23:00:16.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0c7e00640 1 -- 172.21.15.67:0/149999612 learned_addr learned my addr 172.21.15.67:0/149999612 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cd400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80cd570 0x7fc0c8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.444+0000 7fc0cca00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c38c0 0x7fc0c81f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.448+0000 7fc0c7e00640 1 -- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c38c0 msgr2=0x7fc0c81f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.448+0000 7fc0c7e00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c38c0 0x7fc0c81f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.448+0000 7fc0c7e00640 1 -- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80cd570 msgr2=0x7fc0c8154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:16.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.448+0000 7fc0c7e00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80cd570 0x7fc0c8154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:16.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.448+0000 7fc0c7e00640 1 -- 172.21.15.67:0/149999612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094d0 con 0x7fc0c80c8710 2024-01-17T23:00:16.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.452+0000 7fc0c7e00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ac040 tx=0x7fc0b001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:16.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00bd5f0 con 0x7fc0c80c8710 2024-01-17T23:00:16.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b00bd770 con 0x7fc0c80c8710 2024-01-17T23:00:16.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00bdb20 con 0x7fc0c80c8710 2024-01-17T23:00:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c815bb20 con 0x7fc0c80c8710 2024-01-17T23:00:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c815c0e0 con 0x7fc0c80c8710 2024-01-17T23:00:16.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.456+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c80746a0 con 0x7fc0c80c8710 2024-01-17T23:00:16.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.476+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc0b00b3600 con 0x7fc0c80c8710 2024-01-17T23:00:16.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.476+0000 7fc0c4c00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 0x7fc0a0068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:16.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.476+0000 7fc0cca00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 0x7fc0a0068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:16.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.476+0000 7fc0cca00640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 0x7fc0a0068d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007a60 tx=0x7fc0b8008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:16.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.476+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc0b00f0810 con 0x7fc0c80c8710 2024-01-17T23:00:16.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.720+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc0b00ecb50 con 0x7fc0c80c8710 2024-01-17T23:00:16.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:16.880+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc0c8163d10 con 0x7fc0c80c8710 2024-01-17T23:00:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0c4c00640 1 -- 172.21.15.67:0/149999612 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc0b00f0170 con 0x7fc0c80c8710 2024-01-17T23:00:17.261 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 msgr2=0x7fc0a0068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 0x7fc0a0068d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007a60 tx=0x7fc0b8008040 comp rx=0 tx=0).stop 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 msgr2=0x7fc0c81546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ac040 tx=0x7fc0b001ad50 comp rx=0 tx=0).stop 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.256+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 shutdown_connections 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc0a00668c0 0x7fc0a0068d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0c80cd570 0x7fc0c8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0c80c8710 0x7fc0c81546c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 --2- 172.21.15.67:0/149999612 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc0c80c38c0 0x7fc0c81f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 >> 172.21.15.67:0/149999612 conn(0x7fc0c8061100 msgr2=0x7fc0c8157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:17.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 shutdown_connections 2024-01-17T23:00:17.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.260+0000 7fc0cf400640 1 -- 172.21.15.67:0/149999612 wait complete. 2024-01-17T23:00:17.285 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-17T23:00:17.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.436+0000 7fca58600640 1 Processor -- start 2024-01-17T23:00:17.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.436+0000 7fca58600640 1 -- start start 2024-01-17T23:00:17.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca58600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca5014ddb0 0x7fca50157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca58600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca5006aa40 0x7fca500c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca58600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5006bc10 con 0x7fca5014e190 2024-01-17T23:00:17.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca58600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca50158470 con 0x7fca5014ddb0 2024-01-17T23:00:17.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca58600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5006bef0 con 0x7fca5006aa40 2024-01-17T23:00:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca55200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fca5014e190 0x7fca500c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:38422/0 (socket says 172.21.15.67:38422) 2024-01-17T23:00:17.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.440+0000 7fca55200640 1 -- 172.21.15.67:0/2426797143 learned_addr learned my addr 172.21.15.67:0/2426797143 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:17.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.444+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043006433 0 0) 0x7fca5006bc10 con 0x7fca5014e190 2024-01-17T23:00:17.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.444+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca30003530 con 0x7fca5014e190 2024-01-17T23:00:17.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414476728 0 0) 0x7fca30003530 con 0x7fca5014e190 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca5006aa40 msgr2=0x7fca500c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca5006aa40 0x7fca500c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 >> v2:172.21.15.137:3300/0 conn(0x7fca5014ddb0 msgr2=0x7fca50157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 --2- 172.21.15.67:0/2426797143 >> v2:172.21.15.137:3300/0 conn(0x7fca5014ddb0 0x7fca50157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500c5f40 con 0x7fca5014e190 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fca38001680 con 0x7fca5014e190 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 >> v1:172.21.15.67:6789/0 conn(0x7fca5014e190 legacy=0x7fca500c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca30003980 0x7fca30003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca300047d0 0x7fca30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca30014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50158470 con 0x7fca30005190 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5006bef0 con 0x7fca300047d0 2024-01-17T23:00:17.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.448+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca30009c10 con 0x7fca30003980 2024-01-17T23:00:17.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.452+0000 7fca56600640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca30014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.456+0000 7fca56600640 1 -- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca30003980 msgr2=0x7fca30003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.456+0000 7fca56600640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca30003980 0x7fca30003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.456+0000 7fca56600640 1 -- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca300047d0 msgr2=0x7fca30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.456+0000 7fca56600640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca300047d0 0x7fca30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.456+0000 7fca56600640 1 -- 172.21.15.67:0/2426797143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500c5f40 con 0x7fca30005190 2024-01-17T23:00:17.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.460+0000 7fca56600640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca30014590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca50151b40 tx=0x7fca4801ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee17694ecdaba432 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:17.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.460+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca480a5d00 con 0x7fca30005190 2024-01-17T23:00:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca480a5e80 con 0x7fca30005190 2024-01-17T23:00:17.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca4fe00640 1 -- 172.21.15.67:0/2426797143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca480ad680 con 0x7fca30005190 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 -- 172.21.15.67:0/2426797143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 msgr2=0x7fca30014590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 --2- 172.21.15.67:0/2426797143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca30014590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca50151b40 tx=0x7fca4801ccf0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca56600640 1 -- 172.21.15.67:0/2426797143 reap_dead start 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 -- 172.21.15.67:0/2426797143 shutdown_connections 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 -- 172.21.15.67:0/2426797143 >> 172.21.15.67:0/2426797143 conn(0x7fca500cb4a0 msgr2=0x7fca500cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 -- 172.21.15.67:0/2426797143 shutdown_connections 2024-01-17T23:00:17.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.464+0000 7fca58600640 1 -- 172.21.15.67:0/2426797143 wait complete. 2024-01-17T23:00:17.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 Processor -- start 2024-01-17T23:00:17.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 -- start start 2024-01-17T23:00:17.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca50149330 0x7fca50144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca500ca550 0x7fca501eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501437b0 con 0x7fca30005190 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5014a1d0 con 0x7fca50149330 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca58600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5014a4b0 con 0x7fca500ca550 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca55c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca55c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46648/0 (socket says 172.21.15.67:46648) 2024-01-17T23:00:17.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.468+0000 7fca55c00640 1 -- 172.21.15.67:0/3923114570 learned_addr learned my addr 172.21.15.67:0/3923114570 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:17.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.472+0000 7fca55c00640 1 -- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca500ca550 msgr2=0x7fca501eaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.472+0000 7fca55c00640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca500ca550 0x7fca501eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.472+0000 7fca55c00640 1 -- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca50149330 msgr2=0x7fca50144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:17.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.472+0000 7fca55c00640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca50149330 0x7fca50144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:17.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.472+0000 7fca55c00640 1 -- 172.21.15.67:0/3923114570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50143160 con 0x7fca30005190 2024-01-17T23:00:17.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.476+0000 7fca55c00640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca4000b430 tx=0x7fca4000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40011830 con 0x7fca30005190 2024-01-17T23:00:17.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca400119b0 con 0x7fca30005190 2024-01-17T23:00:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40011d60 con 0x7fca30005190 2024-01-17T23:00:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50143440 con 0x7fca30005190 2024-01-17T23:00:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca500ca9d0 con 0x7fca30005190 2024-01-17T23:00:17.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.480+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca500cac50 con 0x7fca30005190 2024-01-17T23:00:17.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.504+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fca4001a400 con 0x7fca30005190 2024-01-17T23:00:17.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.504+0000 7fca4d600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 0x7fca28068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:17.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.504+0000 7fca55200640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 0x7fca28068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:17.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.508+0000 7fca55200640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 0x7fca28068d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca501499c0 tx=0x7fca380016b0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:17.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.508+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fca40055e70 con 0x7fca30005190 2024-01-17T23:00:17.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.764+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fca40051ab0 con 0x7fca30005190 2024-01-17T23:00:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:17.968+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca50142fc0 con 0x7fca30005190 2024-01-17T23:00:19.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca4d600640 1 -- 172.21.15.67:0/3923114570 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca50142fc0 con 0x7fca30005190 2024-01-17T23:00:19.061 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 msgr2=0x7fca28068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 0x7fca28068d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca501499c0 tx=0x7fca380016b0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 msgr2=0x7fca50149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca4000b430 tx=0x7fca4000b8f0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 shutdown_connections 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fca28066890 0x7fca28068d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fca500ca550 0x7fca501eaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca50149330 0x7fca50144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 --2- 172.21.15.67:0/3923114570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca30005190 0x7fca50149b20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 >> 172.21.15.67:0/3923114570 conn(0x7fca500cb4a0 msgr2=0x7fca501409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 shutdown_connections 2024-01-17T23:00:19.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.056+0000 7fca58600640 1 -- 172.21.15.67:0/3923114570 wait complete. 2024-01-17T23:00:19.084 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-17T23:00:19.084 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-17T23:00:19.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 Processor -- start 2024-01-17T23:00:19.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 -- start start 2024-01-17T23:00:19.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f535c0cb390 0x7f535c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c1578c0 con 0x7f535c1518e0 2024-01-17T23:00:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0c7770 con 0x7f535c06dc40 2024-01-17T23:00:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f5361e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c157b80 con 0x7f535c0cb390 2024-01-17T23:00:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f535b400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f535c06dc40 0x7f535c161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:55842/0 (socket says 172.21.15.67:55842) 2024-01-17T23:00:19.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.228+0000 7f535b400640 1 -- 172.21.15.67:0/3710346353 learned_addr learned my addr 172.21.15.67:0/3710346353 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:19.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.232+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559871648 0 0) 0x7f535c0c7770 con 0x7f535c06dc40 2024-01-17T23:00:19.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.232+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f533c003530 con 0x7f535c06dc40 2024-01-17T23:00:19.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f535a000640 1 --2- 172.21.15.67:0/3710346353 >> v2:172.21.15.67:3300/0 conn(0x7f535c0cb390 0x7f535c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978217427 0 0) 0x7f533c003530 con 0x7f535c06dc40 2024-01-17T23:00:19.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 >> v2:172.21.15.67:3300/0 conn(0x7f535c0cb390 msgr2=0x7f535c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:19.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 --2- 172.21.15.67:0/3710346353 >> v2:172.21.15.67:3300/0 conn(0x7f535c0cb390 0x7f535c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 >> v1:172.21.15.67:6789/0 conn(0x7f535c1518e0 legacy=0x7f535c0c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c157e60 con 0x7f535c06dc40 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f5354001a00 con 0x7f535c06dc40 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 >> v1:172.21.15.137:6789/0 conn(0x7f535c06dc40 legacy=0x7f535c161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f533c0039d0 0x7f533c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 0x7f533c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0051e0 0x7f533c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c157b80 con 0x7f533c0039d0 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c00c0f0 con 0x7f533c0051e0 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.236+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c00c2b0 con 0x7f533c0047d0 2024-01-17T23:00:19.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.240+0000 7f535a000640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 0x7f533c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535aa00640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f533c0039d0 0x7f533c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535a000640 1 -- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0051e0 msgr2=0x7f533c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:19.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535a000640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0051e0 0x7f533c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535a000640 1 -- 172.21.15.67:0/3710346353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f533c0039d0 msgr2=0x7f533c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:19.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535a000640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f533c0039d0 0x7f533c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535a000640 1 -- 172.21.15.67:0/3710346353 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c003530 con 0x7f533c0047d0 2024-01-17T23:00:19.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.244+0000 7f535b400640 1 -- 172.21.15.67:0/3710346353 reap_dead start 2024-01-17T23:00:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.248+0000 7f535a000640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 0x7f533c004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f534400ba30 tx=0x7f534401c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c0b2e03d3ffe0a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:19.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440a9660 con 0x7f533c0047d0 2024-01-17T23:00:19.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440a97c0 con 0x7f533c0047d0 2024-01-17T23:00:19.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5359600640 1 -- 172.21.15.67:0/3710346353 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440a9b70 con 0x7f533c0047d0 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 -- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 msgr2=0x7f533c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 0x7f533c004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f534400ba30 tx=0x7f534401c680 comp rx=0 tx=0).stop 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 -- 172.21.15.67:0/3710346353 shutdown_connections 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 --2- 172.21.15.67:0/3710346353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f533c0047d0 0x7f533c004c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 -- 172.21.15.67:0/3710346353 >> 172.21.15.67:0/3710346353 conn(0x7f535c06aae0 msgr2=0x7f535c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 -- 172.21.15.67:0/3710346353 shutdown_connections 2024-01-17T23:00:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.252+0000 7f5361e00640 1 -- 172.21.15.67:0/3710346353 wait complete. 2024-01-17T23:00:19.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 Processor -- start 2024-01-17T23:00:19.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 -- start start 2024-01-17T23:00:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0047d0 0x7f535c1ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c147890 0x7f535c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c148250 con 0x7f535c147890 2024-01-17T23:00:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0c29e0 con 0x7f533c0047d0 2024-01-17T23:00:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f5361e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c149b40 con 0x7f535c0c4020 2024-01-17T23:00:19.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f535a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f535b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c147890 0x7f535c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f535aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0047d0 0x7f535c1ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f535a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:41672/0 (socket says 172.21.15.67:41672) 2024-01-17T23:00:19.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.256+0000 7f535a000640 1 -- 172.21.15.67:0/3202564282 learned_addr learned my addr 172.21.15.67:0/3202564282 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.260+0000 7f535a000640 1 -- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0047d0 msgr2=0x7f535c1ecd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.260+0000 7f535a000640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0047d0 0x7f535c1ecd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.260+0000 7f535a000640 1 -- 172.21.15.67:0/3202564282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c147890 msgr2=0x7f535c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.260+0000 7f535a000640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c147890 0x7f535c147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.260+0000 7f535a000640 1 -- 172.21.15.67:0/3202564282 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0c2ca0 con 0x7f535c0c4020 2024-01-17T23:00:19.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.264+0000 7f535a000640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f534401c4b0 tx=0x7f533c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.264+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440b3650 con 0x7f535c0c4020 2024-01-17T23:00:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.264+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0c2f80 con 0x7f535c0c4020 2024-01-17T23:00:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.264+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c0c3540 con 0x7f535c0c4020 2024-01-17T23:00:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.268+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c067c90 con 0x7f535c0c4020 2024-01-17T23:00:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.268+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53440b37b0 con 0x7f535c0c4020 2024-01-17T23:00:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.268+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440b3b20 con 0x7f535c0c4020 2024-01-17T23:00:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.552+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f53440b3c80 con 0x7f535c0c4020 2024-01-17T23:00:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.552+0000 7f5353400640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.552+0000 7f535aa00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:19.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.552+0000 7f535aa00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 0x7f5334068d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f534c007fd0 tx=0x7f534c007cd0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:19.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.556+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53440f0320 con 0x7f535c0c4020 2024-01-17T23:00:19.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.588+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f53440ec660 con 0x7f535c0c4020 2024-01-17T23:00:19.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:19.756+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f535c0746a0 con 0x7f535c0c4020 2024-01-17T23:00:20.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.884+0000 7f5353400640 1 -- 172.21.15.67:0/3202564282 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f53440ae0e0 con 0x7f535c0c4020 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 msgr2=0x7f5334068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 0x7f5334068d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f534c007fd0 tx=0x7f534c007cd0 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 msgr2=0x7f535c149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f534401c4b0 tx=0x7f533c005800 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 shutdown_connections 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5334066840 0x7f5334068d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f535c147890 0x7f535c147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f535c0c4020 0x7f535c149600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 --2- 172.21.15.67:0/3202564282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0047d0 0x7f535c1ecd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 >> 172.21.15.67:0/3202564282 conn(0x7f535c06aae0 msgr2=0x7f535c0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 shutdown_connections 2024-01-17T23:00:20.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:20.888+0000 7f5361e00640 1 -- 172.21.15.67:0/3202564282 wait complete. 2024-01-17T23:00:20.913 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-17T23:00:21.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 Processor -- start 2024-01-17T23:00:21.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 -- start start 2024-01-17T23:00:21.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0ca850 con 0x7f2a3c0ca310 2024-01-17T23:00:21.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c15a630 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.060+0000 7f2a43400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c15cc60 con 0x7f2a3c06f790 2024-01-17T23:00:21.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.064+0000 7f2a40a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:21.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.068+0000 7f2a40a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43784/0 (socket says 172.21.15.67:43784) 2024-01-17T23:00:21.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.068+0000 7f2a40a00640 1 -- 172.21.15.67:0/2237110229 learned_addr learned my addr 172.21.15.67:0/2237110229 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:21.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.072+0000 7f2a40a00640 1 -- 172.21.15.67:0/2237110229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 msgr2=0x7f2a3c0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:21.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.072+0000 7f2a40a00640 1 --2- 172.21.15.67:0/2237110229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.072+0000 7f2a40a00640 1 -- 172.21.15.67:0/2237110229 >> v1:172.21.15.67:6789/0 conn(0x7f2a3c0ca310 legacy=0x7f2a3c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:21.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.072+0000 7f2a40a00640 1 -- 172.21.15.67:0/2237110229 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c15cf00 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.120+0000 7f2a40a00640 1 --2- 172.21.15.67:0/2237110229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9de4426f757896 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a3b400640 1 -- 172.21.15.67:0/2237110229 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0aa5f0 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a3b400640 1 -- 172.21.15.67:0/2237110229 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0aa750 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a3b400640 1 -- 172.21.15.67:0/2237110229 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0aaae0 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 -- 172.21.15.67:0/2237110229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c06f3b0 msgr2=0x7f2a3c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 --2- 172.21.15.67:0/2237110229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c01c4d0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 -- 172.21.15.67:0/2237110229 shutdown_connections 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 --2- 172.21.15.67:0/2237110229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c0c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 --2- 172.21.15.67:0/2237110229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c15a0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.124+0000 7f2a43400640 1 -- 172.21.15.67:0/2237110229 >> 172.21.15.67:0/2237110229 conn(0x7f2a3c06a8b0 msgr2=0x7f2a3c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- 172.21.15.67:0/2237110229 shutdown_connections 2024-01-17T23:00:21.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- 172.21.15.67:0/2237110229 wait complete. 2024-01-17T23:00:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 Processor -- start 2024-01-17T23:00:21.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- start start 2024-01-17T23:00:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1f3960 con 0x7f2a3c0ca310 2024-01-17T23:00:21.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c14ff10 con 0x7f2a3c06f3b0 2024-01-17T23:00:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a43400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c14cc50 con 0x7f2a3c06f790 2024-01-17T23:00:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a41400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a41400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43800/0 (socket says 172.21.15.67:43800) 2024-01-17T23:00:21.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.128+0000 7f2a41400640 1 -- 172.21.15.67:0/2271374178 learned_addr learned my addr 172.21.15.67:0/2271374178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.132+0000 7f2a41400640 1 -- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 msgr2=0x7f2a3c14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.132+0000 7f2a41400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.132+0000 7f2a41400640 1 -- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a3c06f3b0 msgr2=0x7f2a3c14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.132+0000 7f2a41400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:21.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.132+0000 7f2a41400640 1 -- 172.21.15.67:0/2271374178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0094d0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.136+0000 7f2a41400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400b9e0 tx=0x7f2a3400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:21.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34003b80 con 0x7f2a3c0ca310 2024-01-17T23:00:21.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34003ce0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400cb60 con 0x7f2a3c0ca310 2024-01-17T23:00:21.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c14cef0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c14ec90 con 0x7f2a3c0ca310 2024-01-17T23:00:21.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.140+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0746a0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.160+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2a3400ccc0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.164+0000 7f2a38c00640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 0x7f2a14068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:21.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.164+0000 7f2a40a00640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 0x7f2a14068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:21.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.164+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f2a34055cb0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.164+0000 7f2a40a00640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 0x7f2a14068d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0ae000 tx=0x7f2a2c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:21.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.412+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2a340518f0 con 0x7f2a3c0ca310 2024-01-17T23:00:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:21.572+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a3c15ab70 con 0x7f2a3c0ca310 2024-01-17T23:00:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.448+0000 7f2a38c00640 1 -- 172.21.15.67:0/2271374178 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2a34022020 con 0x7f2a3c0ca310 2024-01-17T23:00:23.455 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' created 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 msgr2=0x7f2a14068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 0x7f2a14068d50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0ae000 tx=0x7f2a2c008040 comp rx=0 tx=0).stop 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 msgr2=0x7f2a3c14de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400b9e0 tx=0x7f2a3400bea0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 shutdown_connections 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2a14066890 0x7f2a14068d50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a3c0ca310 0x7f2a3c14de70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2a3c06f790 0x7f2a3c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 --2- 172.21.15.67:0/2271374178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a3c06f3b0 0x7f2a3c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 >> 172.21.15.67:0/2271374178 conn(0x7f2a3c06a8b0 msgr2=0x7f2a3c158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:23.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 shutdown_connections 2024-01-17T23:00:23.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.452+0000 7f2a43400640 1 -- 172.21.15.67:0/2271374178 wait complete. 2024-01-17T23:00:23.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-17T23:00:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.624+0000 7f9080200640 1 Processor -- start 2024-01-17T23:00:23.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.624+0000 7f9080200640 1 -- start start 2024-01-17T23:00:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f9080200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90781518e0 0x7f90780c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f9080200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90780c66d0 0x7f90780cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f9080200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90781578c0 con 0x7f90780cb8d0 2024-01-17T23:00:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f9080200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780c7770 con 0x7f90781518e0 2024-01-17T23:00:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f9080200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078157b80 con 0x7f90780c66d0 2024-01-17T23:00:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f907ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90780c66d0 0x7f90780cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f907ce00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90780c66d0 0x7f90780cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:42654/0 (socket says 172.21.15.67:42654) 2024-01-17T23:00:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f907ce00640 1 -- 172.21.15.67:0/3909615494 learned_addr learned my addr 172.21.15.67:0/3909615494 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.628+0000 7f907d800640 1 --2- 172.21.15.67:0/3909615494 >> v2:172.21.15.67:3300/0 conn(0x7f90781518e0 0x7f90780c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.632+0000 7f907ce00640 1 -- 172.21.15.67:0/3909615494 >> v2:172.21.15.67:3300/0 conn(0x7f90781518e0 msgr2=0x7f90780c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.632+0000 7f907ce00640 1 --2- 172.21.15.67:0/3909615494 >> v2:172.21.15.67:3300/0 conn(0x7f90781518e0 0x7f90780c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.632+0000 7f907ce00640 1 -- 172.21.15.67:0/3909615494 >> v1:172.21.15.67:6789/0 conn(0x7f90780cb8d0 legacy=0x7f907806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.632+0000 7f907ce00640 1 -- 172.21.15.67:0/3909615494 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078157e60 con 0x7f90780c66d0 2024-01-17T23:00:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.636+0000 7f907ce00640 1 --2- 172.21.15.67:0/3909615494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780c66d0 0x7f90780cb390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90780cc050 tx=0x7f906001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5949dc6e9b5278f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9077e00640 1 -- 172.21.15.67:0/3909615494 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600a89f0 con 0x7f90780c66d0 2024-01-17T23:00:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9077e00640 1 -- 172.21.15.67:0/3909615494 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600a8b50 con 0x7f90780c66d0 2024-01-17T23:00:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9077e00640 1 -- 172.21.15.67:0/3909615494 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600b0440 con 0x7f90780c66d0 2024-01-17T23:00:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 -- 172.21.15.67:0/3909615494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780c66d0 msgr2=0x7f90780cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 --2- 172.21.15.67:0/3909615494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780c66d0 0x7f90780cb390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90780cc050 tx=0x7f906001ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 -- 172.21.15.67:0/3909615494 shutdown_connections 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 --2- 172.21.15.67:0/3909615494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780c66d0 0x7f90780cb390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 --2- 172.21.15.67:0/3909615494 >> v2:172.21.15.67:3300/0 conn(0x7f90781518e0 0x7f90780c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 -- 172.21.15.67:0/3909615494 >> 172.21.15.67:0/3909615494 conn(0x7f907806aae0 msgr2=0x7f907806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 -- 172.21.15.67:0/3909615494 shutdown_connections 2024-01-17T23:00:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 -- 172.21.15.67:0/3909615494 wait complete. 2024-01-17T23:00:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.644+0000 7f9080200640 1 Processor -- start 2024-01-17T23:00:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 -- start start 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90780c66d0 0x7f90780afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90781518e0 0x7f9078146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078155960 con 0x7f90781518e0 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780cae50 con 0x7f90780cb8d0 2024-01-17T23:00:23.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f9080200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907806e000 con 0x7f90780c66d0 2024-01-17T23:00:23.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f907ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:23.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f907ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:42662/0 (socket says 172.21.15.67:42662) 2024-01-17T23:00:23.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.648+0000 7f907ce00640 1 -- 172.21.15.67:0/4156025381 learned_addr learned my addr 172.21.15.67:0/4156025381 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907e200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90781518e0 0x7f9078146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:23.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907d800640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90780c66d0 0x7f90780afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907ce00640 1 -- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90780c66d0 msgr2=0x7f90780afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907ce00640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90780c66d0 0x7f90780afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907ce00640 1 -- 172.21.15.67:0/4156025381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90781518e0 msgr2=0x7f9078146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907ce00640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90781518e0 0x7f9078146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:23.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.652+0000 7f907ce00640 1 -- 172.21.15.67:0/4156025381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600094d0 con 0x7f90780cb8d0 2024-01-17T23:00:23.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.656+0000 7f907ce00640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f906001c920 tx=0x7f906001ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.660+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600b1c60 con 0x7f90780cb8d0 2024-01-17T23:00:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.660+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078145540 con 0x7f90780cb8d0 2024-01-17T23:00:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.660+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078156c30 con 0x7f90780cb8d0 2024-01-17T23:00:23.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.660+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078067c50 con 0x7f90780cb8d0 2024-01-17T23:00:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.664+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600b1dc0 con 0x7f90780cb8d0 2024-01-17T23:00:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.664+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600b9640 con 0x7f90780cb8d0 2024-01-17T23:00:23.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.992+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f90600b7070 con 0x7f90780cb8d0 2024-01-17T23:00:23.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.992+0000 7f9075600640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 0x7f9050068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:23.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.992+0000 7f907d800640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 0x7f9050068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:24.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:23.996+0000 7f907d800640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 0x7f9050068d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9068009990 tx=0x7f9068008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:24.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.000+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f90600af3a0 con 0x7f90780cb8d0 2024-01-17T23:00:24.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.032+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f90600ef400 con 0x7f90780cb8d0 2024-01-17T23:00:24.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.192+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f9078145540 con 0x7f90780cb8d0 2024-01-17T23:00:24.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9075600640 1 -- 172.21.15.67:0/4156025381 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9078145540 con 0x7f90780cb8d0 2024-01-17T23:00:24.724 INFO:teuthology.orchestra.run.smithi067.stderr:set pool 4 allow_ec_overwrites to true 2024-01-17T23:00:24.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 msgr2=0x7f9050068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 0x7f9050068d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9068009990 tx=0x7f9068008040 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 msgr2=0x7f90780ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f906001c920 tx=0x7f906001ba90 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 shutdown_connections 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9050066870 0x7f9050068d30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90781518e0 0x7f9078146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90780cb8d0 0x7f90780ca910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 --2- 172.21.15.67:0/4156025381 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90780c66d0 0x7f90780afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 >> 172.21.15.67:0/4156025381 conn(0x7f907806aae0 msgr2=0x7f90780714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 shutdown_connections 2024-01-17T23:00:24.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.720+0000 7f9080200640 1 -- 172.21.15.67:0/4156025381 wait complete. 2024-01-17T23:00:24.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-17T23:00:24.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 Processor -- start 2024-01-17T23:00:24.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 -- start start 2024-01-17T23:00:24.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 0x7f89880ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880ca950 con 0x7f8988151760 2024-01-17T23:00:24.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8988157540 con 0x7f89881579d0 2024-01-17T23:00:24.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.904+0000 7f8990400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8988151b40 con 0x7f89880c2a60 2024-01-17T23:00:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.912+0000 7f898e400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f89881579d0 0x7f8988157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:33724/0 (socket says 172.21.15.67:33724) 2024-01-17T23:00:24.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.912+0000 7f898e400640 1 -- 172.21.15.67:0/1886099425 learned_addr learned my addr 172.21.15.67:0/1886099425 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.916+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802296192 0 0) 0x7f8988157540 con 0x7f89881579d0 2024-01-17T23:00:24.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.916+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8968003530 con 0x7f89881579d0 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.1 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151206483 0 0) 0x7f8968003530 con 0x7f89881579d0 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 msgr2=0x7f89880ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 0x7f89880ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 >> v1:172.21.15.67:6789/0 conn(0x7f8988151760 legacy=0x7f8988070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880c2e80 con 0x7f89881579d0 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.1 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f8980001a00 con 0x7f89881579d0 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 >> v1:172.21.15.137:6789/0 conn(0x7f89881579d0 legacy=0x7f8988157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8968003980 0x7f8968003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 0x7f89680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968004e30 0x7f896800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988151b40 con 0x7f8968003980 2024-01-17T23:00:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680055a0 con 0x7f8968004e30 2024-01-17T23:00:24.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.924+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896800bed0 con 0x7f89880c2a60 2024-01-17T23:00:24.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.928+0000 7f898da00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8968003980 0x7f8968003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.932+0000 7f898da00640 1 -- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 msgr2=0x7f89680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.932+0000 7f898da00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f89880c2a60 0x7f89680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.932+0000 7f898da00640 1 -- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968004e30 msgr2=0x7f896800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.932+0000 7f898da00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968004e30 0x7f896800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.932+0000 7f898da00640 1 -- 172.21.15.67:0/1886099425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8968003530 con 0x7f8968003980 2024-01-17T23:00:24.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.936+0000 7f898da00640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8968003980 0x7f8968003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89780015e0 tx=0x7f897801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdfb0ee7034e85d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:24.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780052d0 con 0x7f8968003980 2024-01-17T23:00:24.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780a7050 con 0x7f8968003980 2024-01-17T23:00:24.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8987e00640 1 -- 172.21.15.67:0/1886099425 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978003840 con 0x7f8968003980 2024-01-17T23:00:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 -- 172.21.15.67:0/1886099425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8968003980 msgr2=0x7f8968003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 --2- 172.21.15.67:0/1886099425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8968003980 0x7f8968003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89780015e0 tx=0x7f897801c260 comp rx=0 tx=0).stop 2024-01-17T23:00:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f898e400640 1 -- 172.21.15.67:0/1886099425 reap_dead start 2024-01-17T23:00:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 -- 172.21.15.67:0/1886099425 shutdown_connections 2024-01-17T23:00:24.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 -- 172.21.15.67:0/1886099425 >> 172.21.15.67:0/1886099425 conn(0x7f8988070390 msgr2=0x7f898806f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 -- 172.21.15.67:0/1886099425 shutdown_connections 2024-01-17T23:00:24.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.940+0000 7f8990400640 1 -- 172.21.15.67:0/1886099425 wait complete. 2024-01-17T23:00:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 Processor -- start 2024-01-17T23:00:24.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 -- start start 2024-01-17T23:00:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968003980 0x7f898806c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f898806b7f0 0x7f898806ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898806c990 con 0x7f89880b1170 2024-01-17T23:00:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89881ef700 con 0x7f8968003980 2024-01-17T23:00:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f8990400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89881efca0 con 0x7f898806b7f0 2024-01-17T23:00:24.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f898d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f898d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43826/0 (socket says 172.21.15.67:43826) 2024-01-17T23:00:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f898d000640 1 -- 172.21.15.67:0/922891101 learned_addr learned my addr 172.21.15.67:0/922891101 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:24.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.944+0000 7f898da00640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968003980 0x7f898806c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:24.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.948+0000 7f898d000640 1 -- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f898806b7f0 msgr2=0x7f898806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.948+0000 7f898d000640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f898806b7f0 0x7f898806ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.948+0000 7f898d000640 1 -- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968003980 msgr2=0x7f898806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:24.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.948+0000 7f898d000640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968003980 0x7f898806c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:24.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.948+0000 7f898d000640 1 -- 172.21.15.67:0/922891101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89881f0670 con 0x7f89880b1170 2024-01-17T23:00:24.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.952+0000 7f898d000640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f897000b500 tx=0x7f897000b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:24.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970010610 con 0x7f89880b1170 2024-01-17T23:00:24.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970010770 con 0x7f89880b1170 2024-01-17T23:00:24.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970010b00 con 0x7f89880b1170 2024-01-17T23:00:24.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898815a100 con 0x7f89880b1170 2024-01-17T23:00:24.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898815a6c0 con 0x7f89880b1170 2024-01-17T23:00:24.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:24.956+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89881efe50 con 0x7f89880b1170 2024-01-17T23:00:25.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.212+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f8970010c60 con 0x7f89880b1170 2024-01-17T23:00:25.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.212+0000 7f8985600640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 0x7f8960068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.212+0000 7f898da00640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 0x7f8960068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.212+0000 7f898da00640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 0x7f8960068d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89780015b0 tx=0x7f89780011a0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:25.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.224+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f8970054f70 con 0x7f89880b1170 2024-01-17T23:00:25.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.224+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f8970054d40 con 0x7f89880b1170 2024-01-17T23:00:25.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.424+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f89881efe50 con 0x7f89880b1170 2024-01-17T23:00:25.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.708+0000 7f8985600640 1 -- 172.21.15.67:0/922891101 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f89881efe50 con 0x7f89880b1170 2024-01-17T23:00:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:added data pool 4 to fsmap 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.708+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 msgr2=0x7f8960068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.708+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 0x7f8960068d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89780015b0 tx=0x7f89780011a0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.708+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 msgr2=0x7f89881f0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.708+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f897000b500 tx=0x7f897000b9c0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 shutdown_connections 2024-01-17T23:00:25.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8960066890 0x7f8960068d50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f898806b7f0 0x7f898806ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89880b1170 0x7f89881f0130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 --2- 172.21.15.67:0/922891101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8968003980 0x7f898806c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 >> 172.21.15.67:0/922891101 conn(0x7f8988070390 msgr2=0x7f89880c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 shutdown_connections 2024-01-17T23:00:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.712+0000 7f8990400640 1 -- 172.21.15.67:0/922891101 wait complete. 2024-01-17T23:00:25.736 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:25.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 Processor -- start 2024-01-17T23:00:25.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 -- start start 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e781539a0 0x7f1e780ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e780c79c0 0x7f1e78061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e78061640 0x7f1e7815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7806d570 con 0x7f1e780c79c0 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780c9890 con 0x7f1e78061640 2024-01-17T23:00:25.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7fa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78159bf0 con 0x7f1e781539a0 2024-01-17T23:00:25.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e77e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e780c79c0 0x7f1e78061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e77e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1e780c79c0 0x7f1e78061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43836/0 (socket says 172.21.15.67:43836) 2024-01-17T23:00:25.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e77e00640 1 -- 172.21.15.67:0/2452384543 learned_addr learned my addr 172.21.15.67:0/2452384543 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:25.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7da00640 1 --2- 172.21.15.67:0/2452384543 >> v2:172.21.15.137:3300/0 conn(0x7f1e78061640 0x7f1e7815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.876+0000 7f1e7d000640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e781539a0 0x7f1e780ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.880+0000 7f1e77e00640 1 -- 172.21.15.67:0/2452384543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e781539a0 msgr2=0x7f1e780ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.880+0000 7f1e77e00640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e781539a0 0x7f1e780ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.880+0000 7f1e77e00640 1 -- 172.21.15.67:0/2452384543 >> v2:172.21.15.137:3300/0 conn(0x7f1e78061640 msgr2=0x7f1e7815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.880+0000 7f1e77e00640 1 --2- 172.21.15.67:0/2452384543 >> v2:172.21.15.137:3300/0 conn(0x7f1e78061640 0x7f1e7815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.880+0000 7f1e77e00640 1 -- 172.21.15.67:0/2452384543 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78159eb0 con 0x7f1e780c79c0 2024-01-17T23:00:25.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.884+0000 7f1e77e00640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e780c79c0 0x7f1e78061100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e78157410 tx=0x7f1e6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5b8d53d5c9360c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e77400640 1 -- 172.21.15.67:0/2452384543 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600aa620 con 0x7f1e780c79c0 2024-01-17T23:00:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e77400640 1 -- 172.21.15.67:0/2452384543 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e600aa780 con 0x7f1e780c79c0 2024-01-17T23:00:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e77400640 1 -- 172.21.15.67:0/2452384543 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600aab10 con 0x7f1e780c79c0 2024-01-17T23:00:25.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 -- 172.21.15.67:0/2452384543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e780c79c0 msgr2=0x7f1e78061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:25.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e780c79c0 0x7f1e78061100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e78157410 tx=0x7f1e6001c500 comp rx=0 tx=0).stop 2024-01-17T23:00:25.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 -- 172.21.15.67:0/2452384543 shutdown_connections 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/2452384543 >> v2:172.21.15.137:3300/0 conn(0x7f1e78061640 0x7f1e7815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e780c79c0 0x7f1e78061100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/2452384543 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e781539a0 0x7f1e780ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 -- 172.21.15.67:0/2452384543 >> 172.21.15.67:0/2452384543 conn(0x7f1e7806ad40 msgr2=0x7f1e7806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 -- 172.21.15.67:0/2452384543 shutdown_connections 2024-01-17T23:00:25.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.888+0000 7f1e7fa00640 1 -- 172.21.15.67:0/2452384543 wait complete. 2024-01-17T23:00:25.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 Processor -- start 2024-01-17T23:00:25.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 -- start start 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e78061640 0x7f1e780b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e780c79c0 0x7f1e780b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781f63a0 con 0x7f1e781539a0 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780b0c60 con 0x7f1e78061640 2024-01-17T23:00:25.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7fa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78157280 con 0x7f1e780c79c0 2024-01-17T23:00:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7da00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43842/0 (socket says 172.21.15.67:43842) 2024-01-17T23:00:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7da00640 1 -- 172.21.15.67:0/3109504302 learned_addr learned my addr 172.21.15.67:0/3109504302 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:25.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e7d000640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e78061640 0x7f1e780b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.892+0000 7f1e77e00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e780c79c0 0x7f1e780b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.896+0000 7f1e7da00640 1 -- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e780c79c0 msgr2=0x7f1e780b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.896+0000 7f1e7da00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e780c79c0 0x7f1e780b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.896+0000 7f1e7da00640 1 -- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e78061640 msgr2=0x7f1e780b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:25.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.896+0000 7f1e7da00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e78061640 0x7f1e780b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:25.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.896+0000 7f1e7da00640 1 -- 172.21.15.67:0/3109504302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600094d0 con 0x7f1e781539a0 2024-01-17T23:00:25.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.900+0000 7f1e7da00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000eed0 tx=0x7f1e7000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70010040 con 0x7f1e781539a0 2024-01-17T23:00:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e780b1e80 con 0x7f1e781539a0 2024-01-17T23:00:25.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e780b08f0 con 0x7f1e781539a0 2024-01-17T23:00:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7001d400 con 0x7f1e781539a0 2024-01-17T23:00:25.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70009ea0 con 0x7f1e781539a0 2024-01-17T23:00:25.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:25.904+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e780b23a0 con 0x7f1e781539a0 2024-01-17T23:00:26.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.164+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1e7001d770 con 0x7f1e781539a0 2024-01-17T23:00:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.164+0000 7f1e74c00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 0x7f1e50068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.164+0000 7f1e7d000640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 0x7f1e50068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:26.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.164+0000 7f1e7d000640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 0x7f1e50068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009ac0 tx=0x7f1e68009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.176+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e70056080 con 0x7f1e781539a0 2024-01-17T23:00:26.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.176+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1e700523c0 con 0x7f1e781539a0 2024-01-17T23:00:26.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.372+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e780b0750 con 0x7f1e781539a0 2024-01-17T23:00:26.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.396+0000 7f1e74c00640 1 -- 172.21.15.67:0/3109504302 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6520 (secure 0 0 0) 0x7f1e780b0750 con 0x7f1e781539a0 2024-01-17T23:00:26.402 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:26.402 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:25.445411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-17T23:00:26.402 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 msgr2=0x7f1e50068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 0x7f1e50068d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009ac0 tx=0x7f1e68009190 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 msgr2=0x7f1e780cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000eed0 tx=0x7f1e7000b480 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 shutdown_connections 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1e50066840 0x7f1e50068d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1e781539a0 0x7f1e780cc2a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1e780c79c0 0x7f1e780b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 --2- 172.21.15.67:0/3109504302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e78061640 0x7f1e780b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 >> 172.21.15.67:0/3109504302 conn(0x7f1e7806ad40 msgr2=0x7f1e7814cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 shutdown_connections 2024-01-17T23:00:26.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.400+0000 7f1e7fa00640 1 -- 172.21.15.67:0/3109504302 wait complete. 2024-01-17T23:00:26.425 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.560+0000 7fe445a00640 1 Processor -- start 2024-01-17T23:00:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.560+0000 7fe445a00640 1 -- start start 2024-01-17T23:00:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe445a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe44006fa30 0x7fe4400c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe445a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe440159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe445a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44015a6a0 con 0x7fe44006fe10 2024-01-17T23:00:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe445a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4400c7a10 con 0x7fe44006fa30 2024-01-17T23:00:26.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe445a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe440159e00 con 0x7fe4400c9100 2024-01-17T23:00:26.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe43ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe44006fa30 0x7fe4400c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:26.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe43ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe44006fa30 0x7fe4400c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43858/0 (socket says 172.21.15.67:43858) 2024-01-17T23:00:26.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.564+0000 7fe43ea00640 1 -- 172.21.15.67:0/3014401051 learned_addr learned my addr 172.21.15.67:0/3014401051 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.568+0000 7fe43ea00640 1 -- 172.21.15.67:0/3014401051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 msgr2=0x7fe440159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.568+0000 7fe43ea00640 1 --2- 172.21.15.67:0/3014401051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe440159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.568+0000 7fe43ea00640 1 -- 172.21.15.67:0/3014401051 >> v1:172.21.15.137:6789/0 conn(0x7fe44006fe10 legacy=0x7fe4400c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:26.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.568+0000 7fe43ea00640 1 -- 172.21.15.67:0/3014401051 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44015a0e0 con 0x7fe44006fa30 2024-01-17T23:00:26.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.572+0000 7fe43ea00640 1 --2- 172.21.15.67:0/3014401051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fa30 0x7fe4400c9810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe430009870 tx=0x7fe43001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3dd3a7392f4815 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:26.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe43e000640 1 -- 172.21.15.67:0/3014401051 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300a89b0 con 0x7fe44006fa30 2024-01-17T23:00:26.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe43e000640 1 -- 172.21.15.67:0/3014401051 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300a8b10 con 0x7fe44006fa30 2024-01-17T23:00:26.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe43e000640 1 -- 172.21.15.67:0/3014401051 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300a8ea0 con 0x7fe44006fa30 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 -- 172.21.15.67:0/3014401051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fa30 msgr2=0x7fe4400c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 --2- 172.21.15.67:0/3014401051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fa30 0x7fe4400c9810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe430009870 tx=0x7fe43001ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 -- 172.21.15.67:0/3014401051 shutdown_connections 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 --2- 172.21.15.67:0/3014401051 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe440159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 --2- 172.21.15.67:0/3014401051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fa30 0x7fe4400c9810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 -- 172.21.15.67:0/3014401051 >> 172.21.15.67:0/3014401051 conn(0x7fe4400705c0 msgr2=0x7fe4400709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:26.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 -- 172.21.15.67:0/3014401051 shutdown_connections 2024-01-17T23:00:26.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.576+0000 7fe445a00640 1 -- 172.21.15.67:0/3014401051 wait complete. 2024-01-17T23:00:26.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 Processor -- start 2024-01-17T23:00:26.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 -- start start 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44006fa30 0x7fe4401591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe44015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4401f0130 con 0x7fe44006fe10 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe440154620 con 0x7fe44006fa30 2024-01-17T23:00:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe445a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4401ef2d0 con 0x7fe4400c9100 2024-01-17T23:00:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe437e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe437e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43860/0 (socket says 172.21.15.67:43860) 2024-01-17T23:00:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.580+0000 7fe437e00640 1 -- 172.21.15.67:0/2263970131 learned_addr learned my addr 172.21.15.67:0/2263970131 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.584+0000 7fe437e00640 1 -- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 msgr2=0x7fe44015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.584+0000 7fe437e00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe44015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.584+0000 7fe437e00640 1 -- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44006fa30 msgr2=0x7fe4401591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.584+0000 7fe437e00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44006fa30 0x7fe4401591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.584+0000 7fe437e00640 1 -- 172.21.15.67:0/2263970131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300094d0 con 0x7fe44006fe10 2024-01-17T23:00:26.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.588+0000 7fe437e00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b3e0 tx=0x7fe42800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.588+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428011830 con 0x7fe44006fe10 2024-01-17T23:00:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.592+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428011990 con 0x7fe44006fe10 2024-01-17T23:00:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.592+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428011d20 con 0x7fe44006fe10 2024-01-17T23:00:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.592+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4401ef5b0 con 0x7fe44006fe10 2024-01-17T23:00:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.592+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4401efb70 con 0x7fe44006fe10 2024-01-17T23:00:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.592+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4400746a0 con 0x7fe44006fe10 2024-01-17T23:00:26.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.852+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe42801a400 con 0x7fe44006fe10 2024-01-17T23:00:26.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.852+0000 7fe436a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 0x7fe418068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:26.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.852+0000 7fe43ea00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 0x7fe418068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:26.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.852+0000 7fe43ea00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 0x7fe418068d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4300b2000 tx=0x7fe430004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:26.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.876+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe428055f40 con 0x7fe44006fe10 2024-01-17T23:00:26.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:26.876+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe428051b80 con 0x7fe44006fe10 2024-01-17T23:00:27.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.052+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe44006b6b0 con 0x7fe44006fe10 2024-01-17T23:00:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.100+0000 7fe436a00640 1 -- 172.21.15.67:0/2263970131 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18335 (secure 0 0 0) 0x7fe4280551a0 con 0x7fe44006fe10 2024-01-17T23:00:27.107 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:27.107 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:25.440386+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 msgr2=0x7fe418068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 0x7fe418068d50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe4300b2000 tx=0x7fe430004740 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 msgr2=0x7fe44015ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b3e0 tx=0x7fe42800b8a0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 shutdown_connections 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe418066890 0x7fe418068d50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe4400c9100 0x7fe44015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44006fe10 0x7fe44015ac50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 --2- 172.21.15.67:0/2263970131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44006fa30 0x7fe4401591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 >> 172.21.15.67:0/2263970131 conn(0x7fe4400705c0 msgr2=0x7fe4400c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 shutdown_connections 2024-01-17T23:00:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.104+0000 7fe445a00640 1 -- 172.21.15.67:0/2263970131 wait complete. 2024-01-17T23:00:27.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.264+0000 7fa4d3600640 1 Processor -- start 2024-01-17T23:00:27.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 -- start start 2024-01-17T23:00:27.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4cc153860 0x7fa4cc06b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa4cc159ff0 0x7fa4cc0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 0x7fa4cc06f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc15a4c0 con 0x7fa4cc159ff0 2024-01-17T23:00:27.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc06a780 con 0x7fa4cc153860 2024-01-17T23:00:27.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d3600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc06aa60 con 0x7fa4cc061530 2024-01-17T23:00:27.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4cbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa4cc159ff0 0x7fa4cc0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4cbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa4cc159ff0 0x7fa4cc0c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43864/0 (socket says 172.21.15.67:43864) 2024-01-17T23:00:27.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4cbe00640 1 -- 172.21.15.67:0/2786254342 learned_addr learned my addr 172.21.15.67:0/2786254342 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:27.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d1600640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 0x7fa4cc06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.268+0000 7fa4d0c00640 1 --2- 172.21.15.67:0/2786254342 >> v2:172.21.15.137:3300/0 conn(0x7fa4cc153860 0x7fa4cc06b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4cbe00640 1 -- 172.21.15.67:0/2786254342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 msgr2=0x7fa4cc06f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 0x7fa4cc06f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4cbe00640 1 -- 172.21.15.67:0/2786254342 >> v2:172.21.15.137:3300/0 conn(0x7fa4cc153860 msgr2=0x7fa4cc06b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/2786254342 >> v2:172.21.15.137:3300/0 conn(0x7fa4cc153860 0x7fa4cc06b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4cbe00640 1 -- 172.21.15.67:0/2786254342 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc06ad40 con 0x7fa4cc159ff0 2024-01-17T23:00:27.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.272+0000 7fa4d1600640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 0x7fa4cc06f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-17T23:00:27.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.276+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc0c6730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0c8d70 tx=0x7fa4b401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2852507ac6fa9f91 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4cb400640 1 -- 172.21.15.67:0/2786254342 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40a89b0 con 0x7fa4cc159ff0 2024-01-17T23:00:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4cb400640 1 -- 172.21.15.67:0/2786254342 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40a8b10 con 0x7fa4cc159ff0 2024-01-17T23:00:27.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4cb400640 1 -- 172.21.15.67:0/2786254342 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40a8ea0 con 0x7fa4cc159ff0 2024-01-17T23:00:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- 172.21.15.67:0/2786254342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc159ff0 msgr2=0x7fa4cc0c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc0c6730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0c8d70 tx=0x7fa4b401ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- 172.21.15.67:0/2786254342 shutdown_connections 2024-01-17T23:00:27.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc061530 0x7fa4cc06f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 --2- 172.21.15.67:0/2786254342 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc0c6730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 --2- 172.21.15.67:0/2786254342 >> v2:172.21.15.137:3300/0 conn(0x7fa4cc153860 0x7fa4cc06b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- 172.21.15.67:0/2786254342 >> 172.21.15.67:0/2786254342 conn(0x7fa4cc0c8160 msgr2=0x7fa4cc0c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- 172.21.15.67:0/2786254342 shutdown_connections 2024-01-17T23:00:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- 172.21.15.67:0/2786254342 wait complete. 2024-01-17T23:00:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 Processor -- start 2024-01-17T23:00:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.280+0000 7fa4d3600640 1 -- start start 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc153860 0x7fa4cc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1f3770 con 0x7fa4cc061530 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1f2880 con 0x7fa4cc159ff0 2024-01-17T23:00:27.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d3600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc1f2af0 con 0x7fa4cc153860 2024-01-17T23:00:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d0c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d0c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43872/0 (socket says 172.21.15.67:43872) 2024-01-17T23:00:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d0c00640 1 -- 172.21.15.67:0/3778234899 learned_addr learned my addr 172.21.15.67:0/3778234899 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc153860 0x7fa4cc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.284+0000 7fa4d1600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 -- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc153860 msgr2=0x7fa4cc157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc153860 0x7fa4cc157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 -- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc159ff0 msgr2=0x7fa4cc157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 -- 172.21.15.67:0/3778234899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40094d0 con 0x7fa4cc061530 2024-01-17T23:00:27.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.288+0000 7fa4d0c00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d830 tx=0x7fa4bc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:27.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.292+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00b6c0 con 0x7fa4cc061530 2024-01-17T23:00:27.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.292+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00b820 con 0x7fa4cc061530 2024-01-17T23:00:27.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.292+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00bb90 con 0x7fa4cc061530 2024-01-17T23:00:27.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.292+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc1f2dd0 con 0x7fa4cc061530 2024-01-17T23:00:27.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.292+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc1f3390 con 0x7fa4cc061530 2024-01-17T23:00:27.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.296+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0746a0 con 0x7fa4cc061530 2024-01-17T23:00:27.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.316+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa4bc01e460 con 0x7fa4cc061530 2024-01-17T23:00:27.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.316+0000 7fa4c8c00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 0x7fa4a4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.316+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 0x7fa4a4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.316+0000 7fa4cbe00640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 0x7fa4a4068d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40b2000 tx=0x7fa4b40aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:27.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.316+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4bc0561f0 con 0x7fa4cc061530 2024-01-17T23:00:27.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.560+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa4bc052530 con 0x7fa4cc061530 2024-01-17T23:00:27.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.728+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4cc0c3c60 con 0x7fa4cc061530 2024-01-17T23:00:27.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.768+0000 7fa4c8c00640 1 -- 172.21.15.67:0/3778234899 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18335 (secure 0 0 0) 0x7fa4bc055b50 con 0x7fa4cc061530 2024-01-17T23:00:27.775 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:27.775 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:25.440386+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 msgr2=0x7fa4a4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 0x7fa4a4068d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40b2000 tx=0x7fa4b40aa070 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 msgr2=0x7fa4cc0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d830 tx=0x7fa4bc00dcf0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 shutdown_connections 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa4a4066890 0x7fa4a4068d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4cc159ff0 0x7fa4cc157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa4cc153860 0x7fa4cc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 --2- 172.21.15.67:0/3778234899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4cc061530 0x7fa4cc0ca160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 >> 172.21.15.67:0/3778234899 conn(0x7fa4cc0c8160 msgr2=0x7fa4cc0c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 shutdown_connections 2024-01-17T23:00:27.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.772+0000 7fa4d3600640 1 -- 172.21.15.67:0/3778234899 wait complete. 2024-01-17T23:00:27.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:27.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 Processor -- start 2024-01-17T23:00:27.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 -- start start 2024-01-17T23:00:27.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f67340c79c0 0x7f6734061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:27.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67340c9890 con 0x7f67341539a0 2024-01-17T23:00:27.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6734159bf0 con 0x7f6734061640 2024-01-17T23:00:27.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.948+0000 7f673b600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673406d570 con 0x7f67340c79c0 2024-01-17T23:00:27.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.952+0000 7f6739600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6734061640 0x7f673415d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:33736/0 (socket says 172.21.15.67:33736) 2024-01-17T23:00:27.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.952+0000 7f6739600640 1 -- 172.21.15.67:0/303599241 learned_addr learned my addr 172.21.15.67:0/303599241 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:27.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.992+0000 7f6733e00640 1 --2- 172.21.15.67:0/303599241 >> v2:172.21.15.67:3300/0 conn(0x7f67340c79c0 0x7f6734061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.996+0000 7f6733e00640 1 -- 172.21.15.67:0/303599241 >> v1:172.21.15.137:6789/0 conn(0x7f6734061640 legacy=0x7f673415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.996+0000 7f6733e00640 1 -- 172.21.15.67:0/303599241 >> v1:172.21.15.67:6789/0 conn(0x7f67341539a0 legacy=0x7f67340ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:27.996+0000 7f6733e00640 1 -- 172.21.15.67:0/303599241 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734159eb0 con 0x7f67340c79c0 2024-01-17T23:00:28.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.004+0000 7f6733e00640 1 --2- 172.21.15.67:0/303599241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67340c79c0 0x7f6734061100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6734159de0 tx=0x7f671c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde12f491e4e600 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f6733400640 1 -- 172.21.15.67:0/303599241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0ab5f0 con 0x7f67340c79c0 2024-01-17T23:00:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f6733400640 1 -- 172.21.15.67:0/303599241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0ab750 con 0x7f67340c79c0 2024-01-17T23:00:28.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f6733400640 1 -- 172.21.15.67:0/303599241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0abae0 con 0x7f67340c79c0 2024-01-17T23:00:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- 172.21.15.67:0/303599241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67340c79c0 msgr2=0x7f6734061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 --2- 172.21.15.67:0/303599241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67340c79c0 0x7f6734061100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6734159de0 tx=0x7f671c01c3f0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- 172.21.15.67:0/303599241 shutdown_connections 2024-01-17T23:00:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 --2- 172.21.15.67:0/303599241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67340c79c0 0x7f6734061100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- 172.21.15.67:0/303599241 >> 172.21.15.67:0/303599241 conn(0x7f673406ad40 msgr2=0x7f673406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- 172.21.15.67:0/303599241 shutdown_connections 2024-01-17T23:00:28.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- 172.21.15.67:0/303599241 wait complete. 2024-01-17T23:00:28.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 Processor -- start 2024-01-17T23:00:28.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.008+0000 7f673b600640 1 -- start start 2024-01-17T23:00:28.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67340c79c0 0x7f67340cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67341539a0 0x7f67341550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734156590 con 0x7f6734061640 2024-01-17T23:00:28.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734155df0 con 0x7f67341539a0 2024-01-17T23:00:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f673b600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6734156090 con 0x7f67340c79c0 2024-01-17T23:00:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f6738c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f6738c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43890/0 (socket says 172.21.15.67:43890) 2024-01-17T23:00:28.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.012+0000 7f6738c00640 1 -- 172.21.15.67:0/1527715482 learned_addr learned my addr 172.21.15.67:0/1527715482 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.016+0000 7f6738c00640 1 -- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67340c79c0 msgr2=0x7f67340cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.016+0000 7f6738c00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67340c79c0 0x7f67340cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.016+0000 7f6738c00640 1 -- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67341539a0 msgr2=0x7f67341550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.016+0000 7f6738c00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67341539a0 0x7f67341550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.016+0000 7f6738c00640 1 -- 172.21.15.67:0/1527715482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009420 con 0x7f6734061640 2024-01-17T23:00:28.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.020+0000 7f6738c00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f672400c370 tx=0x7f672400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240052d0 con 0x7f6734061640 2024-01-17T23:00:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724005430 con 0x7f6734061640 2024-01-17T23:00:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724007240 con 0x7f6734061640 2024-01-17T23:00:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67341599c0 con 0x7f6734061640 2024-01-17T23:00:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734154490 con 0x7f6734061640 2024-01-17T23:00:28.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.024+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673406b620 con 0x7f6734061640 2024-01-17T23:00:28.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.044+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f67240073a0 con 0x7f6734061640 2024-01-17T23:00:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.044+0000 7f6730c00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 0x7f670c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.044+0000 7f6733e00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 0x7f670c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.044+0000 7f6733e00640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 0x7f670c068d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f671c0af000 tx=0x7f671c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:28.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.292+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6724007650 con 0x7f6734061640 2024-01-17T23:00:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.292+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6724050c40 con 0x7f6734061640 2024-01-17T23:00:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.492+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67340746a0 con 0x7f6734061640 2024-01-17T23:00:28.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.504+0000 7f6730c00640 1 -- 172.21.15.67:0/1527715482 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6520 (secure 0 0 0) 0x7f6724020020 con 0x7f6734061640 2024-01-17T23:00:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:28.511 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:25.445411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-17T23:00:28.512 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 7 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 msgr2=0x7f670c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 0x7f670c068d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f671c0af000 tx=0x7f671c008040 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 msgr2=0x7f67340cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f672400c370 tx=0x7f672400c830 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 shutdown_connections 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f670c066890 0x7f670c068d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f67341539a0 0x7f67341550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f67340c79c0 0x7f67340cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 --2- 172.21.15.67:0/1527715482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6734061640 0x7f67340cb760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 >> 172.21.15.67:0/1527715482 conn(0x7f673406ad40 msgr2=0x7f67341581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 shutdown_connections 2024-01-17T23:00:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.508+0000 7f673b600640 1 -- 172.21.15.67:0/1527715482 wait complete. 2024-01-17T23:00:28.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:28.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.672+0000 7f7748800640 1 Processor -- start 2024-01-17T23:00:28.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.672+0000 7f7748800640 1 -- start start 2024-01-17T23:00:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.676+0000 7f7748800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 0x7f77400c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.676+0000 7f7748800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f77400b0ff0 0x7f7740157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.676+0000 7f7748800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7740158510 con 0x7f77400cd560 2024-01-17T23:00:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.676+0000 7f7748800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400cd370 con 0x7f77400b0ff0 2024-01-17T23:00:28.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.676+0000 7f7748800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c2260 con 0x7f77401515a0 2024-01-17T23:00:28.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.760+0000 7f7745400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f77400cd560 0x7f77400c7ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:33740/0 (socket says 172.21.15.67:33740) 2024-01-17T23:00:28.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.760+0000 7f7745400640 1 -- 172.21.15.67:0/2740435134 learned_addr learned my addr 172.21.15.67:0/2740435134 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:28.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.760+0000 7f7746800640 1 --2- 172.21.15.67:0/2740435134 >> v2:172.21.15.137:3300/0 conn(0x7f77400b0ff0 0x7f7740157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.760+0000 7f7745e00640 1 --2- 172.21.15.67:0/2740435134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 0x7f77400c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.768+0000 7f7745e00640 1 -- 172.21.15.67:0/2740435134 >> v2:172.21.15.137:3300/0 conn(0x7f77400b0ff0 msgr2=0x7f7740157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:28.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.768+0000 7f7745e00640 1 --2- 172.21.15.67:0/2740435134 >> v2:172.21.15.137:3300/0 conn(0x7f77400b0ff0 0x7f7740157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.768+0000 7f7745e00640 1 -- 172.21.15.67:0/2740435134 >> v1:172.21.15.137:6789/0 conn(0x7f77400cd560 legacy=0x7f77400c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.768+0000 7f7745e00640 1 -- 172.21.15.67:0/2740435134 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400c33a0 con 0x7f77401515a0 2024-01-17T23:00:28.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.772+0000 7f7745e00640 1 --2- 172.21.15.67:0/2740435134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 0x7f77400c3830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f773001ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700e5013b71edb52 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7744a00640 1 -- 172.21.15.67:0/2740435134 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a8970 con 0x7f77401515a0 2024-01-17T23:00:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7744a00640 1 -- 172.21.15.67:0/2740435134 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300a8ad0 con 0x7f77401515a0 2024-01-17T23:00:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7744a00640 1 -- 172.21.15.67:0/2740435134 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300a8e60 con 0x7f77401515a0 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- 172.21.15.67:0/2740435134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 msgr2=0x7f77400c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 --2- 172.21.15.67:0/2740435134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 0x7f77400c3830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f773001ec70 comp rx=0 tx=0).stop 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- 172.21.15.67:0/2740435134 shutdown_connections 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 --2- 172.21.15.67:0/2740435134 >> v2:172.21.15.137:3300/0 conn(0x7f77400b0ff0 0x7f7740157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 --2- 172.21.15.67:0/2740435134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77401515a0 0x7f77400c3830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- 172.21.15.67:0/2740435134 >> 172.21.15.67:0/2740435134 conn(0x7f7740061100 msgr2=0x7f7740061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- 172.21.15.67:0/2740435134 shutdown_connections 2024-01-17T23:00:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- 172.21.15.67:0/2740435134 wait complete. 2024-01-17T23:00:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 Processor -- start 2024-01-17T23:00:28.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.788+0000 7f7748800640 1 -- start start 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77400b0ff0 0x7f7740141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77400cd560 0x7f77401e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774006d0e0 con 0x7f77401515a0 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f2e10 con 0x7f77400cd560 2024-01-17T23:00:28.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.792+0000 7f7748800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77401418a0 con 0x7f77400b0ff0 2024-01-17T23:00:28.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.820+0000 7f7746800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.820+0000 7f7746800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43894/0 (socket says 172.21.15.67:43894) 2024-01-17T23:00:28.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.820+0000 7f7746800640 1 -- 172.21.15.67:0/2391959831 learned_addr learned my addr 172.21.15.67:0/2391959831 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 -- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77400b0ff0 msgr2=0x7f7740141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77400b0ff0 0x7f7740141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 -- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77400cd560 msgr2=0x7f77401e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:28.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77400cd560 0x7f77401e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:28.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 -- 172.21.15.67:0/2391959831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009420 con 0x7f77401515a0 2024-01-17T23:00:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.824+0000 7f7746800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f773800efc0 tx=0x7f773800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738014480 con 0x7f77401515a0 2024-01-17T23:00:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800f040 con 0x7f77401515a0 2024-01-17T23:00:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738014820 con 0x7f77401515a0 2024-01-17T23:00:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77401574c0 con 0x7f77401515a0 2024-01-17T23:00:28.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7740157780 con 0x7f77401515a0 2024-01-17T23:00:28.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.832+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7740067c90 con 0x7f77401515a0 2024-01-17T23:00:28.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.852+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7738014980 con 0x7f77401515a0 2024-01-17T23:00:28.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.852+0000 7f773e000640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 0x7f7718068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:28.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.852+0000 7f7745e00640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 0x7f7718068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:28.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:28.856+0000 7f7745e00640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 0x7f7718068d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77300b2000 tx=0x7f7730004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:29.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.104+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7738056c10 con 0x7f77401515a0 2024-01-17T23:00:29.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.104+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7738052850 con 0x7f77401515a0 2024-01-17T23:00:29.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.264+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77401f2f80 con 0x7f77401515a0 2024-01-17T23:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.304+0000 7f773e000640 1 -- 172.21.15.67:0/2391959831 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18335 (secure 0 0 0) 0x7f7738018070 con 0x7f77401515a0 2024-01-17T23:00:29.312 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:29.312 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:25.440386+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 msgr2=0x7f7718068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 0x7f7718068d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77300b2000 tx=0x7f7730004740 comp rx=0 tx=0).stop 2024-01-17T23:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 msgr2=0x7f7740070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f773800efc0 tx=0x7f773800c490 comp rx=0 tx=0).stop 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 shutdown_connections 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7718066890 0x7f7718068d50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77401515a0 0x7f7740070d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77400cd560 0x7f77401e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 --2- 172.21.15.67:0/2391959831 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77400b0ff0 0x7f7740141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 >> 172.21.15.67:0/2391959831 conn(0x7f7740061100 msgr2=0x7f77400cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 shutdown_connections 2024-01-17T23:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:29.308+0000 7f7748800640 1 -- 172.21.15.67:0/2391959831 wait complete. 2024-01-17T23:00:29.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-17T23:00:18.027327+0000', 'modified': '2024-01-17T23:00:25.445411+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.137:6839/2865340697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6837', 'nonce': 2865340697}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 2865340697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-17T23:00:29.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-17T23:00:29.941 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-17T23:00:30.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 Processor -- start 2024-01-17T23:00:30.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 -- start start 2024-01-17T23:00:30.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d406b9d0 con 0x7fc1d4153a00 2024-01-17T23:00:30.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d406bcb0 con 0x7fc1d40cd520 2024-01-17T23:00:30.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.080+0000 7fc1dac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d406d1d0 con 0x7fc1d406f6e0 2024-01-17T23:00:30.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.084+0000 7fc1d3e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc1d4153a00 0x7fc1d415a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:48160/0 (socket says 172.21.15.67:48160) 2024-01-17T23:00:30.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.084+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1626904532 learned_addr learned my addr 172.21.15.67:0/1626904532 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:30.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.084+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1626904532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.084+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464488784 0 0) 0x7fc1d406b9d0 con 0x7fc1d4153a00 2024-01-17T23:00:30.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.084+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b4003530 con 0x7fc1d4153a00 2024-01-17T23:00:30.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.088+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896833873 0 0) 0x7fc1d406bcb0 con 0x7fc1d40cd520 2024-01-17T23:00:30.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.088+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d406b9d0 con 0x7fc1d40cd520 2024-01-17T23:00:30.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.088+0000 7fc1d3400640 1 -- 172.21.15.67:0/1626904532 >> v1:172.21.15.137:6789/0 conn(0x7fc1d40cd520 legacy=0x7fc1d40c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.088+0000 7fc1d3400640 1 -- 172.21.15.67:0/1626904532 >> v1:172.21.15.67:6789/0 conn(0x7fc1d4153a00 legacy=0x7fc1d415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.088+0000 7fc1d3400640 1 -- 172.21.15.67:0/1626904532 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d406bf90 con 0x7fc1d406f6e0 2024-01-17T23:00:30.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.096+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1626904532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d40ccfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097f0 tx=0x7fc1bc01ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f24b9b993a7e518b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0a89b0 con 0x7fc1d406f6e0 2024-01-17T23:00:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0a8b10 con 0x7fc1d406f6e0 2024-01-17T23:00:30.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1d2a00640 1 -- 172.21.15.67:0/1626904532 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0a8ea0 con 0x7fc1d406f6e0 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 -- 172.21.15.67:0/1626904532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 msgr2=0x7fc1d40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 --2- 172.21.15.67:0/1626904532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d40ccfe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0097f0 tx=0x7fc1bc01ecb0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 -- 172.21.15.67:0/1626904532 shutdown_connections 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 --2- 172.21.15.67:0/1626904532 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d40ccfe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 -- 172.21.15.67:0/1626904532 >> 172.21.15.67:0/1626904532 conn(0x7fc1d4061100 msgr2=0x7fc1d4061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 -- 172.21.15.67:0/1626904532 shutdown_connections 2024-01-17T23:00:30.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.108+0000 7fc1dac00640 1 -- 172.21.15.67:0/1626904532 wait complete. 2024-01-17T23:00:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 Processor -- start 2024-01-17T23:00:30.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 -- start start 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d4152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d40cd520 0x7fc1d4149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d406b7f0 con 0x7fc1d4153a00 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40af470 con 0x7fc1d40cd520 2024-01-17T23:00:30.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.112+0000 7fc1dac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41f34b0 con 0x7fc1d406f6e0 2024-01-17T23:00:30.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.116+0000 7fc1d8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.116+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.116+0000 7fc1d8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43898/0 (socket says 172.21.15.67:43898) 2024-01-17T23:00:30.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.116+0000 7fc1d8c00640 1 -- 172.21.15.67:0/3277847163 learned_addr learned my addr 172.21.15.67:0/3277847163 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 -- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 msgr2=0x7fc1d4152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d4152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 -- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d40cd520 msgr2=0x7fc1d4149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d40cd520 0x7fc1d4149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 -- 172.21.15.67:0/3277847163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009420 con 0x7fc1d4153a00 2024-01-17T23:00:30.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.120+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c790 tx=0x7fc1cc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.124+0000 7fc1cbe00640 1 -- 172.21.15.67:0/3277847163 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00cea0 con 0x7fc1d4153a00 2024-01-17T23:00:30.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.124+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4152b70 con 0x7fc1d4153a00 2024-01-17T23:00:30.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.124+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d41528b0 con 0x7fc1d4153a00 2024-01-17T23:00:30.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.124+0000 7fc1cbe00640 1 -- 172.21.15.67:0/3277847163 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc003b80 con 0x7fc1d4153a00 2024-01-17T23:00:30.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.124+0000 7fc1cbe00640 1 -- 172.21.15.67:0/3277847163 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00a850 con 0x7fc1d4153a00 2024-01-17T23:00:30.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 Processor -- start 2024-01-17T23:00:30.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 -- start start 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b50b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b96a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f269a6d70 con 0x558f26b50730 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f269a2ba0 con 0x558f26b8b7d0 2024-01-17T23:00:30.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.128+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f269a00d0 con 0x558f26b8c0f0 2024-01-17T23:00:30.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.132+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.132+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:42750/0 (socket says 172.21.15.67:42750) 2024-01-17T23:00:30.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.132+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1893049276 learned_addr learned my addr 172.21.15.67:0/1893049276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.136+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b50b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.136+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b96a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.140+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 msgr2=0x558f26b96a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.140+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b96a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.140+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1893049276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 msgr2=0x558f26b50b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.140+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b50b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.140+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1893049276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f26692890 con 0x558f26b8b7d0 2024-01-17T23:00:30.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.144+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4006e30 tx=0x7fc1c4007410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d752a0f106414605 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.148+0000 7fc1cbe00640 1 -- 172.21.15.67:0/3277847163 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc1cc00a9b0 con 0x7fc1d4153a00 2024-01-17T23:00:30.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.148+0000 7fc1cbe00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 0x7fc1ac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.148+0000 7fc1d3400640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 0x7fc1ac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.152+0000 7fc1d3400640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 0x7fc1ac068d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0b2000 tx=0x7fc1bc0046d0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.152+0000 7fc1cbe00640 1 -- 172.21.15.67:0/3277847163 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1cc0555c0 con 0x7fc1d4153a00 2024-01-17T23:00:30.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1c8c00640 1 -- 172.21.15.67:0/1893049276 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40015f0 con 0x558f26b8b7d0 2024-01-17T23:00:30.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1c8c00640 1 -- 172.21.15.67:0/1893049276 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4001750 con 0x558f26b8b7d0 2024-01-17T23:00:30.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1c8c00640 1 -- 172.21.15.67:0/1893049276 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4001ac0 con 0x558f26b8b7d0 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 msgr2=0x558f26b8bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4006e30 tx=0x7fc1c4007410 comp rx=0 tx=0).stop 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- 172.21.15.67:0/1893049276 shutdown_connections 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b96a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b8bbb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 --2- 172.21.15.67:0/1893049276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b50b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- 172.21.15.67:0/1893049276 >> 172.21.15.67:0/1893049276 conn(0x558f26b87580 msgr2=0x558f26b89970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- 172.21.15.67:0/1893049276 shutdown_connections 2024-01-17T23:00:30.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- 172.21.15.67:0/1893049276 wait complete. 2024-01-17T23:00:30.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 -- start start 2024-01-17T23:00:30.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.156+0000 7fc1de129000 1 Processor -- start 2024-01-17T23:00:30.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26b85d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b92950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2699b9c0 con 0x558f26b8b7d0 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f26953040 con 0x558f26b50730 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f26958ee0 con 0x558f26b8c0f0 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1de129000 10 client.0 _ll_register_callbacks cb 0x558f269561b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43922/0 (socket says 172.21.15.67:43922) 2024-01-17T23:00:30.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1d3400640 1 -- 172.21.15.67:0/1742459294 learned_addr learned my addr 172.21.15.67:0/1742459294 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b92950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.160+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26b85d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 -- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 msgr2=0x558f26b92950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b92950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 -- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 msgr2=0x558f26b85d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26b85d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 -- 172.21.15.67:0/1742459294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b4003530 con 0x558f26b8b7d0 2024-01-17T23:00:30.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1d3400640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0202c0 tx=0x7fc1bc01d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5e7decadc329dc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.164+0000 7fc1c1600640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:00:30.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.168+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0ca070 con 0x558f26b8b7d0 2024-01-17T23:00:30.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.168+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1bc0c2040 con 0x558f26b8b7d0 2024-01-17T23:00:30.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.168+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f26921e30 con 0x558f26b8b7d0 2024-01-17T23:00:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.172+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1bc0bbe40 con 0x558f26b8b7d0 2024-01-17T23:00:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.172+0000 7fc1de129000 10 client.4389 fetch_fsmap learned FSMap version 7 2024-01-17T23:00:30.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.172+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558f2695b5e0 con 0x558f26b8b7d0 2024-01-17T23:00:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f26921e30 con 0x558f26b8b7d0 2024-01-17T23:00:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fc1bc0cd030 con 0x558f26b8b7d0 2024-01-17T23:00:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-01-17T23:00:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 10 client.4389 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-17T23:00:30.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 20 client.4389 populate_metadata read hostname 'smithi067' 2024-01-17T23:00:30.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26b93600 0x558f26b939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 4 client.4389 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T23:00:30.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.176+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 --> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f26958870 con 0x558f26b93600 2024-01-17T23:00:30.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.200+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26b93600 0x558f26b939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.344+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26b93600 0x558f26b939e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82d31ebfd9c53397 server_cookie=62999a139a403185 in_seq=0 out_seq=0 2024-01-17T23:00:30.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.344+0000 7fc1c1600640 10 client.4389 ms_handle_connect on v2:172.21.15.137:6837/2865340697 2024-01-17T23:00:30.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1c1600640 1 -- 172.21.15.67:0/1742459294 <== mds.0 v2:172.21.15.137:6837/2865340697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558f26958870 con 0x558f26b93600 2024-01-17T23:00:30.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1c1600640 10 client.4389 handle_command_reply: tid=0 2024-01-17T23:00:30.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 client.4389 shutdown 2024-01-17T23:00:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 msgr2=0x558f26b86240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0202c0 tx=0x7fc1bc01d4f0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 shutdown_connections 2024-01-17T23:00:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26b93600 0x558f26b939e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b92950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8b7d0 0x558f26b86240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 --2- 172.21.15.67:0/1742459294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26b85d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 >> 172.21.15.67:0/1742459294 conn(0x558f26b87580 msgr2=0x558f26b86d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1c1600640 0 client.4389 ms_handle_reset on v2:172.21.15.137:6837/2865340697 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 shutdown_connections 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 1 -- 172.21.15.67:0/1742459294 wait complete. 2024-01-17T23:00:30.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.595+0000 7fc1de129000 20 client.4389 trim_cache size 0 max 16384 2024-01-17T23:00:30.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 Processor -- start 2024-01-17T23:00:30.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 -- start start 2024-01-17T23:00:30.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b89970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b89eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f26653940 con 0x558f26b50730 2024-01-17T23:00:30.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f26995cc0 con 0x558f26b8b7d0 2024-01-17T23:00:30.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f26998dc0 con 0x558f26b8c0f0 2024-01-17T23:00:30.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1d8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b89eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.611+0000 7fc1d3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b89970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53856/0 (socket says 172.21.15.67:53856) 2024-01-17T23:00:30.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1596416768 learned_addr learned my addr 172.21.15.67:0/1596416768 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 msgr2=0x558f26b89eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b89eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 msgr2=0x558f26b89970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b89970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.615+0000 7fc1d3e00640 1 -- 172.21.15.67:0/1596416768 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f269418e0 con 0x558f26b50730 2024-01-17T23:00:30.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.619+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558f26a47620 tx=0x7fc1c400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cc510a388b3b68 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1c3e00640 1 -- 172.21.15.67:0/1596416768 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4025070 con 0x558f26b50730 2024-01-17T23:00:30.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1c3e00640 1 -- 172.21.15.67:0/1596416768 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4005cb0 con 0x558f26b50730 2024-01-17T23:00:30.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1c3e00640 1 -- 172.21.15.67:0/1596416768 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4026d00 con 0x558f26b50730 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- 172.21.15.67:0/1596416768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 msgr2=0x558f26b9e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558f26a47620 tx=0x7fc1c400c000 comp rx=0 tx=0).stop 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- 172.21.15.67:0/1596416768 shutdown_connections 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8c0f0 0x558f26b89eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b8b7d0 0x558f26b89970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- 172.21.15.67:0/1596416768 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b50730 0x558f26b9e900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- 172.21.15.67:0/1596416768 >> 172.21.15.67:0/1596416768 conn(0x558f26b87580 msgr2=0x558f26b9e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- 172.21.15.67:0/1596416768 shutdown_connections 2024-01-17T23:00:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- 172.21.15.67:0/1596416768 wait complete. 2024-01-17T23:00:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- start start 2024-01-17T23:00:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 Processor -- start 2024-01-17T23:00:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26bee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8b7d0 0x558f26bee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f26962eb0 con 0x558f26b8c0f0 2024-01-17T23:00:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f26992a40 con 0x558f26b50730 2024-01-17T23:00:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f26ba79d0 con 0x558f26b8b7d0 2024-01-17T23:00:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.623+0000 7fc1de129000 10 client.0 _ll_register_callbacks cb 0x558f269c8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:00:30.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8b7d0 0x558f26bee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53866/0 (socket says 172.21.15.67:53866) 2024-01-17T23:00:30.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 -- 172.21.15.67:0/4119198979 learned_addr learned my addr 172.21.15.67:0/4119198979 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26bee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 -- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8b7d0 msgr2=0x558f26bee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8b7d0 0x558f26bee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 -- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 msgr2=0x558f26bee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26bee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.627+0000 7fc1d8c00640 1 -- 172.21.15.67:0/4119198979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f26692890 con 0x558f26b8c0f0 2024-01-17T23:00:30.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.631+0000 7fc1d8c00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc054bc0 tx=0x7fc1cc05d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44d1776f18757b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.631+0000 7fc1c1600640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:00:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00ac60 con 0x558f26b8c0f0 2024-01-17T23:00:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f2694d4f0 con 0x558f26b8c0f0 2024-01-17T23:00:30.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1cc00adc0 con 0x558f26b8c0f0 2024-01-17T23:00:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1cc05cd30 con 0x558f26b8c0f0 2024-01-17T23:00:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1de129000 10 client.4395 fetch_fsmap learned FSMap version 7 2024-01-17T23:00:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.635+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558f26692cc0 con 0x558f26b8c0f0 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.639+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f2694d4f0 con 0x558f26b8c0f0 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.639+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fc1cc019020 con 0x558f26b8c0f0 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.639+0000 7fc1de129000 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.639+0000 7fc1de129000 10 client.4395 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.639+0000 7fc1de129000 20 client.4395 populate_metadata read hostname 'smithi067' 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.643+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26bf80d0 0x558f26b4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.643+0000 7fc1de129000 4 client.4395 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T23:00:30.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.643+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 --> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f2699a310 con 0x558f26bf80d0 2024-01-17T23:00:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.643+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26bf80d0 0x558f26b4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.651+0000 7fc1d3e00640 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26bf80d0 0x558f26b4f1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f45210369e3cb1 server_cookie=b7f514f196926c31 in_seq=0 out_seq=0 2024-01-17T23:00:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.651+0000 7fc1c1600640 10 client.4395 ms_handle_connect on v2:172.21.15.137:6837/2865340697 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1c1600640 1 -- 172.21.15.67:0/4119198979 <== mds.0 v2:172.21.15.137:6837/2865340697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558f2699a310 con 0x558f26bf80d0 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1c1600640 10 client.4395 handle_command_reply: tid=0 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 client.4395 shutdown 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 msgr2=0x558f26b4e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc054bc0 tx=0x7fc1cc05d340 comp rx=0 tx=0).stop 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 shutdown_connections 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x558f26bf80d0 0x558f26b4f1e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f26b8c0f0 0x558f26b4e5b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x558f26b8b7d0 0x558f26bee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1c1600640 0 client.4395 ms_handle_reset on v2:172.21.15.137:6837/2865340697 2024-01-17T23:00:30.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 --2- 172.21.15.67:0/4119198979 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558f26b50730 0x558f26bee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.675+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 >> 172.21.15.67:0/4119198979 conn(0x558f26b87580 msgr2=0x558f26b94690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 shutdown_connections 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1de129000 1 -- 172.21.15.67:0/4119198979 wait complete. 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1de129000 20 client.4395 trim_cache size 0 max 16384 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-17T23:00:30.685 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1", 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4282, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 11.397916878, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 7, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 27, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 27, 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 38.058061403000004 2024-01-17T23:00:30.686 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-17T23:00:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 msgr2=0x7fc1ac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 0x7fc1ac068d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0b2000 tx=0x7fc1bc0046d0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 msgr2=0x7fc1d4150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c790 tx=0x7fc1cc00cc50 comp rx=0 tx=0).stop 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 shutdown_connections 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc1ac066840 0x7fc1ac068d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4153a00 0x7fc1d4150d60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1d40cd520 0x7fc1d4149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 --2- 172.21.15.67:0/3277847163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc1d406f6e0 0x7fc1d4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 >> 172.21.15.67:0/3277847163 conn(0x7fc1d4061100 msgr2=0x7fc1d414f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 shutdown_connections 2024-01-17T23:00:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.679+0000 7fc1dac00640 1 -- 172.21.15.67:0/3277847163 wait complete. 2024-01-17T23:00:30.705 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-17T23:00:30.705 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:30.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-17T23:00:30.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 Processor -- start 2024-01-17T23:00:30.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 -- start start 2024-01-17T23:00:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 0x7fac340ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac3415d3f0 0x7fac3415d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340c9890 con 0x7fac340c79c0 2024-01-17T23:00:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3406d570 con 0x7fac3415d3f0 2024-01-17T23:00:30.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac3b600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac34159bf0 con 0x7fac341539a0 2024-01-17T23:00:30.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac33e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac340c79c0 0x7fac34061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:54208/0 (socket says 172.21.15.67:54208) 2024-01-17T23:00:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.843+0000 7fac33e00640 1 -- 172.21.15.67:0/303482524 learned_addr learned my addr 172.21.15.67:0/303482524 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:30.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.847+0000 7fac38c00640 1 --2- 172.21.15.67:0/303482524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 0x7fac340ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.851+0000 7fac38c00640 1 -- 172.21.15.67:0/303482524 >> v2:172.21.15.67:3300/0 conn(0x7fac3415d3f0 msgr2=0x7fac3415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:30.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.851+0000 7fac38c00640 1 --2- 172.21.15.67:0/303482524 >> v2:172.21.15.67:3300/0 conn(0x7fac3415d3f0 0x7fac3415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.851+0000 7fac38c00640 1 -- 172.21.15.67:0/303482524 >> v1:172.21.15.137:6789/0 conn(0x7fac340c79c0 legacy=0x7fac34061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.851+0000 7fac38c00640 1 -- 172.21.15.67:0/303482524 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3415dd60 con 0x7fac341539a0 2024-01-17T23:00:30.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.867+0000 7fac38c00640 1 --2- 172.21.15.67:0/303482524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 0x7fac340ca410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41ddad7379ffcae server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac33400640 1 -- 172.21.15.67:0/303482524 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240ab650 con 0x7fac341539a0 2024-01-17T23:00:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac33400640 1 -- 172.21.15.67:0/303482524 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240ab7b0 con 0x7fac341539a0 2024-01-17T23:00:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac33400640 1 -- 172.21.15.67:0/303482524 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240abb40 con 0x7fac341539a0 2024-01-17T23:00:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- 172.21.15.67:0/303482524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 msgr2=0x7fac340ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 --2- 172.21.15.67:0/303482524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 0x7fac340ca410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401c450 comp rx=0 tx=0).stop 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- 172.21.15.67:0/303482524 shutdown_connections 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 --2- 172.21.15.67:0/303482524 >> v2:172.21.15.67:3300/0 conn(0x7fac3415d3f0 0x7fac3415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 --2- 172.21.15.67:0/303482524 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac341539a0 0x7fac340ca410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- 172.21.15.67:0/303482524 >> 172.21.15.67:0/303482524 conn(0x7fac3406ad40 msgr2=0x7fac3406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- 172.21.15.67:0/303482524 shutdown_connections 2024-01-17T23:00:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- 172.21.15.67:0/303482524 wait complete. 2024-01-17T23:00:30.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 Processor -- start 2024-01-17T23:00:30.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.983+0000 7fac3b600640 1 -- start start 2024-01-17T23:00:30.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac340c79c0 0x7fac340b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac3415d3f0 0x7fac3414d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:30.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340cdb40 con 0x7fac341539a0 2024-01-17T23:00:30.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340cdd90 con 0x7fac340c79c0 2024-01-17T23:00:30.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac3b600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3414e320 con 0x7fac3415d3f0 2024-01-17T23:00:30.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac33e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac39600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac3415d3f0 0x7fac3414d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac33e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53882/0 (socket says 172.21.15.67:53882) 2024-01-17T23:00:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac33e00640 1 -- 172.21.15.67:0/1259885654 learned_addr learned my addr 172.21.15.67:0/1259885654 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.987+0000 7fac38c00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac340c79c0 0x7fac340b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 -- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac3415d3f0 msgr2=0x7fac3414d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac3415d3f0 0x7fac3414d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 -- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac340c79c0 msgr2=0x7fac340b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac340c79c0 0x7fac340b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 -- 172.21.15.67:0/1259885654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009420 con 0x7fac341539a0 2024-01-17T23:00:30.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.991+0000 7fac33e00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c450 tx=0x7fac1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.995+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c005cf0 con 0x7fac341539a0 2024-01-17T23:00:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.995+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c005e50 con 0x7fac341539a0 2024-01-17T23:00:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.995+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007290 con 0x7fac341539a0 2024-01-17T23:00:31.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.995+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac341f28d0 con 0x7fac341539a0 2024-01-17T23:00:31.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.995+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3414cac0 con 0x7fac341539a0 2024-01-17T23:00:31.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:30.999+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3414cce0 con 0x7fac341539a0 2024-01-17T23:00:31.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.015+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fac1c0073f0 con 0x7fac341539a0 2024-01-17T23:00:31.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.019+0000 7fac30c00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 0x7fac0c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:31.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.019+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac1c054a00 con 0x7fac341539a0 2024-01-17T23:00:31.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.019+0000 7fac38c00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 0x7fac0c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:31.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.019+0000 7fac38c00640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 0x7fac0c068d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac240af000 tx=0x7fac240a7000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:31.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.279+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fac1c050d40 con 0x7fac341539a0 2024-01-17T23:00:31.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.479+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac3406b620 con 0x7fac341539a0 2024-01-17T23:00:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.483+0000 7fac30c00640 1 -- 172.21.15.67:0/1259885654 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fac1c017070 con 0x7fac341539a0 2024-01-17T23:00:31.491 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 msgr2=0x7fac0c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 0x7fac0c068d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac240af000 tx=0x7fac240a7000 comp rx=0 tx=0).stop 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 msgr2=0x7fac3414cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c450 tx=0x7fac1c00c910 comp rx=0 tx=0).stop 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 shutdown_connections 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac0c0668c0 0x7fac0c068d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac3415d3f0 0x7fac3414d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac341539a0 0x7fac3414cfe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 --2- 172.21.15.67:0/1259885654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac340c79c0 0x7fac340b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 >> 172.21.15.67:0/1259885654 conn(0x7fac3406ad40 msgr2=0x7fac341592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 shutdown_connections 2024-01-17T23:00:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:31.487+0000 7fac3b600640 1 -- 172.21.15.67:0/1259885654 wait complete. 2024-01-17T23:00:31.514 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-17T23:00:31.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-17T23:00:31.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-17T23:00:31.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-17T23:00:31.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.515 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-17T23:00:31.524 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-17T23:00:31.524 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-17T23:00:31.524 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-17T23:00:31.525 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 38165sec preferred_lft 38165sec 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:01:41:8f:bb brd ff:ff:ff:ff:ff:ff 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-17T23:00:31.526 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:00:31.528 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-17T23:00:31.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-17T23:00:31.528 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:00:31.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.640 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-17T23:00:31.658 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-17T23:00:31.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.661 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-17T23:00:31.728 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:00:31.729 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:00:31.729 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:00:31.729 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-17T23:00:31.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.729 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:00:31.729 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:00:31.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-17T23:00:31.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-17T23:00:31.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-17T23:00:31.730 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:00:31.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.828 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-17T23:00:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.839 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-01-17T23:00:31.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.893 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:00:31.893 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:00:31.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:31.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-17T23:00:31.893 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:00:31.976 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-17T23:00:31.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:31.976 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:00:31.976 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-17T23:00:31.977 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:00:32.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:32.144 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:00:32.144 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:00:32.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-17T23:00:32.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-01-17T23:00:32.144 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:00:32.186 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-17T23:00:32.186 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T23:00:32.186 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:32.236 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-17T23:00:32.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T23:00:32.236 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:32.287 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-01-17T23:00:32.354 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T23:00:32.405 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-01-17T23:00:32.405 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-01-17T23:00:32.405 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T23:00:32.406 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-01-17T23:00:32.407 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:32.408 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:32.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:32.409 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-01-17T23:00:32.460 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-17T23:00:32.460 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-17T23:00:32.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-01-17T23:00:32.527 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-01-17T23:00:32.577 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-01-17T23:00:32.578 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T23:00:32.579 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T23:00:32.580 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-01-17T23:00:32.580 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:32.580 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:32.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:32.581 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-01-17T23:00:32.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:2024-01-17T23:00:32.619+0000 7f7ac4249580 -1 init, newargv = 0x5618fed8a7b0 newargc=15 2024-01-17T23:00:32.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[32097]: starting ceph client 2024-01-17T23:00:33.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[32097]: starting fuse 2024-01-17T23:00:33.735 DEBUG:teuthology.orchestra.run.smithi067:> sudo modprobe fuse 2024-01-17T23:00:33.757 DEBUG:teuthology.orchestra.run.smithi067:> cat /proc/self/mounts | awk '{print $2}' 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/sys 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/proc 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/dev 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/pts 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/run 2024-01-17T23:00:33.813 INFO:teuthology.orchestra.run.smithi067.stdout:/ 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/security 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/shm 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/run/lock 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/cgroup 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/pstore 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/bpf 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/sys/fs/binfmt_misc 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/hugepages 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/dev/mqueue 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/debug 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/tracing 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/proc/fs/nfsd 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/fs/fuse/connections 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/sys/kernel/config 2024-01-17T23:00:33.814 INFO:teuthology.orchestra.run.smithi067.stdout:/run/credentials/systemd-sysusers.service 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/run/rpc_pipefs 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/run/user/1000 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-0 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-1 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-2 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/var/lib/ceph/osd/ceph-3 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:00:33.815 INFO:teuthology.orchestra.run.smithi067.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:33.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:33.816 DEBUG:teuthology.orchestra.run.smithi067:> ls /sys/fs/fuse/connections 2024-01-17T23:00:33.872 INFO:teuthology.orchestra.run.smithi067.stdout:43 2024-01-17T23:00:33.872 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> sudo stdin-killer -- python3 -c ' 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> import glob 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> import re 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> import os 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> import subprocess 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> def _find_admin_socket(client_name): 2024-01-17T23:00:33.872 DEBUG:teuthology.orchestra.run.smithi067:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> files = glob.glob(asok_path) 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> # Given a non-glob path, it better be there 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> if "*" not in asok_path: 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> assert(len(files) == 1) 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> return files[0] 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> for f in files: 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> contents = proc_f.read() 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> if mountpoint in contents: 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> return f 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-17T23:00:33.873 DEBUG:teuthology.orchestra.run.smithi067:> 2024-01-17T23:00:33.874 DEBUG:teuthology.orchestra.run.smithi067:> print(_find_admin_socket("client.admin")) 2024-01-17T23:00:33.874 DEBUG:teuthology.orchestra.run.smithi067:> ' 2024-01-17T23:00:34.003 INFO:teuthology.orchestra.run.smithi067.stdout:/var/run/ceph/ceph-client.admin.32097.asok 2024-01-17T23:00:34.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-17T23:00:34.014 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32097.asok 2024-01-17T23:00:34.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:34.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32097.asok status 2024-01-17T23:00:34.191 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "metadata": { 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_sha1": "1ec1182e55b4a38b17dd0d004d9fa6814d0269d4", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.0.0-653-g1ec1182e (1ec1182e55b4a38b17dd0d004d9fa6814d0269d4) squid (dev)", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "entity_id": "admin", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": "smithi067", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "pid": "32097", 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "root": "/" 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_count": 0, 2024-01-17T23:00:34.192 INFO:teuthology.orchestra.run.smithi067.stdout: "dentry_pinned_count": 0, 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4404, 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "inst": { 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "name": { 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "client", 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "num": 4404 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2180116354 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": { 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "192.168.0.1:0", 2024-01-17T23:00:34.193 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 2180116354 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "inst_str": "client.4404 192.168.0.1:0/2180116354", 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "addr_str": "192.168.0.1:0/2180116354", 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "inode_count": 1, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_epoch": 7, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch": 27, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_epoch_barrier": 0, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "blocklisted": false, 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs" 2024-01-17T23:00:34.194 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-17T23:00:34.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:34.211 DEBUG:teuthology.orchestra.run.smithi067:> stat --file-system '--printf=%T 2024-01-17T23:00:34.211 DEBUG:teuthology.orchestra.run.smithi067:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:34.232 INFO:teuthology.orchestra.run.smithi067.stdout:fuseblk 2024-01-17T23:00:34.233 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:34.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:34.233 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:34.436 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-17T23:00:34.930 INFO:teuthology.orchestra.run.smithi067.stdout:# file: . 2024-01-17T23:00:34.930 INFO:teuthology.orchestra.run.smithi067.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-17T23:00:34.930 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:34.931 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T23:00:34.931 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T23:00:34.940 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:35.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 Processor -- start 2024-01-17T23:00:35.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 -- start start 2024-01-17T23:00:35.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f232c0c5a70 0x7f232c159910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c06dc10 con 0x7f232c0c0090 2024-01-17T23:00:35.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c06d7e0 con 0x7f232c0c5a70 2024-01-17T23:00:35.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.123+0000 7f2331a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1564c0 con 0x7f232c150560 2024-01-17T23:00:35.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.127+0000 7f232aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.127+0000 7f232a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f232c0c5a70 0x7f232c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.127+0000 7f232aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:44428/0 (socket says 172.21.15.67:44428) 2024-01-17T23:00:35.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.127+0000 7f232aa00640 1 -- 172.21.15.67:0/2533278176 learned_addr learned my addr 172.21.15.67:0/2533278176 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:35.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.135+0000 7f232aa00640 1 -- 172.21.15.67:0/2533278176 >> v2:172.21.15.137:3300/0 conn(0x7f232c0c5a70 msgr2=0x7f232c159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:35.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.135+0000 7f232aa00640 1 --2- 172.21.15.67:0/2533278176 >> v2:172.21.15.137:3300/0 conn(0x7f232c0c5a70 0x7f232c159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.135+0000 7f232aa00640 1 -- 172.21.15.67:0/2533278176 >> v1:172.21.15.137:6789/0 conn(0x7f232c0c0090 legacy=0x7f232c0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:35.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.135+0000 7f232aa00640 1 -- 172.21.15.67:0/2533278176 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c06d220 con 0x7f232c150560 2024-01-17T23:00:35.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.139+0000 7f232aa00640 1 --2- 172.21.15.67:0/2533278176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f232c0c8c10 tx=0x7f231c01eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505c8a46958364e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2329600640 1 -- 172.21.15.67:0/2533278176 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0a79a0 con 0x7f232c150560 2024-01-17T23:00:35.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2329600640 1 -- 172.21.15.67:0/2533278176 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c0a7b00 con 0x7f232c150560 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2329600640 1 -- 172.21.15.67:0/2533278176 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0a7e90 con 0x7f232c150560 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 -- 172.21.15.67:0/2533278176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 msgr2=0x7f232c156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 --2- 172.21.15.67:0/2533278176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f232c0c8c10 tx=0x7f231c01eb00 comp rx=0 tx=0).stop 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 -- 172.21.15.67:0/2533278176 shutdown_connections 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 --2- 172.21.15.67:0/2533278176 >> v2:172.21.15.137:3300/0 conn(0x7f232c0c5a70 0x7f232c159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 --2- 172.21.15.67:0/2533278176 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c150560 0x7f232c156f60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 -- 172.21.15.67:0/2533278176 >> 172.21.15.67:0/2533278176 conn(0x7f232c0cb070 msgr2=0x7f232c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:35.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 -- 172.21.15.67:0/2533278176 shutdown_connections 2024-01-17T23:00:35.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.151+0000 7f2331a00640 1 -- 172.21.15.67:0/2533278176 wait complete. 2024-01-17T23:00:35.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 Processor -- start 2024-01-17T23:00:35.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 -- start start 2024-01-17T23:00:35.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c0c0090 0x7f232c160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f232c0c5a70 0x7f232c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1f3440 con 0x7f232c150560 2024-01-17T23:00:35.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c146c30 con 0x7f232c0c5a70 2024-01-17T23:00:35.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f2331a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c146950 con 0x7f232c0c0090 2024-01-17T23:00:35.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f232b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f232b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53888/0 (socket says 172.21.15.67:53888) 2024-01-17T23:00:35.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f232b400640 1 -- 172.21.15.67:0/3930051561 learned_addr learned my addr 172.21.15.67:0/3930051561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:35.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.155+0000 7f232aa00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c0c0090 0x7f232c160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.159+0000 7f232b400640 1 -- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c0c0090 msgr2=0x7f232c160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.159+0000 7f232b400640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c0c0090 0x7f232c160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.159+0000 7f232b400640 1 -- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f232c0c5a70 msgr2=0x7f232c1462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.159+0000 7f232b400640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f232c0c5a70 0x7f232c1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.159+0000 7f232b400640 1 -- 172.21.15.67:0/3930051561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c00b770 con 0x7f232c150560 2024-01-17T23:00:35.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.163+0000 7f232b400640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f232400c780 tx=0x7f232400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324004b70 con 0x7f232c150560 2024-01-17T23:00:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232400ce90 con 0x7f232c150560 2024-01-17T23:00:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400a850 con 0x7f232c150560 2024-01-17T23:00:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c1f2680 con 0x7f232c150560 2024-01-17T23:00:35.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c1f2c40 con 0x7f232c150560 2024-01-17T23:00:35.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.171+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c06d050 con 0x7f232c150560 2024-01-17T23:00:35.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.191+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2324006b60 con 0x7f232c150560 2024-01-17T23:00:35.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.191+0000 7f2322a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 0x7f2304068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.191+0000 7f232aa00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 0x7f2304068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.195+0000 7f232aa00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 0x7f2304068d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f231c0b1000 tx=0x7f231c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.195+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2324056090 con 0x7f232c150560 2024-01-17T23:00:35.219 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:35.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:00:35.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.447+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2324051cd0 con 0x7f232c150560 2024-01-17T23:00:35.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.611+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f232c1f3160 con 0x7f232c150560 2024-01-17T23:00:35.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.659+0000 7f2322a00640 1 -- 172.21.15.67:0/3930051561 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f232c1f3160 con 0x7f232c150560 2024-01-17T23:00:35.666 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:35.667 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 msgr2=0x7f2304068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 0x7f2304068d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f231c0b1000 tx=0x7f231c008040 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 msgr2=0x7f232c0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f232400c780 tx=0x7f232400cc40 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 shutdown_connections 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2304066890 0x7f2304068d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f232c150560 0x7f232c0c67f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f232c0c5a70 0x7f232c1462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 --2- 172.21.15.67:0/3930051561 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f232c0c0090 0x7f232c160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 >> 172.21.15.67:0/3930051561 conn(0x7f232c0cb070 msgr2=0x7f232c0cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 shutdown_connections 2024-01-17T23:00:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.663+0000 7f2331a00640 1 -- 172.21.15.67:0/3930051561 wait complete. 2024-01-17T23:00:35.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T23:00:15.126108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T23:00:16.891955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T23:00:22.346907+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T23:00:35.689 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T23:00:35.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 Processor -- start 2024-01-17T23:00:35.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 -- start start 2024-01-17T23:00:35.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f84380cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84380cc4e0 0x7f843815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84380c9900 con 0x7f8438153970 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843806b5d0 con 0x7f84380cc4e0 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843806dcb0 con 0x7f843806d830 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84380cc4e0 0x7f843815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f84380cc4e0 0x7f843815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53890/0 (socket says 172.21.15.67:53890) 2024-01-17T23:00:35.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f843d800640 1 -- 172.21.15.67:0/4278474142 learned_addr learned my addr 172.21.15.67:0/4278474142 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:35.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.827+0000 7f8437e00640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f84380cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.831+0000 7f843d800640 1 -- 172.21.15.67:0/4278474142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 msgr2=0x7f84380cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.831+0000 7f843d800640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f84380cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.831+0000 7f843d800640 1 -- 172.21.15.67:0/4278474142 >> v1:172.21.15.67:6789/0 conn(0x7f8438153970 legacy=0x7f843806e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.831+0000 7f843d800640 1 -- 172.21.15.67:0/4278474142 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380c8cf0 con 0x7f84380cc4e0 2024-01-17T23:00:35.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.835+0000 7f843d800640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84380cc4e0 0x7f843815ce20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105e1cb963e78c90 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.839+0000 7f8437400640 1 -- 172.21.15.67:0/4278474142 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a55b0 con 0x7f84380cc4e0 2024-01-17T23:00:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.839+0000 7f8437400640 1 -- 172.21.15.67:0/4278474142 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a5710 con 0x7f84380cc4e0 2024-01-17T23:00:35.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.839+0000 7f8437400640 1 -- 172.21.15.67:0/4278474142 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a5aa0 con 0x7f84380cc4e0 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.839+0000 7f843f800640 1 -- 172.21.15.67:0/4278474142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84380cc4e0 msgr2=0x7f843815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.839+0000 7f843f800640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84380cc4e0 0x7f843815ce20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843001c8f0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- 172.21.15.67:0/4278474142 shutdown_connections 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84380cc4e0 0x7f843815ce20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 --2- 172.21.15.67:0/4278474142 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f84380cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- 172.21.15.67:0/4278474142 >> 172.21.15.67:0/4278474142 conn(0x7f843806b7f0 msgr2=0x7f843806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- 172.21.15.67:0/4278474142 shutdown_connections 2024-01-17T23:00:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- 172.21.15.67:0/4278474142 wait complete. 2024-01-17T23:00:35.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 Processor -- start 2024-01-17T23:00:35.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- start start 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f843814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84380cc4e0 0x7f8438159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843814f2c0 con 0x7f8438153970 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843814ea20 con 0x7f84380cc4e0 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8438158320 con 0x7f843806d830 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.843+0000 7f843d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53906/0 (socket says 172.21.15.67:53906) 2024-01-17T23:00:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 -- 172.21.15.67:0/552697440 learned_addr learned my addr 172.21.15.67:0/552697440 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:35.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f8437e00640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84380cc4e0 0x7f8438159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843ce00640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f843814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 -- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 msgr2=0x7f843814e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f843814e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 -- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84380cc4e0 msgr2=0x7f8438159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84380cc4e0 0x7f8438159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:35.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.847+0000 7f843d800640 1 -- 172.21.15.67:0/552697440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009b30 con 0x7f8438153970 2024-01-17T23:00:35.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.851+0000 7f843d800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f84300af040 tx=0x7f8430019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a55b0 con 0x7f8438153970 2024-01-17T23:00:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300b8670 con 0x7f8438153970 2024-01-17T23:00:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300b8a20 con 0x7f8438153970 2024-01-17T23:00:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843814ed00 con 0x7f8438153970 2024-01-17T23:00:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843814f7c0 con 0x7f8438153970 2024-01-17T23:00:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.855+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84380746a0 con 0x7f8438153970 2024-01-17T23:00:35.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.875+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f84300b8b80 con 0x7f8438153970 2024-01-17T23:00:35.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.879+0000 7f8434c00640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 0x7f8410068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.879+0000 7f843ce00640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 0x7f8410068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.879+0000 7f843ce00640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 0x7f8410068d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8428001770 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:35.879+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f84300f0a30 con 0x7f8438153970 2024-01-17T23:00:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.123+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f84300ecd70 con 0x7f8438153970 2024-01-17T23:00:36.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.287+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f843815d120 con 0x7f8438153970 2024-01-17T23:00:36.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.291+0000 7f8434c00640 1 -- 172.21.15.67:0/552697440 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84300bc020 con 0x7f8438153970 2024-01-17T23:00:36.298 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 msgr2=0x7f8410068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 0x7f8410068d50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8428001770 tx=0x7f8428009040 comp rx=0 tx=0).stop 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 msgr2=0x7f843814ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f84300af040 tx=0x7f8430019690 comp rx=0 tx=0).stop 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 shutdown_connections 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f8410066890 0x7f8410068d50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8438153970 0x7f843814ffc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84380cc4e0 0x7f8438159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 --2- 172.21.15.67:0/552697440 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f843806d830 0x7f843814e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 >> 172.21.15.67:0/552697440 conn(0x7f843806b7f0 msgr2=0x7f8438152930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 shutdown_connections 2024-01-17T23:00:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.295+0000 7f843f800640 1 -- 172.21.15.67:0/552697440 wait complete. 2024-01-17T23:00:36.320 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T23:00:36.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 Processor -- start 2024-01-17T23:00:36.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 -- start start 2024-01-17T23:00:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f90f0156300 0x7f90f006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:36.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00bffb0 con 0x7f90f01506b0 2024-01-17T23:00:36.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00b1130 con 0x7f90f006df20 2024-01-17T23:00:36.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90f6000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f006e330 con 0x7f90f0156300 2024-01-17T23:00:36.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90efe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f90f006df20 0x7f90f00c5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:54232/0 (socket says 172.21.15.67:54232) 2024-01-17T23:00:36.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.459+0000 7f90efe00640 1 -- 172.21.15.67:0/1850149296 learned_addr learned my addr 172.21.15.67:0/1850149296 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.463+0000 7f90eea00640 1 --2- 172.21.15.67:0/1850149296 >> v2:172.21.15.67:3300/0 conn(0x7f90f0156300 0x7f90f006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.467+0000 7f90eea00640 1 -- 172.21.15.67:0/1850149296 >> v1:172.21.15.137:6789/0 conn(0x7f90f006df20 legacy=0x7f90f00c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.467+0000 7f90eea00640 1 -- 172.21.15.67:0/1850149296 >> v1:172.21.15.67:6789/0 conn(0x7f90f01506b0 legacy=0x7f90f00c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.467+0000 7f90eea00640 1 -- 172.21.15.67:0/1850149296 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f01567b0 con 0x7f90f0156300 2024-01-17T23:00:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.471+0000 7f90eea00640 1 --2- 172.21.15.67:0/1850149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f0156300 0x7f90f006d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7646e3e477450d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90ee000640 1 -- 172.21.15.67:0/1850149296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ab600 con 0x7f90f0156300 2024-01-17T23:00:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90ee000640 1 -- 172.21.15.67:0/1850149296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80a7050 con 0x7f90f0156300 2024-01-17T23:00:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90ee000640 1 -- 172.21.15.67:0/1850149296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ab980 con 0x7f90f0156300 2024-01-17T23:00:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 -- 172.21.15.67:0/1850149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f0156300 msgr2=0x7f90f006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 --2- 172.21.15.67:0/1850149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f0156300 0x7f90f006d9e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d801c480 comp rx=0 tx=0).stop 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 -- 172.21.15.67:0/1850149296 shutdown_connections 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 --2- 172.21.15.67:0/1850149296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f0156300 0x7f90f006d9e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 -- 172.21.15.67:0/1850149296 >> 172.21.15.67:0/1850149296 conn(0x7f90f00c7a90 msgr2=0x7f90f00c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 -- 172.21.15.67:0/1850149296 shutdown_connections 2024-01-17T23:00:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.475+0000 7f90f6000640 1 -- 172.21.15.67:0/1850149296 wait complete. 2024-01-17T23:00:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 Processor -- start 2024-01-17T23:00:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 -- start start 2024-01-17T23:00:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 0x7f90f00b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 0x7f90f014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90f0156300 0x7f90f00c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01438f0 con 0x7f90f006df20 2024-01-17T23:00:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0154550 con 0x7f90f01506b0 2024-01-17T23:00:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90f6000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0143e70 con 0x7f90f0156300 2024-01-17T23:00:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90eea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 0x7f90f014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.479+0000 7f90efe00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90f0156300 0x7f90f00c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.483+0000 7f90eea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 0x7f90f014c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:60564/0 (socket says 172.21.15.67:60564) 2024-01-17T23:00:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.483+0000 7f90eea00640 1 -- 172.21.15.67:0/1356539731 learned_addr learned my addr 172.21.15.67:0/1356539731 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.483+0000 7f90ef400640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 0x7f90f00b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.487+0000 7f90ef400640 1 -- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90f0156300 msgr2=0x7f90f00c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.487+0000 7f90ef400640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90f0156300 0x7f90f00c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.487+0000 7f90ef400640 1 -- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 msgr2=0x7f90f014c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.487+0000 7f90ef400640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 0x7f90f014c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.487+0000 7f90ef400640 1 -- 172.21.15.67:0/1356539731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009420 con 0x7f90f006df20 2024-01-17T23:00:36.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.491+0000 7f90ef400640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 0x7f90f00b0250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90e000c760 tx=0x7f90e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0006d60 con 0x7f90f006df20 2024-01-17T23:00:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000ce10 con 0x7f90f006df20 2024-01-17T23:00:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0003bc0 con 0x7f90f006df20 2024-01-17T23:00:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00c5410 con 0x7f90f006df20 2024-01-17T23:00:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f0143b00 con 0x7f90f006df20 2024-01-17T23:00:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.495+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0144150 con 0x7f90f006df20 2024-01-17T23:00:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.515+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f90e0003d20 con 0x7f90f006df20 2024-01-17T23:00:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.515+0000 7f90e7400640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 0x7f90c8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.515+0000 7f90eea00640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 0x7f90c8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.515+0000 7f90eea00640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 0x7f90c8068d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90d801c4c0 tx=0x7f90d80a6000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.519+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90e00558f0 con 0x7f90f006df20 2024-01-17T23:00:36.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.775+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f90e0051c30 con 0x7f90f006df20 2024-01-17T23:00:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.943+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90f00746a0 con 0x7f90f006df20 2024-01-17T23:00:36.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90e7400640 1 -- 172.21.15.67:0/1356539731 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90e0055250 con 0x7f90f006df20 2024-01-17T23:00:36.969 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:00:36.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 msgr2=0x7f90c8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 0x7f90c8068d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90d801c4c0 tx=0x7f90d80a6000 comp rx=0 tx=0).stop 2024-01-17T23:00:36.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 msgr2=0x7f90f00b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 0x7f90f00b0250 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f90e000c760 tx=0x7f90e000cc20 comp rx=0 tx=0).stop 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 shutdown_connections 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c8066890 0x7f90c8068d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90f0156300 0x7f90f00c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90f01506b0 0x7f90f014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 --2- 172.21.15.67:0/1356539731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90f006df20 0x7f90f00b0250 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 >> 172.21.15.67:0/1356539731 conn(0x7f90f00c7a90 msgr2=0x7f90f0155790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 shutdown_connections 2024-01-17T23:00:36.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:36.963+0000 7f90f6000640 1 -- 172.21.15.67:0/1356539731 wait complete. 2024-01-17T23:00:36.992 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T23:00:37.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 Processor -- start 2024-01-17T23:00:37.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 -- start start 2024-01-17T23:00:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4ccc0c7dc0 0x7f4ccc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc0c2960 con 0x7f4ccc0c9060 2024-01-17T23:00:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ccc158360 con 0x7f4ccc0c7dc0 2024-01-17T23:00:37.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4cd2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc157510 con 0x7f4ccc151840 2024-01-17T23:00:37.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.131+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.135+0000 7f4ccb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:44488/0 (socket says 172.21.15.67:44488) 2024-01-17T23:00:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.135+0000 7f4ccb400640 1 -- 172.21.15.67:0/584026863 learned_addr learned my addr 172.21.15.67:0/584026863 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:37.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.135+0000 7f4ccaa00640 1 --2- 172.21.15.67:0/584026863 >> v2:172.21.15.137:3300/0 conn(0x7f4ccc0c7dc0 0x7f4ccc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.139+0000 7f4ccb400640 1 -- 172.21.15.67:0/584026863 >> v2:172.21.15.137:3300/0 conn(0x7f4ccc0c7dc0 msgr2=0x7f4ccc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.139+0000 7f4ccb400640 1 --2- 172.21.15.67:0/584026863 >> v2:172.21.15.137:3300/0 conn(0x7f4ccc0c7dc0 0x7f4ccc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.139+0000 7f4ccb400640 1 -- 172.21.15.67:0/584026863 >> v1:172.21.15.137:6789/0 conn(0x7f4ccc0c9060 legacy=0x7f4ccc0c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.139+0000 7f4ccb400640 1 -- 172.21.15.67:0/584026863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc0b3270 con 0x7f4ccc151840 2024-01-17T23:00:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.147+0000 7f4ccb400640 1 --2- 172.21.15.67:0/584026863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009870 tx=0x7f4cbc01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa56c63544867ee3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.151+0000 7f4cca000640 1 -- 172.21.15.67:0/584026863 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0a8a30 con 0x7f4ccc151840 2024-01-17T23:00:37.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.155+0000 7f4cca000640 1 -- 172.21.15.67:0/584026863 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc0a8b90 con 0x7f4ccc151840 2024-01-17T23:00:37.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.155+0000 7f4cca000640 1 -- 172.21.15.67:0/584026863 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0b0440 con 0x7f4ccc151840 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- 172.21.15.67:0/584026863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 msgr2=0x7f4ccc0c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- 172.21.15.67:0/584026863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009870 tx=0x7f4cbc01ed30 comp rx=0 tx=0).stop 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- 172.21.15.67:0/584026863 shutdown_connections 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- 172.21.15.67:0/584026863 >> v2:172.21.15.137:3300/0 conn(0x7f4ccc0c7dc0 0x7f4ccc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- 172.21.15.67:0/584026863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc151840 0x7f4ccc0c22d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- 172.21.15.67:0/584026863 >> 172.21.15.67:0/584026863 conn(0x7f4ccc061100 msgr2=0x7f4ccc061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- 172.21.15.67:0/584026863 shutdown_connections 2024-01-17T23:00:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- 172.21.15.67:0/584026863 wait complete. 2024-01-17T23:00:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 Processor -- start 2024-01-17T23:00:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- start start 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc0c7dc0 0x7f4ccc06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ccc0c9060 0x7f4ccc06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc06d170 con 0x7f4ccc151840 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc1f28b0 con 0x7f4ccc0c9060 2024-01-17T23:00:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.159+0000 7f4cd2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc1f2b90 con 0x7f4ccc0c7dc0 2024-01-17T23:00:37.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.163+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.163+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53918/0 (socket says 172.21.15.67:53918) 2024-01-17T23:00:37.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.163+0000 7f4ccbe00640 1 -- 172.21.15.67:0/4115145843 learned_addr learned my addr 172.21.15.67:0/4115145843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:37.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.163+0000 7f4ccaa00640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ccc0c9060 0x7f4ccc06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.163+0000 7f4ccb400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc0c7dc0 0x7f4ccc06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 -- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc0c7dc0 msgr2=0x7f4ccc06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc0c7dc0 0x7f4ccc06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 -- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ccc0c9060 msgr2=0x7f4ccc06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ccc0c9060 0x7f4ccc06cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 -- 172.21.15.67:0/4115145843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc0094d0 con 0x7f4ccc151840 2024-01-17T23:00:37.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.167+0000 7f4ccbe00640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c730 tx=0x7f4cc400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4003b80 con 0x7f4ccc151840 2024-01-17T23:00:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc4003ce0 con 0x7f4ccc151840 2024-01-17T23:00:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400aa30 con 0x7f4ccc151840 2024-01-17T23:00:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc1f2e70 con 0x7f4ccc151840 2024-01-17T23:00:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc1f3430 con 0x7f4ccc151840 2024-01-17T23:00:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.171+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc0746a0 con 0x7f4ccc151840 2024-01-17T23:00:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.191+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4cc400ab90 con 0x7f4ccc151840 2024-01-17T23:00:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.195+0000 7f4cc3400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 0x7f4ca4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.195+0000 7f4ccb400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 0x7f4ca4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.195+0000 7f4ccb400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 0x7f4ca4068d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0b2000 tx=0x7f4cbc009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.195+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4cc400ae40 con 0x7f4ccc151840 2024-01-17T23:00:37.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.443+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4cc40519b0 con 0x7f4ccc151840 2024-01-17T23:00:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.607+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ccc0c2960 con 0x7f4ccc151840 2024-01-17T23:00:37.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.611+0000 7f4cc3400640 1 -- 172.21.15.67:0/4115145843 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ccc0c2960 con 0x7f4ccc151840 2024-01-17T23:00:37.618 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 msgr2=0x7f4ca4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 0x7f4ca4068d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0b2000 tx=0x7f4cbc009040 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 msgr2=0x7f4ccc152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c730 tx=0x7f4cc400cbf0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 shutdown_connections 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4ca4066890 0x7f4ca4068d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ccc151840 0x7f4ccc152490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ccc0c9060 0x7f4ccc06cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 --2- 172.21.15.67:0/4115145843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4ccc0c7dc0 0x7f4ccc06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 >> 172.21.15.67:0/4115145843 conn(0x7f4ccc061100 msgr2=0x7f4ccc155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 shutdown_connections 2024-01-17T23:00:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.615+0000 7f4cd2400640 1 -- 172.21.15.67:0/4115145843 wait complete. 2024-01-17T23:00:37.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T23:00:37.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.779+0000 7fee49800640 1 Processor -- start 2024-01-17T23:00:37.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.779+0000 7fee49800640 1 -- start start 2024-01-17T23:00:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee49800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fee441516c0 0x7fee4406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee49800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee440c5cc0 con 0x7fee440c6e90 2024-01-17T23:00:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee49800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee441575b0 con 0x7fee4406e090 2024-01-17T23:00:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee49800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee44158410 con 0x7fee441516c0 2024-01-17T23:00:37.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee42000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fee4406e090 0x7fee440c6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:54250/0 (socket says 172.21.15.67:54250) 2024-01-17T23:00:37.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.783+0000 7fee42000640 1 -- 172.21.15.67:0/2501145974 learned_addr learned my addr 172.21.15.67:0/2501145974 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:37.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.791+0000 7fee42a00640 1 --2- 172.21.15.67:0/2501145974 >> v2:172.21.15.67:3300/0 conn(0x7fee441516c0 0x7fee4406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.839+0000 7fee42a00640 1 -- 172.21.15.67:0/2501145974 >> v1:172.21.15.137:6789/0 conn(0x7fee4406e090 legacy=0x7fee440c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.839+0000 7fee42a00640 1 -- 172.21.15.67:0/2501145974 >> v1:172.21.15.67:6789/0 conn(0x7fee440c6e90 legacy=0x7fee440b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.839+0000 7fee42a00640 1 -- 172.21.15.67:0/2501145974 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44157890 con 0x7fee441516c0 2024-01-17T23:00:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.843+0000 7fee42a00640 1 --2- 172.21.15.67:0/2501145974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee441516c0 0x7fee4406db50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee340097c0 tx=0x7fee3401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ad3e3cf4ef385 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.847+0000 7fee41600640 1 -- 172.21.15.67:0/2501145974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee340a8930 con 0x7fee441516c0 2024-01-17T23:00:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.847+0000 7fee41600640 1 -- 172.21.15.67:0/2501145974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee340a8a90 con 0x7fee441516c0 2024-01-17T23:00:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.847+0000 7fee41600640 1 -- 172.21.15.67:0/2501145974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee340a8e20 con 0x7fee441516c0 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- 172.21.15.67:0/2501145974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee441516c0 msgr2=0x7fee4406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 --2- 172.21.15.67:0/2501145974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee441516c0 0x7fee4406db50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee340097c0 tx=0x7fee3401ec30 comp rx=0 tx=0).stop 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- 172.21.15.67:0/2501145974 shutdown_connections 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 --2- 172.21.15.67:0/2501145974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee441516c0 0x7fee4406db50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- 172.21.15.67:0/2501145974 >> 172.21.15.67:0/2501145974 conn(0x7fee440c7a90 msgr2=0x7fee440c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- 172.21.15.67:0/2501145974 shutdown_connections 2024-01-17T23:00:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- 172.21.15.67:0/2501145974 wait complete. 2024-01-17T23:00:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 Processor -- start 2024-01-17T23:00:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- start start 2024-01-17T23:00:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4406e090 0x7fee441509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee441516c0 0x7fee44154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440c3cf0 con 0x7fee440c6e90 2024-01-17T23:00:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440c4f30 con 0x7fee4406e090 2024-01-17T23:00:37.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.851+0000 7fee49800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4406d8c0 con 0x7fee441516c0 2024-01-17T23:00:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.855+0000 7fee42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.855+0000 7fee42000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53936/0 (socket says 172.21.15.67:53936) 2024-01-17T23:00:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.855+0000 7fee42000640 1 -- 172.21.15.67:0/2736461607 learned_addr learned my addr 172.21.15.67:0/2736461607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:37.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 -- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee441516c0 msgr2=0x7fee44154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee441516c0 0x7fee44154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 -- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4406e090 msgr2=0x7fee441509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:37.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4406e090 0x7fee441509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:37.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 -- 172.21.15.67:0/2736461607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34009420 con 0x7fee440c6e90 2024-01-17T23:00:37.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.859+0000 7fee42000640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00c420 tx=0x7fee2c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.863+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c005cf0 con 0x7fee440c6e90 2024-01-17T23:00:37.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.863+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c005e50 con 0x7fee440c6e90 2024-01-17T23:00:37.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.863+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0072f0 con 0x7fee440c6e90 2024-01-17T23:00:37.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.863+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee44150ee0 con 0x7fee440c6e90 2024-01-17T23:00:37.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.863+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee440c4590 con 0x7fee440c6e90 2024-01-17T23:00:37.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.867+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee440c5070 con 0x7fee440c6e90 2024-01-17T23:00:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.883+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fee2c007450 con 0x7fee440c6e90 2024-01-17T23:00:37.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.887+0000 7fee3aa00640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 0x7fee1c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:37.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.887+0000 7fee42a00640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 0x7fee1c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:37.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.887+0000 7fee42a00640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 0x7fee1c068d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee340b2000 tx=0x7fee34004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:37.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:37.887+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fee2c013e70 con 0x7fee440c6e90 2024-01-17T23:00:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.143+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fee2c050f40 con 0x7fee440c6e90 2024-01-17T23:00:38.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.307+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee440c5070 con 0x7fee440c6e90 2024-01-17T23:00:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee3aa00640 1 -- 172.21.15.67:0/2736461607 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee440c5070 con 0x7fee440c6e90 2024-01-17T23:00:38.321 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:00:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 msgr2=0x7fee1c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 0x7fee1c068d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee340b2000 tx=0x7fee34004740 comp rx=0 tx=0).stop 2024-01-17T23:00:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 msgr2=0x7fee440c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00c420 tx=0x7fee2c00c8e0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 shutdown_connections 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fee1c066890 0x7fee1c068d50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fee441516c0 0x7fee44154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee440c6e90 0x7fee440c5350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 --2- 172.21.15.67:0/2736461607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4406e090 0x7fee441509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 >> 172.21.15.67:0/2736461607 conn(0x7fee440c7a90 msgr2=0x7fee4414a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 shutdown_connections 2024-01-17T23:00:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.315+0000 7fee49800640 1 -- 172.21.15.67:0/2736461607 wait complete. 2024-01-17T23:00:38.345 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-17T23:00:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.479+0000 7f4983600640 1 Processor -- start 2024-01-17T23:00:38.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.479+0000 7f4983600640 1 -- start start 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.479+0000 7f4983600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c1517a0 0x7f497c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4983600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f497c157bc0 0x7f497c158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4983600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c158550 con 0x7f497c06d210 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4983600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c15b9c0 con 0x7f497c157bc0 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4983600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c15ae40 con 0x7f497c1517a0 2024-01-17T23:00:38.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4981600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f497c157bc0 0x7f497c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4980c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c1517a0 0x7f497c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4981600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f497c157bc0 0x7f497c158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53950/0 (socket says 172.21.15.67:53950) 2024-01-17T23:00:38.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.483+0000 7f4981600640 1 -- 172.21.15.67:0/4098220646 learned_addr learned my addr 172.21.15.67:0/4098220646 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:38.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.487+0000 7f4981600640 1 -- 172.21.15.67:0/4098220646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c1517a0 msgr2=0x7f497c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:38.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.487+0000 7f4981600640 1 --2- 172.21.15.67:0/4098220646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c1517a0 0x7f497c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.487+0000 7f4981600640 1 -- 172.21.15.67:0/4098220646 >> v1:172.21.15.67:6789/0 conn(0x7f497c06d210 legacy=0x7f497c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.487+0000 7f4981600640 1 -- 172.21.15.67:0/4098220646 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c15b120 con 0x7f497c157bc0 2024-01-17T23:00:38.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.491+0000 7f4981600640 1 --2- 172.21.15.67:0/4098220646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c157bc0 0x7f497c158010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4974009e50 tx=0x7f497401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48bbce832125b18 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f497b400640 1 -- 172.21.15.67:0/4098220646 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740a58a0 con 0x7f497c157bc0 2024-01-17T23:00:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f497b400640 1 -- 172.21.15.67:0/4098220646 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49740a5a00 con 0x7f497c157bc0 2024-01-17T23:00:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f497b400640 1 -- 172.21.15.67:0/4098220646 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740a5d90 con 0x7f497c157bc0 2024-01-17T23:00:38.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 -- 172.21.15.67:0/4098220646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c157bc0 msgr2=0x7f497c158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 --2- 172.21.15.67:0/4098220646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c157bc0 0x7f497c158010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4974009e50 tx=0x7f497401c9e0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 -- 172.21.15.67:0/4098220646 shutdown_connections 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 --2- 172.21.15.67:0/4098220646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c157bc0 0x7f497c158010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 --2- 172.21.15.67:0/4098220646 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c1517a0 0x7f497c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 -- 172.21.15.67:0/4098220646 >> 172.21.15.67:0/4098220646 conn(0x7f497c0cb070 msgr2=0x7f497c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 -- 172.21.15.67:0/4098220646 shutdown_connections 2024-01-17T23:00:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.495+0000 7f4983600640 1 -- 172.21.15.67:0/4098220646 wait complete. 2024-01-17T23:00:38.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 Processor -- start 2024-01-17T23:00:38.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 -- start start 2024-01-17T23:00:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f497c06d210 0x7f497c0c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c157bc0 0x7f497c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c159d60 con 0x7f497c1517a0 2024-01-17T23:00:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c1f6160 con 0x7f497c06d210 2024-01-17T23:00:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4983600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c159300 con 0x7f497c157bc0 2024-01-17T23:00:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f497be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f497be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53954/0 (socket says 172.21.15.67:53954) 2024-01-17T23:00:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f497be00640 1 -- 172.21.15.67:0/720499389 learned_addr learned my addr 172.21.15.67:0/720499389 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4981600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c157bc0 0x7f497c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.499+0000 7f4980c00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f497c06d210 0x7f497c0c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.503+0000 7f497be00640 1 -- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c157bc0 msgr2=0x7f497c14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.503+0000 7f497be00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c157bc0 0x7f497c14af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.503+0000 7f497be00640 1 -- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f497c06d210 msgr2=0x7f497c0c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.503+0000 7f497be00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f497c06d210 0x7f497c0c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.503+0000 7f497be00640 1 -- 172.21.15.67:0/720499389 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009b30 con 0x7f497c1517a0 2024-01-17T23:00:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.507+0000 7f497be00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f496400c370 tx=0x7f496400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:38.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49640052d0 con 0x7f497c1517a0 2024-01-17T23:00:38.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964005430 con 0x7f497c1517a0 2024-01-17T23:00:38.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964007260 con 0x7f497c1517a0 2024-01-17T23:00:38.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0c1e10 con 0x7f497c1517a0 2024-01-17T23:00:38.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c1589d0 con 0x7f497c1517a0 2024-01-17T23:00:38.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.511+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c0746a0 con 0x7f497c1517a0 2024-01-17T23:00:38.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.531+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f49640073c0 con 0x7f497c1517a0 2024-01-17T23:00:38.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.531+0000 7f4978c00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 0x7f4954068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:38.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.531+0000 7f4980c00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 0x7f4954068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:38.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.531+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4964007670 con 0x7f497c1517a0 2024-01-17T23:00:38.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.535+0000 7f4980c00640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 0x7f4954068d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f496c009ac0 tx=0x7f496c009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:38.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.779+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4964050ab0 con 0x7f497c1517a0 2024-01-17T23:00:38.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.955+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f497c158550 con 0x7f497c1517a0 2024-01-17T23:00:38.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.959+0000 7f4978c00640 1 -- 172.21.15.67:0/720499389 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f497c158550 con 0x7f497c1517a0 2024-01-17T23:00:38.967 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 msgr2=0x7f4954068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 0x7f4954068d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f496c009ac0 tx=0x7f496c009190 comp rx=0 tx=0).stop 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 msgr2=0x7f497c1f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f496400c370 tx=0x7f496400c830 comp rx=0 tx=0).stop 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 shutdown_connections 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4954066890 0x7f4954068d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f497c157bc0 0x7f497c14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f497c1517a0 0x7f497c1f5c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 --2- 172.21.15.67:0/720499389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f497c06d210 0x7f497c0c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 >> 172.21.15.67:0/720499389 conn(0x7f497c0cb070 msgr2=0x7f497c14e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 shutdown_connections 2024-01-17T23:00:38.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:38.963+0000 7f4983600640 1 -- 172.21.15.67:0/720499389 wait complete. 2024-01-17T23:00:38.989 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T23:00:38.989 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T23:00:38.998 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:39.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.175+0000 7f5d36000640 1 Processor -- start 2024-01-17T23:00:39.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.175+0000 7f5d36000640 1 -- start start 2024-01-17T23:00:39.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d36000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d300c3830 0x7f5d300cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d36000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300c2260 con 0x7f5d300b0ff0 2024-01-17T23:00:39.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d36000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300c33a0 con 0x7f5d301515a0 2024-01-17T23:00:39.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d36000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d300cd370 con 0x7f5d300c3830 2024-01-17T23:00:39.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d2ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d300c3830 0x7f5d300cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d2ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5d300c3830 0x7f5d300cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53958/0 (socket says 172.21.15.67:53958) 2024-01-17T23:00:39.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.179+0000 7f5d2ea00640 1 -- 172.21.15.67:0/1116938230 learned_addr learned my addr 172.21.15.67:0/1116938230 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.183+0000 7f5d2ea00640 1 -- 172.21.15.67:0/1116938230 >> v1:172.21.15.137:6789/0 conn(0x7f5d301515a0 legacy=0x7f5d300c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.183+0000 7f5d2ea00640 1 -- 172.21.15.67:0/1116938230 >> v1:172.21.15.67:6789/0 conn(0x7f5d300b0ff0 legacy=0x7f5d30161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.183+0000 7f5d2ea00640 1 -- 172.21.15.67:0/1116938230 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300b1440 con 0x7f5d300c3830 2024-01-17T23:00:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.191+0000 7f5d2ea00640 1 --2- 172.21.15.67:0/1116938230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d300c3830 0x7f5d300cd560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009870 tx=0x7f5d1801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a799dc122e3644f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d2e000640 1 -- 172.21.15.67:0/1116938230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180a8a30 con 0x7f5d300c3830 2024-01-17T23:00:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d2e000640 1 -- 172.21.15.67:0/1116938230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d180a8b90 con 0x7f5d300c3830 2024-01-17T23:00:39.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d2e000640 1 -- 172.21.15.67:0/1116938230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180b0440 con 0x7f5d300c3830 2024-01-17T23:00:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- 172.21.15.67:0/1116938230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d300c3830 msgr2=0x7f5d300cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 --2- 172.21.15.67:0/1116938230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d300c3830 0x7f5d300cd560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009870 tx=0x7f5d1801ed30 comp rx=0 tx=0).stop 2024-01-17T23:00:39.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- 172.21.15.67:0/1116938230 shutdown_connections 2024-01-17T23:00:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 --2- 172.21.15.67:0/1116938230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d300c3830 0x7f5d300cd560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- 172.21.15.67:0/1116938230 >> 172.21.15.67:0/1116938230 conn(0x7f5d30061100 msgr2=0x7f5d30061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- 172.21.15.67:0/1116938230 shutdown_connections 2024-01-17T23:00:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- 172.21.15.67:0/1116938230 wait complete. 2024-01-17T23:00:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 Processor -- start 2024-01-17T23:00:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.203+0000 7f5d36000640 1 -- start start 2024-01-17T23:00:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d300b0ff0 0x7f5d300af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d300c3830 0x7f5d300acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301f3870 con 0x7f5d301515a0 2024-01-17T23:00:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300ad5a0 con 0x7f5d300b0ff0 2024-01-17T23:00:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d36000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301f2ab0 con 0x7f5d300c3830 2024-01-17T23:00:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d2f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d300b0ff0 0x7f5d300af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d2fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d2fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53974/0 (socket says 172.21.15.67:53974) 2024-01-17T23:00:39.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d2fe00640 1 -- 172.21.15.67:0/179035151 learned_addr learned my addr 172.21.15.67:0/179035151 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:39.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.207+0000 7f5d2ea00640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d300c3830 0x7f5d300acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.211+0000 7f5d2fe00640 1 -- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d300c3830 msgr2=0x7f5d300acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.211+0000 7f5d2fe00640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d300c3830 0x7f5d300acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.211+0000 7f5d2fe00640 1 -- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d300b0ff0 msgr2=0x7f5d300af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.211+0000 7f5d2fe00640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d300b0ff0 0x7f5d300af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.211+0000 7f5d2fe00640 1 -- 172.21.15.67:0/179035151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180094d0 con 0x7f5d301515a0 2024-01-17T23:00:39.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.215+0000 7f5d2fe00640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c770 tx=0x7f5d2800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.219+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28003b80 con 0x7f5d301515a0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.223+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28003ce0 con 0x7f5d301515a0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.223+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d301f2d90 con 0x7f5d301515a0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.223+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800aa90 con 0x7f5d301515a0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.223+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d301f3350 con 0x7f5d301515a0 2024-01-17T23:00:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.223+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d301f3570 con 0x7f5d301515a0 2024-01-17T23:00:39.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.531+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5d2800abf0 con 0x7f5d301515a0 2024-01-17T23:00:39.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.531+0000 7f5d27400640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 0x7f5d08068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.531+0000 7f5d2f400640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 0x7f5d08068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.531+0000 7f5d2f400640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 0x7f5d08068d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001770 tx=0x7f5d20009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:39.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.543+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5d28055f80 con 0x7f5d301515a0 2024-01-17T23:00:39.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.543+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5d28051bc0 con 0x7f5d301515a0 2024-01-17T23:00:39.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.707+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d300746a0 con 0x7f5d301515a0 2024-01-17T23:00:39.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d27400640 1 -- 172.21.15.67:0/179035151 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f5d280551e0 con 0x7f5d301515a0 2024-01-17T23:00:39.757 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:39.757 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 msgr2=0x7f5d08068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 0x7f5d08068d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001770 tx=0x7f5d20009040 comp rx=0 tx=0).stop 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 msgr2=0x7f5d30156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c770 tx=0x7f5d2800cc30 comp rx=0 tx=0).stop 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 shutdown_connections 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5d080668c0 0x7f5d08068d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d301515a0 0x7f5d30156820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5d300c3830 0x7f5d300acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 --2- 172.21.15.67:0/179035151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d300b0ff0 0x7f5d300af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 >> 172.21.15.67:0/179035151 conn(0x7f5d30061100 msgr2=0x7f5d300b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 shutdown_connections 2024-01-17T23:00:39.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.751+0000 7f5d36000640 1 -- 172.21.15.67:0/179035151 wait complete. 2024-01-17T23:00:39.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T23:00:15.126108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T23:00:16.891955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T23:00:22.346907+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T23:00:39.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T23:00:39.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.915+0000 7fdaca800640 1 Processor -- start 2024-01-17T23:00:39.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.915+0000 7fdaca800640 1 -- start start 2024-01-17T23:00:39.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.915+0000 7fdaca800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdac41516c0 0x7fdac406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.915+0000 7fdaca800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdaca800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40c7120 con 0x7fdac40c6cc0 2024-01-17T23:00:39.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdaca800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac4158410 con 0x7fdac41516c0 2024-01-17T23:00:39.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdaca800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41573c0 con 0x7fdac406e090 2024-01-17T23:00:39.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdac2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdac3400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdac41516c0 0x7fdac406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdac2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:44544/0 (socket says 172.21.15.67:44544) 2024-01-17T23:00:39.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.919+0000 7fdac2a00640 1 -- 172.21.15.67:0/37462897 learned_addr learned my addr 172.21.15.67:0/37462897 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:39.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.927+0000 7fdac2a00640 1 -- 172.21.15.67:0/37462897 >> v2:172.21.15.137:3300/0 conn(0x7fdac41516c0 msgr2=0x7fdac406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.927+0000 7fdac2a00640 1 --2- 172.21.15.67:0/37462897 >> v2:172.21.15.137:3300/0 conn(0x7fdac41516c0 0x7fdac406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.927+0000 7fdac2a00640 1 -- 172.21.15.67:0/37462897 >> v1:172.21.15.137:6789/0 conn(0x7fdac40c6cc0 legacy=0x7fdac40b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.927+0000 7fdac2a00640 1 -- 172.21.15.67:0/37462897 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40c5cc0 con 0x7fdac406e090 2024-01-17T23:00:39.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.935+0000 7fdac2a00640 1 --2- 172.21.15.67:0/37462897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4ab02d71c4470 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:39.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdac2000640 1 -- 172.21.15.67:0/37462897 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0a8a30 con 0x7fdac406e090 2024-01-17T23:00:39.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdac2000640 1 -- 172.21.15.67:0/37462897 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0a8b90 con 0x7fdac406e090 2024-01-17T23:00:39.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdac2000640 1 -- 172.21.15.67:0/37462897 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0b0440 con 0x7fdac406e090 2024-01-17T23:00:39.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 -- 172.21.15.67:0/37462897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 msgr2=0x7fdac40c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 --2- 172.21.15.67:0/37462897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac01ed30 comp rx=0 tx=0).stop 2024-01-17T23:00:39.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 -- 172.21.15.67:0/37462897 shutdown_connections 2024-01-17T23:00:39.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 --2- 172.21.15.67:0/37462897 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac406e090 0x7fdac40c6780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 --2- 172.21.15.67:0/37462897 >> v2:172.21.15.137:3300/0 conn(0x7fdac41516c0 0x7fdac406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 -- 172.21.15.67:0/37462897 >> 172.21.15.67:0/37462897 conn(0x7fdac40c7a90 msgr2=0x7fdac40c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:39.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 -- 172.21.15.67:0/37462897 shutdown_connections 2024-01-17T23:00:39.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.943+0000 7fdaca800640 1 -- 172.21.15.67:0/37462897 wait complete. 2024-01-17T23:00:39.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 Processor -- start 2024-01-17T23:00:39.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 -- start start 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac406e090 0x7fdac4150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac40c6cc0 0x7fdac41509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40c48d0 con 0x7fdac41516c0 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40c4e00 con 0x7fdac406e090 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdaca800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac414ff60 con 0x7fdac40c6cc0 2024-01-17T23:00:39.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdac3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdac3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53990/0 (socket says 172.21.15.67:53990) 2024-01-17T23:00:39.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdac3e00640 1 -- 172.21.15.67:0/3892258866 learned_addr learned my addr 172.21.15.67:0/3892258866 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:39.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdac2a00640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac40c6cc0 0x7fdac41509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.947+0000 7fdac3400640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac406e090 0x7fdac4150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.951+0000 7fdac3e00640 1 -- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac40c6cc0 msgr2=0x7fdac41509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.951+0000 7fdac3e00640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac40c6cc0 0x7fdac41509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.951+0000 7fdac3e00640 1 -- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac406e090 msgr2=0x7fdac4150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:39.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.951+0000 7fdac3e00640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac406e090 0x7fdac4150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:39.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.951+0000 7fdac3e00640 1 -- 172.21.15.67:0/3892258866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0094d0 con 0x7fdac41516c0 2024-01-17T23:00:39.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.955+0000 7fdac3e00640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c770 tx=0x7fdabc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:39.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc003b80 con 0x7fdac41516c0 2024-01-17T23:00:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc003ce0 con 0x7fdac41516c0 2024-01-17T23:00:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00aa90 con 0x7fdac41516c0 2024-01-17T23:00:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac40c4b20 con 0x7fdac41516c0 2024-01-17T23:00:39.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac414f5b0 con 0x7fdac41516c0 2024-01-17T23:00:39.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.959+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40c28c0 con 0x7fdac41516c0 2024-01-17T23:00:39.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.979+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fdabc00abf0 con 0x7fdac41516c0 2024-01-17T23:00:39.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.983+0000 7fdabb400640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 0x7fda9c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:39.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.983+0000 7fdac3400640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 0x7fda9c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:39.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:39.983+0000 7fdac3400640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 0x7fda9c068d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009ac0 tx=0x7fdab4009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:40.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.227+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdabc0558a0 con 0x7fdac41516c0 2024-01-17T23:00:40.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.227+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fdabc051be0 con 0x7fdac41516c0 2024-01-17T23:00:40.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.395+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdac4150120 con 0x7fdac41516c0 2024-01-17T23:00:40.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.439+0000 7fdabb400640 1 -- 172.21.15.67:0/3892258866 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdabc055200 con 0x7fdac41516c0 2024-01-17T23:00:40.445 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.439+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 msgr2=0x7fda9c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.439+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 0x7fda9c068d50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009ac0 tx=0x7fdab4009190 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.439+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 msgr2=0x7fdac4148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.439+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c770 tx=0x7fdabc00cc30 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 shutdown_connections 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fda9c066890 0x7fda9c068d50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdac41516c0 0x7fdac4148680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fdac40c6cc0 0x7fdac41509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 --2- 172.21.15.67:0/3892258866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdac406e090 0x7fdac4150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 >> 172.21.15.67:0/3892258866 conn(0x7fdac40c7a90 msgr2=0x7fdac41562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:40.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 shutdown_connections 2024-01-17T23:00:40.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.443+0000 7fdaca800640 1 -- 172.21.15.67:0/3892258866 wait complete. 2024-01-17T23:00:40.468 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T23:00:40.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.603+0000 7fac5cc00640 1 Processor -- start 2024-01-17T23:00:40.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.603+0000 7fac5cc00640 1 -- start start 2024-01-17T23:00:40.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac5cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac5806db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac5cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac580c6e90 0x7fac580b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac5cc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580c5cc0 con 0x7fac5806e090 2024-01-17T23:00:40.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac5cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac58158410 con 0x7fac580c6e90 2024-01-17T23:00:40.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac5cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac581573c0 con 0x7fac581516c0 2024-01-17T23:00:40.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac56800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac580c6e90 0x7fac580b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac55e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac5806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac56800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fac580c6e90 0x7fac580b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34782/0 (socket says 172.21.15.67:34782) 2024-01-17T23:00:40.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.607+0000 7fac56800640 1 -- 172.21.15.67:0/729847992 learned_addr learned my addr 172.21.15.67:0/729847992 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:40.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.611+0000 7fac56800640 1 -- 172.21.15.67:0/729847992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 msgr2=0x7fac5806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:40.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.611+0000 7fac56800640 1 --2- 172.21.15.67:0/729847992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac5806db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.611+0000 7fac56800640 1 -- 172.21.15.67:0/729847992 >> v1:172.21.15.67:6789/0 conn(0x7fac5806e090 legacy=0x7fac580c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.611+0000 7fac56800640 1 -- 172.21.15.67:0/729847992 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac581575b0 con 0x7fac580c6e90 2024-01-17T23:00:40.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.615+0000 7fac56800640 1 --2- 172.21.15.67:0/729847992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac580b0640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac50009e50 tx=0x7fac5001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c7b90f15707f14 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:40.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac54a00640 1 -- 172.21.15.67:0/729847992 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac500af400 con 0x7fac580c6e90 2024-01-17T23:00:40.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac54a00640 1 -- 172.21.15.67:0/729847992 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac500ab050 con 0x7fac580c6e90 2024-01-17T23:00:40.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac54a00640 1 -- 172.21.15.67:0/729847992 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac500af780 con 0x7fac580c6e90 2024-01-17T23:00:40.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- 172.21.15.67:0/729847992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 msgr2=0x7fac580b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 --2- 172.21.15.67:0/729847992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac580b0640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac50009e50 tx=0x7fac5001f1f0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- 172.21.15.67:0/729847992 shutdown_connections 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 --2- 172.21.15.67:0/729847992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac580b0640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 --2- 172.21.15.67:0/729847992 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac5806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- 172.21.15.67:0/729847992 >> 172.21.15.67:0/729847992 conn(0x7fac580c7a90 msgr2=0x7fac580c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- 172.21.15.67:0/729847992 shutdown_connections 2024-01-17T23:00:40.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- 172.21.15.67:0/729847992 wait complete. 2024-01-17T23:00:40.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 Processor -- start 2024-01-17T23:00:40.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.619+0000 7fac5cc00640 1 -- start start 2024-01-17T23:00:40.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5806e090 0x7fac580c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac581eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5814c0b0 con 0x7fac580c6e90 2024-01-17T23:00:40.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac581f2e00 con 0x7fac5806e090 2024-01-17T23:00:40.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac5cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac580c4870 con 0x7fac581516c0 2024-01-17T23:00:40.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac55400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac55400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34790/0 (socket says 172.21.15.67:34790) 2024-01-17T23:00:40.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac55400640 1 -- 172.21.15.67:0/747560821 learned_addr learned my addr 172.21.15.67:0/747560821 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:40.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac56800640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac581eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.623+0000 7fac55e00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5806e090 0x7fac580c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.627+0000 7fac55400640 1 -- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 msgr2=0x7fac581eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.627+0000 7fac55400640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac581eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.627+0000 7fac55400640 1 -- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5806e090 msgr2=0x7fac580c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:40.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.627+0000 7fac55400640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5806e090 0x7fac580c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:40.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.627+0000 7fac55400640 1 -- 172.21.15.67:0/747560821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50009b30 con 0x7fac580c6e90 2024-01-17T23:00:40.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.631+0000 7fac55400640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c370 tx=0x7fac4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400052d0 con 0x7fac580c6e90 2024-01-17T23:00:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40005430 con 0x7fac580c6e90 2024-01-17T23:00:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40007260 con 0x7fac580c6e90 2024-01-17T23:00:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac581569a0 con 0x7fac580c6e90 2024-01-17T23:00:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5814bdd0 con 0x7fac580c6e90 2024-01-17T23:00:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.635+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac580c28c0 con 0x7fac580c6e90 2024-01-17T23:00:40.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.891+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fac400073c0 con 0x7fac580c6e90 2024-01-17T23:00:40.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.891+0000 7fac4e000640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 0x7fac30068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:40.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.891+0000 7fac55e00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 0x7fac30068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:40.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.891+0000 7fac55e00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 0x7fac30068d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac48009b60 tx=0x7fac48009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:40.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.903+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac400548b0 con 0x7fac580c6e90 2024-01-17T23:00:40.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:40.903+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fac40050bf0 con 0x7fac580c6e90 2024-01-17T23:00:41.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.063+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac581f2f40 con 0x7fac580c6e90 2024-01-17T23:00:41.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac4e000640 1 -- 172.21.15.67:0/747560821 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac40054210 con 0x7fac580c6e90 2024-01-17T23:00:41.076 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:00:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 msgr2=0x7fac30068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 0x7fac30068d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac48009b60 tx=0x7fac48009190 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 msgr2=0x7fac5814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c370 tx=0x7fac4000c830 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 shutdown_connections 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fac300668c0 0x7fac30068d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fac581516c0 0x7fac581eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fac580c6e90 0x7fac5814acc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 --2- 172.21.15.67:0/747560821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5806e090 0x7fac580c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 >> 172.21.15.67:0/747560821 conn(0x7fac580c7a90 msgr2=0x7fac58071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 shutdown_connections 2024-01-17T23:00:41.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.071+0000 7fac5cc00640 1 -- 172.21.15.67:0/747560821 wait complete. 2024-01-17T23:00:41.098 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T23:00:41.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.235+0000 7f00b7400640 1 Processor -- start 2024-01-17T23:00:41.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.235+0000 7f00b7400640 1 -- start start 2024-01-17T23:00:41.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00b7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f00b0153780 0x7f00b0159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00b7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0159c40 con 0x7f00b00ca2f0 2024-01-17T23:00:41.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00b7400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0159f20 con 0x7f00b015d410 2024-01-17T23:00:41.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00b7400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b0153b60 con 0x7f00b0153780 2024-01-17T23:00:41.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00afe00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f00b00ca2f0 0x7f00b006c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54280/0 (socket says 172.21.15.67:54280) 2024-01-17T23:00:41.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.239+0000 7f00afe00640 1 -- 172.21.15.67:0/2871993477 learned_addr learned my addr 172.21.15.67:0/2871993477 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:41.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.243+0000 7f00b4a00640 1 --2- 172.21.15.67:0/2871993477 >> v2:172.21.15.137:3300/0 conn(0x7f00b0153780 0x7f00b0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.243+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891357463 0 0) 0x7f00b0159c40 con 0x7f00b00ca2f0 2024-01-17T23:00:41.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.243+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0090003530 con 0x7f00b00ca2f0 2024-01-17T23:00:41.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3549323290 0 0) 0x7f0090003530 con 0x7f00b00ca2f0 2024-01-17T23:00:41.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 >> v2:172.21.15.137:3300/0 conn(0x7f00b0153780 msgr2=0x7f00b0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 --2- 172.21.15.67:0/2871993477 >> v2:172.21.15.137:3300/0 conn(0x7f00b0153780 0x7f00b0159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 >> v1:172.21.15.137:6789/0 conn(0x7f00b015d410 legacy=0x7f00b0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b015a200 con 0x7f00b00ca2f0 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f0098001680 con 0x7f00b00ca2f0 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 >> v1:172.21.15.67:6789/0 conn(0x7f00b00ca2f0 legacy=0x7f00b006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00900039d0 0x7f0090003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00900047d0 0x7f0090004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 0x7f009000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0153b60 con 0x7f0090005190 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009000c070 con 0x7f00900047d0 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009000c230 con 0x7f00900039d0 2024-01-17T23:00:41.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00b4a00640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00900039d0 0x7f0090003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.247+0000 7f00b5400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 0x7f009000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.251+0000 7f00b5400640 1 -- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00900039d0 msgr2=0x7f0090003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.251+0000 7f00b5400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f00900039d0 0x7f0090003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.251+0000 7f00b5400640 1 -- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00900047d0 msgr2=0x7f0090004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.251+0000 7f00b5400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00900047d0 0x7f0090004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.251+0000 7f00b5400640 1 -- 172.21.15.67:0/2871993477 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090003530 con 0x7f0090005190 2024-01-17T23:00:41.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.255+0000 7f00b5400640 1 -- 172.21.15.67:0/2871993477 reap_dead start 2024-01-17T23:00:41.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.259+0000 7f00b5400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 0x7f009000b990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001e70 tx=0x7f00a801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffdf7acb5288812 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.259+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8003b80 con 0x7f0090005190 2024-01-17T23:00:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.259+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8003d00 con 0x7f0090005190 2024-01-17T23:00:41.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.259+0000 7f00af400640 1 -- 172.21.15.67:0/2871993477 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8005260 con 0x7f0090005190 2024-01-17T23:00:41.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 msgr2=0x7f009000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 0x7f009000b990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00a8001e70 tx=0x7f00a801c760 comp rx=0 tx=0).stop 2024-01-17T23:00:41.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- 172.21.15.67:0/2871993477 shutdown_connections 2024-01-17T23:00:41.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 --2- 172.21.15.67:0/2871993477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0090005190 0x7f009000b990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- 172.21.15.67:0/2871993477 >> 172.21.15.67:0/2871993477 conn(0x7f00b0070390 msgr2=0x7f00b006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:41.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- 172.21.15.67:0/2871993477 shutdown_connections 2024-01-17T23:00:41.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- 172.21.15.67:0/2871993477 wait complete. 2024-01-17T23:00:41.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 Processor -- start 2024-01-17T23:00:41.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- start start 2024-01-17T23:00:41.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0090005190 0x7f00b01e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b00af430 0x7f00b01e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01ef770 con 0x7f00b01e4390 2024-01-17T23:00:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01e2530 con 0x7f00b00af430 2024-01-17T23:00:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.263+0000 7f00b7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01ef3b0 con 0x7f0090005190 2024-01-17T23:00:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.267+0000 7f00b5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.267+0000 7f00b5400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34816/0 (socket says 172.21.15.67:34816) 2024-01-17T23:00:41.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.267+0000 7f00b5400640 1 -- 172.21.15.67:0/2166292707 learned_addr learned my addr 172.21.15.67:0/2166292707 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:41.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.267+0000 7f00b4a00640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0090005190 0x7f00b01e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.267+0000 7f00afe00640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b00af430 0x7f00b01e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 -- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0090005190 msgr2=0x7f00b01e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0090005190 0x7f00b01e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 -- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b00af430 msgr2=0x7f00b01e3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b00af430 0x7f00b01e3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 -- 172.21.15.67:0/2166292707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b01e4940 con 0x7f00b01e4390 2024-01-17T23:00:41.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.271+0000 7f00b5400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00a801cc40 tx=0x7f0090005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.275+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80ac070 con 0x7f00b01e4390 2024-01-17T23:00:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.275+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8003b90 con 0x7f00b01e4390 2024-01-17T23:00:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.275+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80057f0 con 0x7f00b01e4390 2024-01-17T23:00:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.275+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01e4c20 con 0x7f00b01e4390 2024-01-17T23:00:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.275+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01e51e0 con 0x7f00b01e4390 2024-01-17T23:00:41.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.279+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b01ef8b0 con 0x7f00b01e4390 2024-01-17T23:00:41.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.299+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f00a8006b60 con 0x7f00b01e4390 2024-01-17T23:00:41.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.299+0000 7f00acc00640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 0x7f0088068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.299+0000 7f00b4a00640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 0x7f0088068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.303+0000 7f00b4a00640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 0x7f0088068d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009b60 tx=0x7f00a0009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.551+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00a80edda0 con 0x7f00b01e4390 2024-01-17T23:00:41.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.551+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f00a80ea0e0 con 0x7f00b01e4390 2024-01-17T23:00:41.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.711+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00b01ef8b0 con 0x7f00b01e4390 2024-01-17T23:00:41.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00acc00640 1 -- 172.21.15.67:0/2166292707 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00b01ef8b0 con 0x7f00b01e4390 2024-01-17T23:00:41.725 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-01-17T23:00:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 msgr2=0x7f0088068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 0x7f0088068d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009b60 tx=0x7f00a0009190 comp rx=0 tx=0).stop 2024-01-17T23:00:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 msgr2=0x7f00b01efb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00a801cc40 tx=0x7f0090005800 comp rx=0 tx=0).stop 2024-01-17T23:00:41.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 shutdown_connections 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0088066870 0x7f0088068d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00b01e4390 0x7f00b01efb90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00b00af430 0x7f00b01e3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 --2- 172.21.15.67:0/2166292707 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0090005190 0x7f00b01e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 >> 172.21.15.67:0/2166292707 conn(0x7f00b0070390 msgr2=0x7f00b00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 shutdown_connections 2024-01-17T23:00:41.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.719+0000 7f00b7400640 1 -- 172.21.15.67:0/2166292707 wait complete. 2024-01-17T23:00:41.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T23:00:41.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.883+0000 7fd672000640 1 Processor -- start 2024-01-17T23:00:41.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.883+0000 7fd672000640 1 -- start start 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd672000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd66c1516c0 0x7fd66c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd672000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c0b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd672000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c0c5cc0 con 0x7fd66c06e090 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd672000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c158410 con 0x7fd66c1516c0 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd672000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c1573c0 con 0x7fd66c0c6e90 2024-01-17T23:00:41.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd66b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd66c1516c0 0x7fd66c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd66b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd66c1516c0 0x7fd66c06db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34822/0 (socket says 172.21.15.67:34822) 2024-01-17T23:00:41.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd66b400640 1 -- 172.21.15.67:0/1325998701 learned_addr learned my addr 172.21.15.67:0/1325998701 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:41.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.887+0000 7fd66be00640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c0b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.891+0000 7fd66b400640 1 -- 172.21.15.67:0/1325998701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 msgr2=0x7fd66c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.891+0000 7fd66b400640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c0b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.891+0000 7fd66b400640 1 -- 172.21.15.67:0/1325998701 >> v1:172.21.15.67:6789/0 conn(0x7fd66c06e090 legacy=0x7fd66c0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.891+0000 7fd66b400640 1 -- 172.21.15.67:0/1325998701 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c1575b0 con 0x7fd66c1516c0 2024-01-17T23:00:41.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.895+0000 7fd66b400640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c06db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009870 tx=0x7fd65c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3972638d2402eda1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd66a000640 1 -- 172.21.15.67:0/1325998701 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0a8a30 con 0x7fd66c1516c0 2024-01-17T23:00:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd66a000640 1 -- 172.21.15.67:0/1325998701 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c0a8b90 con 0x7fd66c1516c0 2024-01-17T23:00:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd66a000640 1 -- 172.21.15.67:0/1325998701 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0b0440 con 0x7fd66c1516c0 2024-01-17T23:00:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 -- 172.21.15.67:0/1325998701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 msgr2=0x7fd66c06db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c06db50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009870 tx=0x7fd65c01ed30 comp rx=0 tx=0).stop 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 -- 172.21.15.67:0/1325998701 shutdown_connections 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c0b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 --2- 172.21.15.67:0/1325998701 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c06db50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 -- 172.21.15.67:0/1325998701 >> 172.21.15.67:0/1325998701 conn(0x7fd66c0c7a90 msgr2=0x7fd66c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 -- 172.21.15.67:0/1325998701 shutdown_connections 2024-01-17T23:00:41.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.899+0000 7fd672000640 1 -- 172.21.15.67:0/1325998701 wait complete. 2024-01-17T23:00:41.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 Processor -- start 2024-01-17T23:00:41.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 -- start start 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c06e090 0x7fd66c1f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c1ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c14ff80 con 0x7fd66c1516c0 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c150790 con 0x7fd66c06e090 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd672000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c1501d0 con 0x7fd66c0c6e90 2024-01-17T23:00:41.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd66be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd66be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34836/0 (socket says 172.21.15.67:34836) 2024-01-17T23:00:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd66be00640 1 -- 172.21.15.67:0/4174053684 learned_addr learned my addr 172.21.15.67:0/4174053684 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd66b400640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c06e090 0x7fd66c1f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.903+0000 7fd66aa00640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c1ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.907+0000 7fd66be00640 1 -- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 msgr2=0x7fd66c1ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.907+0000 7fd66be00640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c1ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.907+0000 7fd66be00640 1 -- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c06e090 msgr2=0x7fd66c1f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:41.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.907+0000 7fd66be00640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c06e090 0x7fd66c1f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:41.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.907+0000 7fd66be00640 1 -- 172.21.15.67:0/4174053684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0094d0 con 0x7fd66c1516c0 2024-01-17T23:00:41.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.911+0000 7fd66be00640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd664009dd0 tx=0x7fd66400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664014480 con 0x7fd66c1516c0 2024-01-17T23:00:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400f040 con 0x7fd66c1516c0 2024-01-17T23:00:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664014840 con 0x7fd66c1516c0 2024-01-17T23:00:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c1504b0 con 0x7fd66c1516c0 2024-01-17T23:00:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c1ed430 con 0x7fd66c1516c0 2024-01-17T23:00:41.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.915+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c0c28c0 con 0x7fd66c1516c0 2024-01-17T23:00:41.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.935+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd6640149a0 con 0x7fd66c1516c0 2024-01-17T23:00:41.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.935+0000 7fd663400640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 0x7fd644068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:41.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.935+0000 7fd66b400640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 0x7fd644068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:41.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.939+0000 7fd66b400640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 0x7fd644068d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b2000 tx=0x7fd65c0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:41.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:41.939+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd664056680 con 0x7fd66c1516c0 2024-01-17T23:00:42.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.183+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd6640529c0 con 0x7fd66c1516c0 2024-01-17T23:00:42.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.339+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd66c0746a0 con 0x7fd66c1516c0 2024-01-17T23:00:42.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd663400640 1 -- 172.21.15.67:0/4174053684 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd664018030 con 0x7fd66c1516c0 2024-01-17T23:00:42.353 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 msgr2=0x7fd644068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 0x7fd644068d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b2000 tx=0x7fd65c0aa070 comp rx=0 tx=0).stop 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 msgr2=0x7fd66c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd664009dd0 tx=0x7fd66400c490 comp rx=0 tx=0).stop 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 shutdown_connections 2024-01-17T23:00:42.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd644066890 0x7fd644068d50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd66c1516c0 0x7fd66c152400 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd66c0c6e90 0x7fd66c1ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 --2- 172.21.15.67:0/4174053684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd66c06e090 0x7fd66c1f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 >> 172.21.15.67:0/4174053684 conn(0x7fd66c0c7a90 msgr2=0x7fd66c1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.347+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 shutdown_connections 2024-01-17T23:00:42.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.351+0000 7fd672000640 1 -- 172.21.15.67:0/4174053684 wait complete. 2024-01-17T23:00:42.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-17T23:00:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 Processor -- start 2024-01-17T23:00:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 -- start start 2024-01-17T23:00:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c153b10 0x7ff33c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33c15a560 0x7ff33c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff33c0c2f70 0x7ff33c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c159870 con 0x7ff33c15a560 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0c9b10 con 0x7ff33c0c2f70 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.511+0000 7ff341200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c3840 con 0x7ff33c153b10 2024-01-17T23:00:42.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33c15a560 0x7ff33c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff33c15a560 0x7ff33c0c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34844/0 (socket says 172.21.15.67:34844) 2024-01-17T23:00:42.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff33a800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff33c0c2f70 0x7ff33c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 -- 172.21.15.67:0/2811498151 learned_addr learned my addr 172.21.15.67:0/2811498151 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:42.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c153b10 0x7ff33c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 -- 172.21.15.67:0/2811498151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c153b10 msgr2=0x7ff33c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:42.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 --2- 172.21.15.67:0/2811498151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c153b10 0x7ff33c0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 -- 172.21.15.67:0/2811498151 >> v2:172.21.15.137:3300/0 conn(0x7ff33c0c2f70 msgr2=0x7ff33c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:42.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 --2- 172.21.15.67:0/2811498151 >> v2:172.21.15.137:3300/0 conn(0x7ff33c0c2f70 0x7ff33c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.515+0000 7ff339400640 1 -- 172.21.15.67:0/2811498151 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0c3b20 con 0x7ff33c15a560 2024-01-17T23:00:42.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.519+0000 7ff339400640 1 --2- 172.21.15.67:0/2811498151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c0c7ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06e5e0 tx=0x7ff32401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7799aeca36dfe8f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:42.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.523+0000 7ff338a00640 1 -- 172.21.15.67:0/2811498151 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240a89b0 con 0x7ff33c15a560 2024-01-17T23:00:42.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.523+0000 7ff338a00640 1 -- 172.21.15.67:0/2811498151 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3240a8b10 con 0x7ff33c15a560 2024-01-17T23:00:42.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.523+0000 7ff338a00640 1 -- 172.21.15.67:0/2811498151 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240a8ea0 con 0x7ff33c15a560 2024-01-17T23:00:42.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- 172.21.15.67:0/2811498151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 msgr2=0x7ff33c0c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:42.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- 172.21.15.67:0/2811498151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c0c7ca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06e5e0 tx=0x7ff32401ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- 172.21.15.67:0/2811498151 shutdown_connections 2024-01-17T23:00:42.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- 172.21.15.67:0/2811498151 >> v2:172.21.15.137:3300/0 conn(0x7ff33c0c2f70 0x7ff33c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- 172.21.15.67:0/2811498151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c0c7ca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- 172.21.15.67:0/2811498151 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c153b10 0x7ff33c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- 172.21.15.67:0/2811498151 >> 172.21.15.67:0/2811498151 conn(0x7ff33c061100 msgr2=0x7ff33c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- 172.21.15.67:0/2811498151 shutdown_connections 2024-01-17T23:00:42.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- 172.21.15.67:0/2811498151 wait complete. 2024-01-17T23:00:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 Processor -- start 2024-01-17T23:00:42.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- start start 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c0c2f70 0x7ff33c1f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c153b10 0x7ff33c1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1500f0 con 0x7ff33c15a560 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0aebb0 con 0x7ff33c153b10 2024-01-17T23:00:42.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.527+0000 7ff341200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0ad960 con 0x7ff33c0c2f70 2024-01-17T23:00:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.531+0000 7ff33a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.531+0000 7ff33a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34860/0 (socket says 172.21.15.67:34860) 2024-01-17T23:00:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.531+0000 7ff33a800640 1 -- 172.21.15.67:0/412859325 learned_addr learned my addr 172.21.15.67:0/412859325 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:42.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.531+0000 7ff339400640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c153b10 0x7ff33c1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 -- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c0c2f70 msgr2=0x7ff33c1f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:42.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c0c2f70 0x7ff33c1f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 -- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c153b10 msgr2=0x7ff33c1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:42.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c153b10 0x7ff33c1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:42.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 -- 172.21.15.67:0/412859325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240094d0 con 0x7ff33c15a560 2024-01-17T23:00:42.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.535+0000 7ff33a800640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ef00 tx=0x7ff33400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:42.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334010040 con 0x7ff33c15a560 2024-01-17T23:00:42.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c0c8c10 con 0x7ff33c15a560 2024-01-17T23:00:42.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0ad0c0 con 0x7ff33c15a560 2024-01-17T23:00:42.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c06d980 con 0x7ff33c15a560 2024-01-17T23:00:42.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400bcc0 con 0x7ff33c15a560 2024-01-17T23:00:42.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.539+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334026640 con 0x7ff33c15a560 2024-01-17T23:00:42.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.811+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ff3340267a0 con 0x7ff33c15a560 2024-01-17T23:00:42.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.815+0000 7ff332000640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 0x7ff314068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:42.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.815+0000 7ff339e00640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 0x7ff314068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:42.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.815+0000 7ff339e00640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 0x7ff314068d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06d3e0 tx=0x7ff32c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:42.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.831+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff334015e70 con 0x7ff33c15a560 2024-01-17T23:00:42.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:42.831+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7ff334052080 con 0x7ff33c15a560 2024-01-17T23:00:43.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.011+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff33c0746a0 con 0x7ff33c15a560 2024-01-17T23:00:43.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.015+0000 7ff332000640 1 -- 172.21.15.67:0/412859325 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3340556a0 con 0x7ff33c15a560 2024-01-17T23:00:43.023 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 msgr2=0x7ff314068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 0x7ff314068d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06d3e0 tx=0x7ff32c008040 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 msgr2=0x7ff33c14dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff33400ef00 tx=0x7ff33400b480 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 shutdown_connections 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ff314066870 0x7ff314068d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c15a560 0x7ff33c14dc40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff33c153b10 0x7ff33c1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 --2- 172.21.15.67:0/412859325 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ff33c0c2f70 0x7ff33c1f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 >> 172.21.15.67:0/412859325 conn(0x7ff33c061100 msgr2=0x7ff33c14eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 shutdown_connections 2024-01-17T23:00:43.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:43.019+0000 7ff341200640 1 -- 172.21.15.67:0/412859325 wait complete. 2024-01-17T23:00:43.048 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi067.front.sepia.ceph.com... 2024-01-17T23:00:43.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:43.048 DEBUG:teuthology.orchestra.run.smithi067:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-17T23:00:43.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi067.stderr:ceph-fuse[32097]: fuse finished with error 0 and tester_r 0 2024-01-17T23:00:43.086 INFO:teuthology.orchestra.run:waiting for 300 2024-01-17T23:00:49.188 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-17T23:00:49.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:00:49.189 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-17T23:00:49.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 Processor -- start 2024-01-17T23:00:49.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 -- start start 2024-01-17T23:00:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb580c79c0 0x7ffb58061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb58061640 0x7ffb5815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580c9890 con 0x7ffb581539a0 2024-01-17T23:00:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5806d570 con 0x7ffb580c79c0 2024-01-17T23:00:49.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.399+0000 7ffb5d200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb58159bf0 con 0x7ffb58061640 2024-01-17T23:00:49.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb580c79c0 0x7ffb58061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:49.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb580c79c0 0x7ffb58061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34866/0 (socket says 172.21.15.67:34866) 2024-01-17T23:00:49.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 -- 172.21.15.67:0/355942835 learned_addr learned my addr 172.21.15.67:0/355942835 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:49.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 -- 172.21.15.67:0/355942835 >> v2:172.21.15.137:3300/0 conn(0x7ffb58061640 msgr2=0x7ffb5815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:49.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 --2- 172.21.15.67:0/355942835 >> v2:172.21.15.137:3300/0 conn(0x7ffb58061640 0x7ffb5815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 -- 172.21.15.67:0/355942835 >> v1:172.21.15.137:6789/0 conn(0x7ffb581539a0 legacy=0x7ffb580ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:49.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.431+0000 7ffb55400640 1 -- 172.21.15.67:0/355942835 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58159eb0 con 0x7ffb580c79c0 2024-01-17T23:00:49.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.435+0000 7ffb55400640 1 --2- 172.21.15.67:0/355942835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb580c79c0 0x7ffb58061100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806d9d0 tx=0x7ffb4001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61bd577624ba9a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:49.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.439+0000 7ffb54a00640 1 -- 172.21.15.67:0/355942835 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400a7070 con 0x7ffb580c79c0 2024-01-17T23:00:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.439+0000 7ffb54a00640 1 -- 172.21.15.67:0/355942835 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400ab430 con 0x7ffb580c79c0 2024-01-17T23:00:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.439+0000 7ffb54a00640 1 -- 172.21.15.67:0/355942835 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400ab7c0 con 0x7ffb580c79c0 2024-01-17T23:00:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.439+0000 7ffb5d200640 1 -- 172.21.15.67:0/355942835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb580c79c0 msgr2=0x7ffb58061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:49.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.439+0000 7ffb5d200640 1 --2- 172.21.15.67:0/355942835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb580c79c0 0x7ffb58061100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb5806d9d0 tx=0x7ffb4001c430 comp rx=0 tx=0).stop 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- 172.21.15.67:0/355942835 shutdown_connections 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 --2- 172.21.15.67:0/355942835 >> v2:172.21.15.137:3300/0 conn(0x7ffb58061640 0x7ffb5815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 --2- 172.21.15.67:0/355942835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb580c79c0 0x7ffb58061100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- 172.21.15.67:0/355942835 >> 172.21.15.67:0/355942835 conn(0x7ffb5806ad40 msgr2=0x7ffb5806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- 172.21.15.67:0/355942835 shutdown_connections 2024-01-17T23:00:49.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- 172.21.15.67:0/355942835 wait complete. 2024-01-17T23:00:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 Processor -- start 2024-01-17T23:00:49.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- start start 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb58061640 0x7ffb580b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb580c79c0 0x7ffb58158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580b0660 con 0x7ffb581539a0 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f54a0 con 0x7ffb58061640 2024-01-17T23:00:49.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.443+0000 7ffb5d200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580b0f30 con 0x7ffb580c79c0 2024-01-17T23:00:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.447+0000 7ffb56800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.447+0000 7ffb56800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34880/0 (socket says 172.21.15.67:34880) 2024-01-17T23:00:49.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.447+0000 7ffb56800640 1 -- 172.21.15.67:0/1552073729 learned_addr learned my addr 172.21.15.67:0/1552073729 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 -- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb580c79c0 msgr2=0x7ffb58158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb580c79c0 0x7ffb58158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 -- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb58061640 msgr2=0x7ffb580b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb58061640 0x7ffb580b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 -- 172.21.15.67:0/1552073729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb400094d0 con 0x7ffb581539a0 2024-01-17T23:00:49.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.451+0000 7ffb56800640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b970 tx=0x7ffb5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000cb40 con 0x7ffb581539a0 2024-01-17T23:00:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5000ccc0 con 0x7ffb581539a0 2024-01-17T23:00:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50014680 con 0x7ffb581539a0 2024-01-17T23:00:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb580b1ad0 con 0x7ffb581539a0 2024-01-17T23:00:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb580b2070 con 0x7ffb581539a0 2024-01-17T23:00:49.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.455+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5806b620 con 0x7ffb581539a0 2024-01-17T23:00:49.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.475+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ffb5001d3b0 con 0x7ffb581539a0 2024-01-17T23:00:49.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.479+0000 7ffb4e000640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 0x7ffb30068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:49.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.479+0000 7ffb55e00640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 0x7ffb30068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.479+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb5000ce30 con 0x7ffb581539a0 2024-01-17T23:00:49.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.479+0000 7ffb55e00640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 0x7ffb30068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009650 tx=0x7ffb48006bb0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:49.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.723+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7ffb50051760 con 0x7ffb581539a0 2024-01-17T23:00:49.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.887+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb580746a0 con 0x7ffb581539a0 2024-01-17T23:00:49.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.947+0000 7ffb4e000640 1 -- 172.21.15.67:0/1552073729 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7ffb50019070 con 0x7ffb581539a0 2024-01-17T23:00:49.955 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:49.955 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:49.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 msgr2=0x7ffb30068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:49.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 0x7ffb30068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009650 tx=0x7ffb48006bb0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 msgr2=0x7ffb581f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:49.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b970 tx=0x7ffb5000be30 comp rx=0 tx=0).stop 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 shutdown_connections 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb30066870 0x7ffb30068d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb581539a0 0x7ffb581f5c10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb580c79c0 0x7ffb58158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 --2- 172.21.15.67:0/1552073729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb58061640 0x7ffb580b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 >> 172.21.15.67:0/1552073729 conn(0x7ffb5806ad40 msgr2=0x7ffb58152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 shutdown_connections 2024-01-17T23:00:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:49.951+0000 7ffb5d200640 1 -- 172.21.15.67:0/1552073729 wait complete. 2024-01-17T23:00:49.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:50.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.111+0000 7fa49f800640 1 Processor -- start 2024-01-17T23:00:50.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.111+0000 7fa49f800640 1 -- start start 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806c840 0x7fa4981568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49f800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa49806d330 0x7fa498156e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49f800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa498072b80 con 0x7fa49806cf50 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49f800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4980720a0 con 0x7fa49806d330 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa498157350 con 0x7fa49806c840 2024-01-17T23:00:50.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa49806d330 0x7fa498156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49d800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa49806d330 0x7fa498156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34892/0 (socket says 172.21.15.67:34892) 2024-01-17T23:00:50.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa49d800640 1 -- 172.21.15.67:0/1015676756 learned_addr learned my addr 172.21.15.67:0/1015676756 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:50.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.115+0000 7fa497e00640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806c840 0x7fa4981568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.119+0000 7fa49d800640 1 -- 172.21.15.67:0/1015676756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806c840 msgr2=0x7fa4981568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:50.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.119+0000 7fa49d800640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806c840 0x7fa4981568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.119+0000 7fa49d800640 1 -- 172.21.15.67:0/1015676756 >> v1:172.21.15.67:6789/0 conn(0x7fa49806cf50 legacy=0x7fa49815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.119+0000 7fa49d800640 1 -- 172.21.15.67:0/1015676756 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980728a0 con 0x7fa49806d330 2024-01-17T23:00:50.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.123+0000 7fa49d800640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498156e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa490009e50 tx=0x7fa49001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41e4170cc402e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:50.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa497400640 1 -- 172.21.15.67:0/1015676756 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900a58a0 con 0x7fa49806d330 2024-01-17T23:00:50.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa497400640 1 -- 172.21.15.67:0/1015676756 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4900a5a00 con 0x7fa49806d330 2024-01-17T23:00:50.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa497400640 1 -- 172.21.15.67:0/1015676756 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900a5d90 con 0x7fa49806d330 2024-01-17T23:00:50.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 -- 172.21.15.67:0/1015676756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 msgr2=0x7fa498156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498156e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa490009e50 tx=0x7fa49001c9e0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 -- 172.21.15.67:0/1015676756 shutdown_connections 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498156e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 --2- 172.21.15.67:0/1015676756 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806c840 0x7fa4981568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 -- 172.21.15.67:0/1015676756 >> 172.21.15.67:0/1015676756 conn(0x7fa4980cb070 msgr2=0x7fa4980cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 -- 172.21.15.67:0/1015676756 shutdown_connections 2024-01-17T23:00:50.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.127+0000 7fa49f800640 1 -- 172.21.15.67:0/1015676756 wait complete. 2024-01-17T23:00:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 Processor -- start 2024-01-17T23:00:50.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 -- start start 2024-01-17T23:00:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa49806c840 0x7fa49814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806cf50 0x7fa498145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498150220 con 0x7fa49806d330 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4981452a0 con 0x7fa49806c840 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49f800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4981f65d0 con 0x7fa49806cf50 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34894/0 (socket says 172.21.15.67:34894) 2024-01-17T23:00:50.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49d800640 1 -- 172.21.15.67:0/3522983345 learned_addr learned my addr 172.21.15.67:0/3522983345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa49ce00640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa49806c840 0x7fa49814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.131+0000 7fa497e00640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806cf50 0x7fa498145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.135+0000 7fa49d800640 1 -- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806cf50 msgr2=0x7fa498145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.135+0000 7fa49d800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806cf50 0x7fa498145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.135+0000 7fa49d800640 1 -- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa49806c840 msgr2=0x7fa49814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.135+0000 7fa49d800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa49806c840 0x7fa49814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.135+0000 7fa49d800640 1 -- 172.21.15.67:0/3522983345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009b30 con 0x7fa49806d330 2024-01-17T23:00:50.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.139+0000 7fa49d800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa49001a610 tx=0x7fa490019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:50.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900b8670 con 0x7fa49806d330 2024-01-17T23:00:50.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4900b87d0 con 0x7fa49806d330 2024-01-17T23:00:50.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900b8b80 con 0x7fa49806d330 2024-01-17T23:00:50.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4981f68b0 con 0x7fa49806d330 2024-01-17T23:00:50.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4981457d0 con 0x7fa49806d330 2024-01-17T23:00:50.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.143+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4980c84f0 con 0x7fa49806d330 2024-01-17T23:00:50.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.163+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa4900b8ce0 con 0x7fa49806d330 2024-01-17T23:00:50.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.167+0000 7fa494c00640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 0x7fa470068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.167+0000 7fa49ce00640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 0x7fa470068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.167+0000 7fa49ce00640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 0x7fa470068d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa488001770 tx=0x7fa488009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:50.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.167+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4900f0e50 con 0x7fa49806d330 2024-01-17T23:00:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.419+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa4900ed190 con 0x7fa49806d330 2024-01-17T23:00:50.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.583+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4980c84f0 con 0x7fa49806d330 2024-01-17T23:00:50.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa494c00640 1 -- 172.21.15.67:0/3522983345 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7fa4980c84f0 con 0x7fa49806d330 2024-01-17T23:00:50.636 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:50.636 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 msgr2=0x7fa470068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 0x7fa470068d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa488001770 tx=0x7fa488009040 comp rx=0 tx=0).stop 2024-01-17T23:00:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 msgr2=0x7fa498141c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa49001a610 tx=0x7fa490019780 comp rx=0 tx=0).stop 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 shutdown_connections 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa470066890 0x7fa470068d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa49806d330 0x7fa498141c60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa49806cf50 0x7fa498145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 --2- 172.21.15.67:0/3522983345 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa49806c840 0x7fa49814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 >> 172.21.15.67:0/3522983345 conn(0x7fa4980cb070 msgr2=0x7fa4980c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 shutdown_connections 2024-01-17T23:00:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.631+0000 7fa49f800640 1 -- 172.21.15.67:0/3522983345 wait complete. 2024-01-17T23:00:50.660 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-17T23:00:50.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 Processor -- start 2024-01-17T23:00:50.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 -- start start 2024-01-17T23:00:50.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f580c6780 0x7f7f580c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f580b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f580c5cc0 con 0x7f7f581516c0 2024-01-17T23:00:50.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f58158410 con 0x7f7f580c6780 2024-01-17T23:00:50.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.799+0000 7f7f5ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581573c0 con 0x7f7f580b0640 2024-01-17T23:00:50.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.803+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f580b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.803+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f580b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:50844/0 (socket says 172.21.15.67:50844) 2024-01-17T23:00:50.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.803+0000 7f7f5ce00640 1 -- 172.21.15.67:0/2302312113 learned_addr learned my addr 172.21.15.67:0/2302312113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:50.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.803+0000 7f7f57e00640 1 --1- 172.21.15.67:0/2302312113 >> v1:172.21.15.137:6789/0 conn(0x7f7f581516c0 0x7f7f5806db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50330/0 (socket says 172.21.15.67:50330) 2024-01-17T23:00:50.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.803+0000 7f7f57400640 1 --2- 172.21.15.67:0/2302312113 >> v2:172.21.15.137:3300/0 conn(0x7f7f580c6780 0x7f7f580c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.811+0000 7f7f57400640 1 -- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 msgr2=0x7f7f580b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:50.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.811+0000 7f7f57400640 1 --2- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f580b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.811+0000 7f7f57400640 1 -- 172.21.15.67:0/2302312113 >> v1:172.21.15.137:6789/0 conn(0x7f7f581516c0 legacy=0x7f7f5806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.811+0000 7f7f57400640 1 -- 172.21.15.67:0/2302312113 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f581575b0 con 0x7f7f580c6780 2024-01-17T23:00:50.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.819+0000 7f7f57400640 1 --2- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097c0 tx=0x7f7f4001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd083ee65c94f138 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f56a00640 1 -- 172.21.15.67:0/2302312113 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a8970 con 0x7f7f580c6780 2024-01-17T23:00:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f56a00640 1 -- 172.21.15.67:0/2302312113 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f400a8ad0 con 0x7f7f580c6780 2024-01-17T23:00:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f56a00640 1 -- 172.21.15.67:0/2302312113 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400a8e60 con 0x7f7f580c6780 2024-01-17T23:00:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 -- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 msgr2=0x7f7f580c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c6ba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097c0 tx=0x7f7f4001ec70 comp rx=0 tx=0).stop 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 -- 172.21.15.67:0/2302312113 shutdown_connections 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f580b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/2302312113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c6ba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 -- 172.21.15.67:0/2302312113 >> 172.21.15.67:0/2302312113 conn(0x7f7f580c7a90 msgr2=0x7f7f580c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 -- 172.21.15.67:0/2302312113 shutdown_connections 2024-01-17T23:00:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.831+0000 7f7f5ee00640 1 -- 172.21.15.67:0/2302312113 wait complete. 2024-01-17T23:00:50.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 Processor -- start 2024-01-17T23:00:50.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 -- start start 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f5814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58151e10 con 0x7f7f581516c0 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581f05a0 con 0x7f7f580c6780 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ee00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581ef740 con 0x7f7f580b0640 2024-01-17T23:00:50.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38496/0 (socket says 172.21.15.67:38496) 2024-01-17T23:00:50.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f5ce00640 1 -- 172.21.15.67:0/1085085387 learned_addr learned my addr 172.21.15.67:0/1085085387 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:50.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.835+0000 7f7f57e00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f5814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:50.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.839+0000 7f7f5ce00640 1 -- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 msgr2=0x7f7f5814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.839+0000 7f7f5ce00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f5814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.839+0000 7f7f5ce00640 1 -- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 msgr2=0x7f7f580c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:50.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.839+0000 7f7f5ce00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:50.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.839+0000 7f7f5ce00640 1 -- 172.21.15.67:0/1085085387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009420 con 0x7f7f581516c0 2024-01-17T23:00:50.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.843+0000 7f7f5ce00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009d90 tx=0x7f7f5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000cd20 con 0x7f7f581516c0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5000f040 con 0x7f7f581516c0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50003be0 con 0x7f7f581516c0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f581efa20 con 0x7f7f581516c0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581effe0 con 0x7f7f581516c0 2024-01-17T23:00:50.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:50.847+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f580c28c0 con 0x7f7f581516c0 2024-01-17T23:00:51.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.107+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7f50003d40 con 0x7f7f581516c0 2024-01-17T23:00:51.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.107+0000 7f7f4fe00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 0x7f7f30068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:51.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.107+0000 7f7f57e00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 0x7f7f30068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:51.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.107+0000 7f7f57e00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 0x7f7f30068d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000f70 tx=0x7f7f48007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:51.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.119+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7f5000ce80 con 0x7f7f581516c0 2024-01-17T23:00:51.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.119+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7f50052760 con 0x7f7f581516c0 2024-01-17T23:00:51.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.315+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f580746a0 con 0x7f7f581516c0 2024-01-17T23:00:51.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.867+0000 7f7f4fe00640 1 -- 172.21.15.67:0/1085085387 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f50055d80 con 0x7f7f581516c0 2024-01-17T23:00:51.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 msgr2=0x7f7f30068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 0x7f7f30068d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000f70 tx=0x7f7f48007e90 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 msgr2=0x7f7f580c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009d90 tx=0x7f7f5000c490 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 shutdown_connections 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7f30066890 0x7f7f30068d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f581516c0 0x7f7f580c1730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f580c6780 0x7f7f580c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 --2- 172.21.15.67:0/1085085387 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7f580b0640 0x7f7f5814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 >> 172.21.15.67:0/1085085387 conn(0x7f7f580c7a90 msgr2=0x7f7f58156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 shutdown_connections 2024-01-17T23:00:51.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:51.871+0000 7f7f5ee00640 1 -- 172.21.15.67:0/1085085387 wait complete. 2024-01-17T23:00:51.896 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-01-17T23:00:51.897 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-01-17T23:00:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 Processor -- start 2024-01-17T23:00:52.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 -- start start 2024-01-17T23:00:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4040153780 0x7f4040159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40400ca2f0 0x7f404006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404015d410 0x7f4040070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4040153b60 con 0x7f40400ca2f0 2024-01-17T23:00:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404006c710 con 0x7f4040153780 2024-01-17T23:00:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4048200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4040159c40 con 0x7f404015d410 2024-01-17T23:00:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4044e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40400ca2f0 0x7f404006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.035+0000 7f4045800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4040153780 0x7f4040159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40400ca2f0 0x7f404006c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38502/0 (socket says 172.21.15.67:38502) 2024-01-17T23:00:52.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 -- 172.21.15.67:0/4135719465 learned_addr learned my addr 172.21.15.67:0/4135719465 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:52.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4046200640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404015d410 0x7f4040070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 -- 172.21.15.67:0/4135719465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404015d410 msgr2=0x7f4040070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404015d410 0x7f4040070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 -- 172.21.15.67:0/4135719465 >> v2:172.21.15.137:3300/0 conn(0x7f4040153780 msgr2=0x7f4040159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 --2- 172.21.15.67:0/4135719465 >> v2:172.21.15.137:3300/0 conn(0x7f4040153780 0x7f4040159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.039+0000 7f4044e00640 1 -- 172.21.15.67:0/4135719465 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040159f20 con 0x7f40400ca2f0 2024-01-17T23:00:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.043+0000 7f4044e00640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40400ca2f0 0x7f404006c1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f404006fb30 tx=0x7f402801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7611b2572f976c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:52.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f403fe00640 1 -- 172.21.15.67:0/4135719465 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280a89b0 con 0x7f40400ca2f0 2024-01-17T23:00:52.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f403fe00640 1 -- 172.21.15.67:0/4135719465 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a8b10 con 0x7f40400ca2f0 2024-01-17T23:00:52.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f403fe00640 1 -- 172.21.15.67:0/4135719465 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280a8ea0 con 0x7f40400ca2f0 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 -- 172.21.15.67:0/4135719465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40400ca2f0 msgr2=0x7f404006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40400ca2f0 0x7f404006c1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f404006fb30 tx=0x7f402801ecf0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 -- 172.21.15.67:0/4135719465 shutdown_connections 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f404015d410 0x7f4040070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 --2- 172.21.15.67:0/4135719465 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40400ca2f0 0x7f404006c1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 --2- 172.21.15.67:0/4135719465 >> v2:172.21.15.137:3300/0 conn(0x7f4040153780 0x7f4040159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 -- 172.21.15.67:0/4135719465 >> 172.21.15.67:0/4135719465 conn(0x7f4040070390 msgr2=0x7f404006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 -- 172.21.15.67:0/4135719465 shutdown_connections 2024-01-17T23:00:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.047+0000 7f4048200640 1 -- 172.21.15.67:0/4135719465 wait complete. 2024-01-17T23:00:52.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 Processor -- start 2024-01-17T23:00:52.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 -- start start 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40400ca2f0 0x7f40400b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040153780 0x7f40401e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400b21a0 con 0x7f404015d410 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400b0c80 con 0x7f40400ca2f0 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4048200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400b0f60 con 0x7f4040153780 2024-01-17T23:00:52.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4046200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4046200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38518/0 (socket says 172.21.15.67:38518) 2024-01-17T23:00:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4046200640 1 -- 172.21.15.67:0/1749668471 learned_addr learned my addr 172.21.15.67:0/1749668471 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4045800640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40400ca2f0 0x7f40400b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.051+0000 7f4044e00640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040153780 0x7f40401e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.055+0000 7f4046200640 1 -- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040153780 msgr2=0x7f40401e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:52.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.055+0000 7f4046200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040153780 0x7f40401e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.055+0000 7f4046200640 1 -- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40400ca2f0 msgr2=0x7f40400b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:52.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.055+0000 7f4046200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40400ca2f0 0x7f40400b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:52.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.055+0000 7f4046200640 1 -- 172.21.15.67:0/1749668471 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40280094d0 con 0x7f404015d410 2024-01-17T23:00:52.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.059+0000 7f4046200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f403800efc0 tx=0x7f403800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:52.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038014480 con 0x7f404015d410 2024-01-17T23:00:52.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800f040 con 0x7f404015d410 2024-01-17T23:00:52.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038014820 con 0x7f404015d410 2024-01-17T23:00:52.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40400b1e30 con 0x7f404015d410 2024-01-17T23:00:52.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40401e40c0 con 0x7f404015d410 2024-01-17T23:00:52.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.063+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40401591c0 con 0x7f404015d410 2024-01-17T23:00:52.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.083+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4038014980 con 0x7f404015d410 2024-01-17T23:00:52.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.083+0000 7f403d600640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 0x7f4018068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:52.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.083+0000 7f4045800640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 0x7f4018068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:52.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.083+0000 7f4045800640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 0x7f4018068d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4030009ae0 tx=0x7f4030009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.087+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4038056360 con 0x7f404015d410 2024-01-17T23:00:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.331+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f40380526a0 con 0x7f404015d410 2024-01-17T23:00:52.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:52.527+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f40401e4370 con 0x7f404015d410 2024-01-17T23:00:53.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f403d600640 1 -- 172.21.15.67:0/1749668471 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4038018070 con 0x7f404015d410 2024-01-17T23:00:53.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 msgr2=0x7f4018068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:53.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 0x7f4018068d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4030009ae0 tx=0x7f4030009190 comp rx=0 tx=0).stop 2024-01-17T23:00:53.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 msgr2=0x7f40401e4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:53.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f403800efc0 tx=0x7f403800c490 comp rx=0 tx=0).stop 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 shutdown_connections 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4018066890 0x7f4018068d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f404015d410 0x7f40401e4940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4040153780 0x7f40401e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 --2- 172.21.15.67:0/1749668471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40400ca2f0 0x7f40400b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 >> 172.21.15.67:0/1749668471 conn(0x7f4040070390 msgr2=0x7f404006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 shutdown_connections 2024-01-17T23:00:53.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.067+0000 7f4048200640 1 -- 172.21.15.67:0/1749668471 wait complete. 2024-01-17T23:00:53.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-17T23:00:53.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.235+0000 7f777ba00640 1 Processor -- start 2024-01-17T23:00:53.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 -- start start 2024-01-17T23:00:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7774151760 0x7f77740c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77741579d0 0x7f7774157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7774157540 con 0x7f77740ca410 2024-01-17T23:00:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7774151b40 con 0x7f77741579d0 2024-01-17T23:00:53.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.239+0000 7f777ba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777415aa30 con 0x7f7774151760 2024-01-17T23:00:53.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.267+0000 7f7779a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77741579d0 0x7f7774157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:53.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.267+0000 7f7779a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77741579d0 0x7f7774157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38524/0 (socket says 172.21.15.67:38524) 2024-01-17T23:00:53.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.267+0000 7f7779a00640 1 -- 172.21.15.67:0/2833947912 learned_addr learned my addr 172.21.15.67:0/2833947912 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.271+0000 7f7779a00640 1 -- 172.21.15.67:0/2833947912 >> v2:172.21.15.137:3300/0 conn(0x7f7774151760 msgr2=0x7f77740c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.271+0000 7f7779a00640 1 --2- 172.21.15.67:0/2833947912 >> v2:172.21.15.137:3300/0 conn(0x7f7774151760 0x7f77740c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.271+0000 7f7779a00640 1 -- 172.21.15.67:0/2833947912 >> v1:172.21.15.137:6789/0 conn(0x7f77740ca410 legacy=0x7f7774070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:53.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.271+0000 7f7779a00640 1 -- 172.21.15.67:0/2833947912 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774158350 con 0x7f77741579d0 2024-01-17T23:00:53.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.275+0000 7f7779a00640 1 --2- 172.21.15.67:0/2833947912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77741579d0 0x7f7774157e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f777406fc10 tx=0x7f776c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42768ef3616cf603 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f7773400640 1 -- 172.21.15.67:0/2833947912 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0af400 con 0x7f77741579d0 2024-01-17T23:00:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f7773400640 1 -- 172.21.15.67:0/2833947912 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0ab050 con 0x7f77741579d0 2024-01-17T23:00:53.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f7773400640 1 -- 172.21.15.67:0/2833947912 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0af780 con 0x7f77741579d0 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 -- 172.21.15.67:0/2833947912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77741579d0 msgr2=0x7f7774157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 --2- 172.21.15.67:0/2833947912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77741579d0 0x7f7774157e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f777406fc10 tx=0x7f776c01f180 comp rx=0 tx=0).stop 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 -- 172.21.15.67:0/2833947912 shutdown_connections 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 --2- 172.21.15.67:0/2833947912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77741579d0 0x7f7774157e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 --2- 172.21.15.67:0/2833947912 >> v2:172.21.15.137:3300/0 conn(0x7f7774151760 0x7f77740c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 -- 172.21.15.67:0/2833947912 >> 172.21.15.67:0/2833947912 conn(0x7f7774070390 msgr2=0x7f777406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 -- 172.21.15.67:0/2833947912 shutdown_connections 2024-01-17T23:00:53.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.279+0000 7f777ba00640 1 -- 172.21.15.67:0/2833947912 wait complete. 2024-01-17T23:00:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 Processor -- start 2024-01-17T23:00:53.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 -- start start 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77740ca410 0x7f77741f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77741579d0 0x7f777414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774156ab0 con 0x7f7774151760 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777415a740 con 0x7f77740ca410 2024-01-17T23:00:53.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f777ba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77741efc80 con 0x7f77741579d0 2024-01-17T23:00:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f7773e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f7773e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38530/0 (socket says 172.21.15.67:38530) 2024-01-17T23:00:53.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.283+0000 7f7773e00640 1 -- 172.21.15.67:0/2380014013 learned_addr learned my addr 172.21.15.67:0/2380014013 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.287+0000 7f7773e00640 1 -- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77741579d0 msgr2=0x7f777414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.287+0000 7f7773e00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77741579d0 0x7f777414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.287+0000 7f7773e00640 1 -- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77740ca410 msgr2=0x7f77741f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.287+0000 7f7773e00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77740ca410 0x7f77741f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:53.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.287+0000 7f7773e00640 1 -- 172.21.15.67:0/2380014013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009b30 con 0x7f7774151760 2024-01-17T23:00:53.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.291+0000 7f7773e00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c4f0 tx=0x7f775c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.291+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c003600 con 0x7f7774151760 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.291+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c003780 con 0x7f7774151760 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.291+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c003b30 con 0x7f7774151760 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.291+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77741ef670 con 0x7f7774151760 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.295+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777415a460 con 0x7f7774151760 2024-01-17T23:00:53.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.295+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740746a0 con 0x7f7774151760 2024-01-17T23:00:53.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.315+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f775c003c90 con 0x7f7774151760 2024-01-17T23:00:53.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.315+0000 7f7770c00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 0x7f774c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:53.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.315+0000 7f7779000640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 0x7f774c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:53.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.315+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f775c013e70 con 0x7f7774151760 2024-01-17T23:00:53.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.319+0000 7f7779000640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 0x7f774c068d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7764009730 tx=0x7f7764006ca0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:53.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.563+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f775c050e20 con 0x7f7774151760 2024-01-17T23:00:53.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:53.783+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f777406f4c0 con 0x7f7774151760 2024-01-17T23:00:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f7770c00640 1 -- 172.21.15.67:0/2380014013 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f775c054440 con 0x7f7774151760 2024-01-17T23:00:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 msgr2=0x7f774c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 0x7f774c068d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7764009730 tx=0x7f7764006ca0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 msgr2=0x7f777414dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c4f0 tx=0x7f775c001e80 comp rx=0 tx=0).stop 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 shutdown_connections 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f774c0668c0 0x7f774c068d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77741579d0 0x7f777414e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7774151760 0x7f777414dba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 --2- 172.21.15.67:0/2380014013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77740ca410 0x7f77741f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 >> 172.21.15.67:0/2380014013 conn(0x7f7774070390 msgr2=0x7f777414ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 shutdown_connections 2024-01-17T23:00:54.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.671+0000 7f777ba00640 1 -- 172.21.15.67:0/2380014013 wait complete. 2024-01-17T23:00:54.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-17T23:00:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 Processor -- start 2024-01-17T23:00:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 -- start start 2024-01-17T23:00:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f769c06e090 0x7f769c0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0c7120 con 0x7f769c0c6cc0 2024-01-17T23:00:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c158410 con 0x7f769c06e090 2024-01-17T23:00:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1573c0 con 0x7f769c1516c0 2024-01-17T23:00:54.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:54.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:50904/0 (socket says 172.21.15.67:50904) 2024-01-17T23:00:54.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.839+0000 7f76a1200640 1 -- 172.21.15.67:0/867451421 learned_addr learned my addr 172.21.15.67:0/867451421 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:54.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.843+0000 7f769be00640 1 --2- 172.21.15.67:0/867451421 >> v2:172.21.15.137:3300/0 conn(0x7f769c06e090 0x7f769c0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:54.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.843+0000 7f76a1200640 1 -- 172.21.15.67:0/867451421 >> v2:172.21.15.137:3300/0 conn(0x7f769c06e090 msgr2=0x7f769c0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:54.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.843+0000 7f76a1200640 1 --2- 172.21.15.67:0/867451421 >> v2:172.21.15.137:3300/0 conn(0x7f769c06e090 0x7f769c0c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.843+0000 7f76a1200640 1 -- 172.21.15.67:0/867451421 >> v1:172.21.15.137:6789/0 conn(0x7f769c0c6cc0 legacy=0x7f769c0b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.843+0000 7f76a1200640 1 -- 172.21.15.67:0/867451421 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0c5cc0 con 0x7f769c1516c0 2024-01-17T23:00:54.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.847+0000 7f76a1200640 1 --2- 172.21.15.67:0/867451421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ba53b8e2b443c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:54.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.851+0000 7f769b400640 1 -- 172.21.15.67:0/867451421 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0a8a30 con 0x7f769c1516c0 2024-01-17T23:00:54.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f769b400640 1 -- 172.21.15.67:0/867451421 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c0a8b90 con 0x7f769c1516c0 2024-01-17T23:00:54.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f769b400640 1 -- 172.21.15.67:0/867451421 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0b0440 con 0x7f769c1516c0 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 -- 172.21.15.67:0/867451421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 msgr2=0x7f769c06db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 --2- 172.21.15.67:0/867451421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c01ed30 comp rx=0 tx=0).stop 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 -- 172.21.15.67:0/867451421 shutdown_connections 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 --2- 172.21.15.67:0/867451421 >> v2:172.21.15.137:3300/0 conn(0x7f769c06e090 0x7f769c0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 --2- 172.21.15.67:0/867451421 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c1516c0 0x7f769c06db50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 -- 172.21.15.67:0/867451421 >> 172.21.15.67:0/867451421 conn(0x7f769c0c7a90 msgr2=0x7f769c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 -- 172.21.15.67:0/867451421 shutdown_connections 2024-01-17T23:00:54.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.855+0000 7f76a3c00640 1 -- 172.21.15.67:0/867451421 wait complete. 2024-01-17T23:00:54.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 Processor -- start 2024-01-17T23:00:54.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 -- start start 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c06e090 0x7f769c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c0c6cc0 0x7f769c14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1efe30 con 0x7f769c1516c0 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0c0050 con 0x7f769c0c6cc0 2024-01-17T23:00:54.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a3c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c14d350 con 0x7f769c06e090 2024-01-17T23:00:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a1200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c06e090 0x7f769c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f769be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c0c6cc0 0x7f769c14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38532/0 (socket says 172.21.15.67:38532) 2024-01-17T23:00:54.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.859+0000 7f76a1c00640 1 -- 172.21.15.67:0/193050368 learned_addr learned my addr 172.21.15.67:0/193050368 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.863+0000 7f76a1c00640 1 -- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c06e090 msgr2=0x7f769c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.863+0000 7f76a1c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c06e090 0x7f769c151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.863+0000 7f76a1c00640 1 -- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c0c6cc0 msgr2=0x7f769c14c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.863+0000 7f76a1c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c0c6cc0 0x7f769c14c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.863+0000 7f76a1c00640 1 -- 172.21.15.67:0/193050368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0094d0 con 0x7f769c1516c0 2024-01-17T23:00:54.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.867+0000 7f76a1c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f769400c770 tx=0x7f769400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:54.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694003b80 con 0x7f769c1516c0 2024-01-17T23:00:54.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694003ce0 con 0x7f769c1516c0 2024-01-17T23:00:54.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400aa90 con 0x7f769c1516c0 2024-01-17T23:00:54.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c14d630 con 0x7f769c1516c0 2024-01-17T23:00:54.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c14c170 con 0x7f769c1516c0 2024-01-17T23:00:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:54.871+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c0c28c0 con 0x7f769c1516c0 2024-01-17T23:00:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.131+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f769400abf0 con 0x7f769c1516c0 2024-01-17T23:00:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.131+0000 7f7698c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 0x7f7674068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.131+0000 7f76a1200640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 0x7f7674068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.131+0000 7f76a1200640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 0x7f7674068d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f768c0b2000 tx=0x7f768c009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:55.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.147+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76940558b0 con 0x7f769c1516c0 2024-01-17T23:00:55.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.147+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7694051bf0 con 0x7f769c1516c0 2024-01-17T23:00:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.347+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f769c0746a0 con 0x7f769c1516c0 2024-01-17T23:00:55.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.699+0000 7f7698c00640 1 -- 172.21.15.67:0/193050368 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7694055210 con 0x7f769c1516c0 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 msgr2=0x7f7674068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 0x7f7674068d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f768c0b2000 tx=0x7f768c009040 comp rx=0 tx=0).stop 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 msgr2=0x7f769c0c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f769400c770 tx=0x7f769400cc30 comp rx=0 tx=0).stop 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 shutdown_connections 2024-01-17T23:00:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7674066890 0x7f7674068d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f769c1516c0 0x7f769c0c0810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c0c6cc0 0x7f769c14c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 --2- 172.21.15.67:0/193050368 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f769c06e090 0x7f769c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 >> 172.21.15.67:0/193050368 conn(0x7f769c0c7a90 msgr2=0x7f769c071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 shutdown_connections 2024-01-17T23:00:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.703+0000 7f76a3c00640 1 -- 172.21.15.67:0/193050368 wait complete. 2024-01-17T23:00:55.730 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-17T23:00:55.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:00:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 Processor -- start 2024-01-17T23:00:55.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 -- start start 2024-01-17T23:00:55.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56ec157520 0x7f56ec157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0c2540 con 0x7f56ec1517e0 2024-01-17T23:00:55.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0c30c0 con 0x7f56ec157520 2024-01-17T23:00:55.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.875+0000 7f56f1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0c3c60 con 0x7f56ec0cce40 2024-01-17T23:00:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.883+0000 7f56eaa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f56ec1517e0 0x7f56ec0c3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50362/0 (socket says 172.21.15.67:50362) 2024-01-17T23:00:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.883+0000 7f56eaa00640 1 -- 172.21.15.67:0/1843457565 learned_addr learned my addr 172.21.15.67:0/1843457565 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:55.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.883+0000 7f56ea000640 1 --2- 172.21.15.67:0/1843457565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.939+0000 7f56eb400640 1 --2- 172.21.15.67:0/1843457565 >> v2:172.21.15.137:3300/0 conn(0x7f56ec157520 0x7f56ec157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.947+0000 7f56ea000640 1 -- 172.21.15.67:0/1843457565 >> v2:172.21.15.137:3300/0 conn(0x7f56ec157520 msgr2=0x7f56ec157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.947+0000 7f56ea000640 1 --2- 172.21.15.67:0/1843457565 >> v2:172.21.15.137:3300/0 conn(0x7f56ec157520 0x7f56ec157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.947+0000 7f56ea000640 1 -- 172.21.15.67:0/1843457565 >> v1:172.21.15.137:6789/0 conn(0x7f56ec1517e0 legacy=0x7f56ec0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.947+0000 7f56ea000640 1 -- 172.21.15.67:0/1843457565 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec158320 con 0x7f56ec0cce40 2024-01-17T23:00:55.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.955+0000 7f56ea000640 1 --2- 172.21.15.67:0/1843457565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec0cd260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f56d40097c0 tx=0x7f56d401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a334018ac9e634a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:55.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56e9600640 1 -- 172.21.15.67:0/1843457565 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40a8970 con 0x7f56ec0cce40 2024-01-17T23:00:55.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56e9600640 1 -- 172.21.15.67:0/1843457565 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d40a8ad0 con 0x7f56ec0cce40 2024-01-17T23:00:55.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56e9600640 1 -- 172.21.15.67:0/1843457565 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40a8e60 con 0x7f56ec0cce40 2024-01-17T23:00:55.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- 172.21.15.67:0/1843457565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 msgr2=0x7f56ec0cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 --2- 172.21.15.67:0/1843457565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec0cd260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f56d40097c0 tx=0x7f56d401ec70 comp rx=0 tx=0).stop 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- 172.21.15.67:0/1843457565 shutdown_connections 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 --2- 172.21.15.67:0/1843457565 >> v2:172.21.15.137:3300/0 conn(0x7f56ec157520 0x7f56ec157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 --2- 172.21.15.67:0/1843457565 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec0cd260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- 172.21.15.67:0/1843457565 >> 172.21.15.67:0/1843457565 conn(0x7f56ec061100 msgr2=0x7f56ec061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- 172.21.15.67:0/1843457565 shutdown_connections 2024-01-17T23:00:55.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- 172.21.15.67:0/1843457565 wait complete. 2024-01-17T23:00:55.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 Processor -- start 2024-01-17T23:00:55.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.963+0000 7f56f1a00640 1 -- start start 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56ec1517e0 0x7f56ec147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec150150 con 0x7f56ec157520 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec1ef280 con 0x7f56ec1517e0 2024-01-17T23:00:55.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56f1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec1ef490 con 0x7f56ec0cce40 2024-01-17T23:00:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56eb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56ea000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56ec1517e0 0x7f56ec147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56eaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56eb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38544/0 (socket says 172.21.15.67:38544) 2024-01-17T23:00:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.967+0000 7f56eb400640 1 -- 172.21.15.67:0/3958855534 learned_addr learned my addr 172.21.15.67:0/3958855534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 -- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 msgr2=0x7f56ec14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec14d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 -- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56ec1517e0 msgr2=0x7f56ec147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56ec1517e0 0x7f56ec147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:55.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 -- 172.21.15.67:0/3958855534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009420 con 0x7f56ec157520 2024-01-17T23:00:55.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.971+0000 7f56eb400640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56e400efc0 tx=0x7f56e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.975+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4009ba0 con 0x7f56ec157520 2024-01-17T23:00:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.975+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400f040 con 0x7f56ec157520 2024-01-17T23:00:55.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.975+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40146c0 con 0x7f56ec157520 2024-01-17T23:00:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.975+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec1ef770 con 0x7f56ec157520 2024-01-17T23:00:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.975+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec1efd30 con 0x7f56ec157520 2024-01-17T23:00:55.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.979+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec0746a0 con 0x7f56ec157520 2024-01-17T23:00:56.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.999+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f56e4014820 con 0x7f56ec157520 2024-01-17T23:00:56.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.999+0000 7f56e2a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 0x7f56c4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.999+0000 7f56eaa00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 0x7f56c4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:55.999+0000 7f56eaa00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 0x7f56c4068d50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56dc005890 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:56.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.003+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56e4056290 con 0x7f56ec157520 2024-01-17T23:00:56.094 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-17T23:00:56.086+0000 f9d6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-01-17T23:00:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.247+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f56e40525d0 con 0x7f56ec157520 2024-01-17T23:00:56.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.447+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56ec0cae60 con 0x7f56ec157520 2024-01-17T23:00:56.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.459+0000 7f56e2a00640 1 -- 172.21.15.67:0/3958855534 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6556 (secure 0 0 0) 0x7f56e4018070 con 0x7f56ec157520 2024-01-17T23:00:56.466 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:56.466 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:55.699424+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T23:00:56.466 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 13 2024-01-17T23:00:56.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 msgr2=0x7f56c4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 0x7f56c4068d50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56dc005890 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2024-01-17T23:00:56.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 msgr2=0x7f56ec14f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56e400efc0 tx=0x7f56e400c490 comp rx=0 tx=0).stop 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 shutdown_connections 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f56c4066890 0x7f56c4068d50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56ec157520 0x7f56ec14f010 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56ec1517e0 0x7f56ec147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 --2- 172.21.15.67:0/3958855534 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f56ec0cce40 0x7f56ec14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 >> 172.21.15.67:0/3958855534 conn(0x7f56ec061100 msgr2=0x7f56ec0c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 shutdown_connections 2024-01-17T23:00:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.463+0000 7f56f1a00640 1 -- 172.21.15.67:0/3958855534 wait complete. 2024-01-17T23:00:56.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.623+0000 7fe452800640 1 Processor -- start 2024-01-17T23:00:56.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.623+0000 7fe452800640 1 -- start start 2024-01-17T23:00:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe452800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe44c153730 0x7fe44c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe452800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe44c15d0c0 0x7fe44c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe452800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c1598e0 con 0x7fe44c0cda40 2024-01-17T23:00:56.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe452800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c1596f0 con 0x7fe44c153730 2024-01-17T23:00:56.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe452800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c0cde80 con 0x7fe44c15d0c0 2024-01-17T23:00:56.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe44aa00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe44c0cda40 0x7fe44c070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54398/0 (socket says 172.21.15.67:54398) 2024-01-17T23:00:56.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe44aa00640 1 -- 172.21.15.67:0/3559042105 learned_addr learned my addr 172.21.15.67:0/3559042105 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:56.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe44be00640 1 --2- 172.21.15.67:0/3559042105 >> v2:172.21.15.137:3300/0 conn(0x7fe44c15d0c0 0x7fe44c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.627+0000 7fe44b400640 1 --2- 172.21.15.67:0/3559042105 >> v2:172.21.15.67:3300/0 conn(0x7fe44c153730 0x7fe44c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.631+0000 7fe44b400640 1 -- 172.21.15.67:0/3559042105 >> v2:172.21.15.137:3300/0 conn(0x7fe44c15d0c0 msgr2=0x7fe44c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.631+0000 7fe44b400640 1 --2- 172.21.15.67:0/3559042105 >> v2:172.21.15.137:3300/0 conn(0x7fe44c15d0c0 0x7fe44c15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.631+0000 7fe44b400640 1 -- 172.21.15.67:0/3559042105 >> v1:172.21.15.67:6789/0 conn(0x7fe44c0cda40 legacy=0x7fe44c070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.631+0000 7fe44b400640 1 -- 172.21.15.67:0/3559042105 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c159b80 con 0x7fe44c153730 2024-01-17T23:00:56.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.635+0000 7fe44b400640 1 --2- 172.21.15.67:0/3559042105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c0ca330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe44c070cb0 tx=0x7fe43c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4680ba8a40e0292 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:56.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.639+0000 7fe44a000640 1 -- 172.21.15.67:0/3559042105 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0a8950 con 0x7fe44c153730 2024-01-17T23:00:56.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.639+0000 7fe44a000640 1 -- 172.21.15.67:0/3559042105 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0a8ab0 con 0x7fe44c153730 2024-01-17T23:00:56.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.639+0000 7fe44a000640 1 -- 172.21.15.67:0/3559042105 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0a8e40 con 0x7fe44c153730 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- 172.21.15.67:0/3559042105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 msgr2=0x7fe44c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- 172.21.15.67:0/3559042105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c0ca330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe44c070cb0 tx=0x7fe43c01ec50 comp rx=0 tx=0).stop 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- 172.21.15.67:0/3559042105 shutdown_connections 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- 172.21.15.67:0/3559042105 >> v2:172.21.15.137:3300/0 conn(0x7fe44c15d0c0 0x7fe44c15d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- 172.21.15.67:0/3559042105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c0ca330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- 172.21.15.67:0/3559042105 >> 172.21.15.67:0/3559042105 conn(0x7fe44c070460 msgr2=0x7fe44c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- 172.21.15.67:0/3559042105 shutdown_connections 2024-01-17T23:00:56.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- 172.21.15.67:0/3559042105 wait complete. 2024-01-17T23:00:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 Processor -- start 2024-01-17T23:00:56.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- start start 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44c0cda40 0x7fe44c06ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe44c15d0c0 0x7fe44c1ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c1512f0 con 0x7fe44c153730 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c150a00 con 0x7fe44c0cda40 2024-01-17T23:00:56.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.643+0000 7fe452800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c15c710 con 0x7fe44c15d0c0 2024-01-17T23:00:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.647+0000 7fe44aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.647+0000 7fe44aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38566/0 (socket says 172.21.15.67:38566) 2024-01-17T23:00:56.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.647+0000 7fe44aa00640 1 -- 172.21.15.67:0/105027036 learned_addr learned my addr 172.21.15.67:0/105027036 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.647+0000 7fe44be00640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe44c15d0c0 0x7fe44c1ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.647+0000 7fe44b400640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44c0cda40 0x7fe44c06ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 -- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe44c15d0c0 msgr2=0x7fe44c1ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe44c15d0c0 0x7fe44c1ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 -- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44c0cda40 msgr2=0x7fe44c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:56.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44c0cda40 0x7fe44c06ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:56.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 -- 172.21.15.67:0/105027036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009420 con 0x7fe44c153730 2024-01-17T23:00:56.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.651+0000 7fe44aa00640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c420 tx=0x7fe43400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:56.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434005cf0 con 0x7fe44c153730 2024-01-17T23:00:56.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c150ca0 con 0x7fe44c153730 2024-01-17T23:00:56.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c15c9f0 con 0x7fe44c153730 2024-01-17T23:00:56.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434005e50 con 0x7fe44c153730 2024-01-17T23:00:56.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340072d0 con 0x7fe44c153730 2024-01-17T23:00:56.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.655+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44c0746a0 con 0x7fe44c153730 2024-01-17T23:00:56.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.675+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe434007430 con 0x7fe44c153730 2024-01-17T23:00:56.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.675+0000 7fe443400640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 0x7fe424068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:56.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.679+0000 7fe44b400640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 0x7fe424068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:56.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.679+0000 7fe44b400640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 0x7fe424068d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0b2000 tx=0x7fe43c0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.923+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe434054e70 con 0x7fe44c153730 2024-01-17T23:00:56.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:56.923+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe4340511b0 con 0x7fe44c153730 2024-01-17T23:00:57.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.087+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe44c157340 con 0x7fe44c153730 2024-01-17T23:00:57.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe443400640 1 -- 172.21.15.67:0/105027036 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7fe434021030 con 0x7fe44c153730 2024-01-17T23:00:57.141 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:57.141 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:00:57.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 msgr2=0x7fe424068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 0x7fe424068d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0b2000 tx=0x7fe43c0aa070 comp rx=0 tx=0).stop 2024-01-17T23:00:57.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 msgr2=0x7fe44c14d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c420 tx=0x7fe43400c8e0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 shutdown_connections 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe424066840 0x7fe424068d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe44c15d0c0 0x7fe44c1ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe44c153730 0x7fe44c14d830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 --2- 172.21.15.67:0/105027036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe44c0cda40 0x7fe44c06ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 >> 172.21.15.67:0/105027036 conn(0x7fe44c070460 msgr2=0x7fe44c157730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 shutdown_connections 2024-01-17T23:00:57.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.135+0000 7fe452800640 1 -- 172.21.15.67:0/105027036 wait complete. 2024-01-17T23:00:57.164 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-17T23:00:57.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T23:00:57.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 Processor -- start 2024-01-17T23:00:57.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 -- start start 2024-01-17T23:00:57.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70b0153860 0x7f70b006b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 0x7f70b00c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015a4c0 con 0x7f70b0061530 2024-01-17T23:00:57.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b006a780 con 0x7f70b0159ff0 2024-01-17T23:00:57.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.303+0000 7f70b7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b006aa60 con 0x7f70b0153860 2024-01-17T23:00:57.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.307+0000 7f70afe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f70b0153860 0x7f70b006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.307+0000 7f70b5200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f70b0061530 0x7f70b006f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50372/0 (socket says 172.21.15.67:50372) 2024-01-17T23:00:57.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.307+0000 7f70b5200640 1 -- 172.21.15.67:0/1618453420 learned_addr learned my addr 172.21.15.67:0/1618453420 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:00:57.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.307+0000 7f70af400640 1 --2- 172.21.15.67:0/1618453420 >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 0x7f70b00c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.311+0000 7f70afe00640 1 -- 172.21.15.67:0/1618453420 >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 msgr2=0x7f70b00c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:57.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.311+0000 7f70afe00640 1 --2- 172.21.15.67:0/1618453420 >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 0x7f70b00c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.311+0000 7f70afe00640 1 -- 172.21.15.67:0/1618453420 >> v1:172.21.15.137:6789/0 conn(0x7f70b0061530 legacy=0x7f70b006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:57.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.311+0000 7f70afe00640 1 -- 172.21.15.67:0/1618453420 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b006ad40 con 0x7f70b0153860 2024-01-17T23:00:57.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.311+0000 7f70af400640 1 --2- 172.21.15.67:0/1618453420 >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 0x7f70b00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-17T23:00:57.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.319+0000 7f70afe00640 1 --2- 172.21.15.67:0/1618453420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0153860 0x7f70b006b820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c8d70 tx=0x7f70a001ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84951ca320c403a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:57.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70aea00640 1 -- 172.21.15.67:0/1618453420 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00a8910 con 0x7f70b0153860 2024-01-17T23:00:57.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70aea00640 1 -- 172.21.15.67:0/1618453420 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a00a8a70 con 0x7f70b0153860 2024-01-17T23:00:57.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70aea00640 1 -- 172.21.15.67:0/1618453420 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00a8e00 con 0x7f70b0153860 2024-01-17T23:00:57.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 -- 172.21.15.67:0/1618453420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0153860 msgr2=0x7f70b006b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 --2- 172.21.15.67:0/1618453420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0153860 0x7f70b006b820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c8d70 tx=0x7f70a001ec10 comp rx=0 tx=0).stop 2024-01-17T23:00:57.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 -- 172.21.15.67:0/1618453420 shutdown_connections 2024-01-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 --2- 172.21.15.67:0/1618453420 >> v2:172.21.15.67:3300/0 conn(0x7f70b0159ff0 0x7f70b00c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 --2- 172.21.15.67:0/1618453420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0153860 0x7f70b006b820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 -- 172.21.15.67:0/1618453420 >> 172.21.15.67:0/1618453420 conn(0x7f70b00c8160 msgr2=0x7f70b00c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 -- 172.21.15.67:0/1618453420 shutdown_connections 2024-01-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.331+0000 7f70b7200640 1 -- 172.21.15.67:0/1618453420 wait complete. 2024-01-17T23:00:57.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 Processor -- start 2024-01-17T23:00:57.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 -- start start 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0061530 0x7f70b0147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70b0153860 0x7f70b014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0148000 con 0x7f70b0159ff0 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b014b730 con 0x7f70b0061530 2024-01-17T23:00:57.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0147a50 con 0x7f70b0153860 2024-01-17T23:00:57.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38586/0 (socket says 172.21.15.67:38586) 2024-01-17T23:00:57.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70b5200640 1 -- 172.21.15.67:0/3139983306 learned_addr learned my addr 172.21.15.67:0/3139983306 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:57.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70af400640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70b0153860 0x7f70b014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.335+0000 7f70afe00640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0061530 0x7f70b0147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.339+0000 7f70b5200640 1 -- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70b0153860 msgr2=0x7f70b014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.339+0000 7f70b5200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70b0153860 0x7f70b014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.339+0000 7f70b5200640 1 -- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0061530 msgr2=0x7f70b0147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.339+0000 7f70b5200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0061530 0x7f70b0147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.339+0000 7f70b5200640 1 -- 172.21.15.67:0/3139983306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009420 con 0x7f70b0159ff0 2024-01-17T23:00:57.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.343+0000 7f70b5200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ca40 tx=0x7f70a800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:57.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a800abd0 con 0x7f70b0159ff0 2024-01-17T23:00:57.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0009420 con 0x7f70b0159ff0 2024-01-17T23:00:57.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b014ae00 con 0x7f70b0159ff0 2024-01-17T23:00:57.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a80054b0 con 0x7f70b0159ff0 2024-01-17T23:00:57.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a801b400 con 0x7f70b0159ff0 2024-01-17T23:00:57.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.347+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70800052a0 con 0x7f70b0159ff0 2024-01-17T23:00:57.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.367+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f70a801b620 con 0x7f70b0159ff0 2024-01-17T23:00:57.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.367+0000 7f70a7e00640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 0x7f7088068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:57.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.371+0000 7f70afe00640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 0x7f7088068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:57.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.371+0000 7f70afe00640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 0x7f7088068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70a00b2000 tx=0x7f70a00aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:57.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.371+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70a8055f90 con 0x7f70b0159ff0 2024-01-17T23:00:57.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.619+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f70a80522d0 con 0x7f70b0159ff0 2024-01-17T23:00:57.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.775+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7080000bd0 con 0x7f7088066840 2024-01-17T23:00:57.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70a7e00640 1 -- 172.21.15.67:0/3139983306 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368800 (secure 0 0 0) 0x7f7080000bd0 con 0x7f7088066840 2024-01-17T23:00:57.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:57.817 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-17T23:00:57.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 msgr2=0x7f7088068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 0x7f7088068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70a00b2000 tx=0x7f70a00aa070 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 msgr2=0x7f70b0146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70a800ca40 tx=0x7f70a800cf00 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 shutdown_connections 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7088066840 0x7f7088068d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b0159ff0 0x7f70b0146070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f70b0153860 0x7f70b014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 --2- 172.21.15.67:0/3139983306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f70b0061530 0x7f70b0147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 >> 172.21.15.67:0/3139983306 conn(0x7f70b00c8160 msgr2=0x7f70b00c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 shutdown_connections 2024-01-17T23:00:57.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:57.807+0000 7f70b7200640 1 -- 172.21.15.67:0/3139983306 wait complete. 2024-01-17T23:00:57.835 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-17T23:00:55.935011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218736,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755984,"statfs":{"total":773094113280,"available":772870127616,"internally_reserved":0,"allocated":2654208,"data_stored":2197862,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005569"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079579+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-17T23:00:33.079579+0000","last_peered":"2024-01-17T23:00:33.079579+0000","last_clean":"2024-01-17T23:00:33.079579+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-17T23:00:33.079579+0000","last_undegraded":"2024-01-17T23:00:33.079579+0000","last_fullsized":"2024-01-17T23:00:33.079579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077894+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.077894+0000","last_peered":"2024-01-17T23:00:33.077894+0000","last_clean":"2024-01-17T23:00:33.077894+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-17T23:00:33.077894+0000","last_undegraded":"2024-01-17T23:00:33.077894+0000","last_fullsized":"2024-01-17T23:00:33.077894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075877+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-17T23:00:33.075877+0000","last_peered":"2024-01-17T23:00:33.075877+0000","last_clean":"2024-01-17T23:00:33.075877+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-17T23:00:33.075877+0000","last_undegraded":"2024-01-17T23:00:33.075877+0000","last_fullsized":"2024-01-17T23:00:33.075877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078088+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-17T23:00:33.078088+0000","last_peered":"2024-01-17T23:00:33.078088+0000","last_clean":"2024-01-17T23:00:33.078088+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-17T23:00:33.078088+0000","last_undegraded":"2024-01-17T23:00:33.078088+0000","last_fullsized":"2024-01-17T23:00:33.078088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079362+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-17T23:00:33.079362+0000","last_peered":"2024-01-17T23:00:33.079362+0000","last_clean":"2024-01-17T23:00:33.079362+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-17T23:00:33.079362+0000","last_undegraded":"2024-01-17T23:00:33.079362+0000","last_fullsized":"2024-01-17T23:00:33.079362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093022+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-17T23:00:33.093022+0000","last_peered":"2024-01-17T23:00:33.093022+0000","last_clean":"2024-01-17T23:00:33.093022+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-17T23:00:33.093022+0000","last_undegraded":"2024-01-17T23:00:33.093022+0000","last_fullsized":"2024-01-17T23:00:33.093022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091521+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-17T23:00:33.091521+0000","last_peered":"2024-01-17T23:00:33.091521+0000","last_clean":"2024-01-17T23:00:33.091521+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-17T23:00:33.091521+0000","last_undegraded":"2024-01-17T23:00:33.091521+0000","last_fullsized":"2024-01-17T23:00:33.091521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080814+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-17T23:00:33.080814+0000","last_peered":"2024-01-17T23:00:33.080814+0000","last_clean":"2024-01-17T23:00:33.080814+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-17T23:00:33.080814+0000","last_undegraded":"2024-01-17T23:00:33.080814+0000","last_fullsized":"2024-01-17T23:00:33.080814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093362+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-17T23:00:33.093362+0000","last_peered":"2024-01-17T23:00:33.093362+0000","last_clean":"2024-01-17T23:00:33.093362+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-17T23:00:33.093362+0000","last_undegraded":"2024-01-17T23:00:33.093362+0000","last_fullsized":"2024-01-17T23:00:33.093362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089926+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-17T23:00:33.089926+0000","last_peered":"2024-01-17T23:00:33.089926+0000","last_clean":"2024-01-17T23:00:33.089926+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-17T23:00:33.089926+0000","last_undegraded":"2024-01-17T23:00:33.089926+0000","last_fullsized":"2024-01-17T23:00:33.089926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080653+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-17T23:00:33.080653+0000","last_peered":"2024-01-17T23:00:33.080653+0000","last_clean":"2024-01-17T23:00:33.080653+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-17T23:00:33.080653+0000","last_undegraded":"2024-01-17T23:00:33.080653+0000","last_fullsized":"2024-01-17T23:00:33.080653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092397+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-17T23:00:33.092397+0000","last_peered":"2024-01-17T23:00:33.092397+0000","last_clean":"2024-01-17T23:00:33.092397+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-17T23:00:33.092397+0000","last_undegraded":"2024-01-17T23:00:33.092397+0000","last_fullsized":"2024-01-17T23:00:33.092397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082880+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-17T23:00:33.082880+0000","last_peered":"2024-01-17T23:00:33.082880+0000","last_clean":"2024-01-17T23:00:33.082880+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-17T23:00:33.082880+0000","last_undegraded":"2024-01-17T23:00:33.082880+0000","last_fullsized":"2024-01-17T23:00:33.082880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089884+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-17T23:00:33.089884+0000","last_peered":"2024-01-17T23:00:33.089884+0000","last_clean":"2024-01-17T23:00:33.089884+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-17T23:00:33.089884+0000","last_undegraded":"2024-01-17T23:00:33.089884+0000","last_fullsized":"2024-01-17T23:00:33.089884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095174+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-17T23:00:33.095174+0000","last_peered":"2024-01-17T23:00:33.095174+0000","last_clean":"2024-01-17T23:00:33.095174+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-17T23:00:33.095174+0000","last_undegraded":"2024-01-17T23:00:33.095174+0000","last_fullsized":"2024-01-17T23:00:33.095174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076603+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-17T23:00:33.076603+0000","last_peered":"2024-01-17T23:00:33.076603+0000","last_clean":"2024-01-17T23:00:33.076603+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-17T23:00:33.076603+0000","last_undegraded":"2024-01-17T23:00:33.076603+0000","last_fullsized":"2024-01-17T23:00:33.076603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081106+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-17T23:00:33.081106+0000","last_peered":"2024-01-17T23:00:33.081106+0000","last_clean":"2024-01-17T23:00:33.081106+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-17T23:00:33.081106+0000","last_undegraded":"2024-01-17T23:00:33.081106+0000","last_fullsized":"2024-01-17T23:00:33.081106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093356+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-17T23:00:33.093356+0000","last_peered":"2024-01-17T23:00:33.093356+0000","last_clean":"2024-01-17T23:00:33.093356+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-17T23:00:33.093356+0000","last_undegraded":"2024-01-17T23:00:33.093356+0000","last_fullsized":"2024-01-17T23:00:33.093356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075816+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-17T23:00:33.075816+0000","last_peered":"2024-01-17T23:00:33.075816+0000","last_clean":"2024-01-17T23:00:33.075816+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-17T23:00:33.075816+0000","last_undegraded":"2024-01-17T23:00:33.075816+0000","last_fullsized":"2024-01-17T23:00:33.075816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080255+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-17T23:00:33.080255+0000","last_peered":"2024-01-17T23:00:33.080255+0000","last_clean":"2024-01-17T23:00:33.080255+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-17T23:00:33.080255+0000","last_undegraded":"2024-01-17T23:00:33.080255+0000","last_fullsized":"2024-01-17T23:00:33.080255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077169+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-17T23:00:33.077169+0000","last_peered":"2024-01-17T23:00:33.077169+0000","last_clean":"2024-01-17T23:00:33.077169+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-17T23:00:33.077169+0000","last_undegraded":"2024-01-17T23:00:33.077169+0000","last_fullsized":"2024-01-17T23:00:33.077169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092641+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-17T23:00:33.092641+0000","last_peered":"2024-01-17T23:00:33.092641+0000","last_clean":"2024-01-17T23:00:33.092641+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-17T23:00:33.092641+0000","last_undegraded":"2024-01-17T23:00:33.092641+0000","last_fullsized":"2024-01-17T23:00:33.092641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088759+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-17T23:00:33.088759+0000","last_peered":"2024-01-17T23:00:33.088759+0000","last_clean":"2024-01-17T23:00:33.088759+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-17T23:00:33.088759+0000","last_undegraded":"2024-01-17T23:00:33.088759+0000","last_fullsized":"2024-01-17T23:00:33.088759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095681+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-17T23:00:33.095681+0000","last_peered":"2024-01-17T23:00:33.095681+0000","last_clean":"2024-01-17T23:00:33.095681+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-17T23:00:33.095681+0000","last_undegraded":"2024-01-17T23:00:33.095681+0000","last_fullsized":"2024-01-17T23:00:33.095681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079343+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-17T23:00:33.079343+0000","last_peered":"2024-01-17T23:00:33.079343+0000","last_clean":"2024-01-17T23:00:33.079343+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-17T23:00:33.079343+0000","last_undegraded":"2024-01-17T23:00:33.079343+0000","last_fullsized":"2024-01-17T23:00:33.079343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087333+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-17T23:00:33.087333+0000","last_peered":"2024-01-17T23:00:33.087333+0000","last_clean":"2024-01-17T23:00:33.087333+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-17T23:00:33.087333+0000","last_undegraded":"2024-01-17T23:00:33.087333+0000","last_fullsized":"2024-01-17T23:00:33.087333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092000+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-17T23:00:33.092000+0000","last_peered":"2024-01-17T23:00:33.092000+0000","last_clean":"2024-01-17T23:00:33.092000+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-17T23:00:33.092000+0000","last_undegraded":"2024-01-17T23:00:33.092000+0000","last_fullsized":"2024-01-17T23:00:33.092000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076680+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-17T23:00:33.076680+0000","last_peered":"2024-01-17T23:00:33.076680+0000","last_clean":"2024-01-17T23:00:33.076680+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-17T23:00:33.076680+0000","last_undegraded":"2024-01-17T23:00:33.076680+0000","last_fullsized":"2024-01-17T23:00:33.076680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078207+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-17T23:00:33.078207+0000","last_peered":"2024-01-17T23:00:33.078207+0000","last_clean":"2024-01-17T23:00:33.078207+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-17T23:00:33.078207+0000","last_undegraded":"2024-01-17T23:00:33.078207+0000","last_fullsized":"2024-01-17T23:00:33.078207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075915+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-17T23:00:33.075915+0000","last_peered":"2024-01-17T23:00:33.075915+0000","last_clean":"2024-01-17T23:00:33.075915+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-17T23:00:33.075915+0000","last_undegraded":"2024-01-17T23:00:33.075915+0000","last_fullsized":"2024-01-17T23:00:33.075915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079329+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-17T23:00:33.079329+0000","last_peered":"2024-01-17T23:00:33.079329+0000","last_clean":"2024-01-17T23:00:33.079329+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-17T23:00:33.079329+0000","last_undegraded":"2024-01-17T23:00:33.079329+0000","last_fullsized":"2024-01-17T23:00:33.079329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091954+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-17T23:00:33.091954+0000","last_peered":"2024-01-17T23:00:33.091954+0000","last_clean":"2024-01-17T23:00:33.091954+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-17T23:00:33.091954+0000","last_undegraded":"2024-01-17T23:00:33.091954+0000","last_fullsized":"2024-01-17T23:00:33.091954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078545+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-17T23:00:33.078545+0000","last_peered":"2024-01-17T23:00:33.078545+0000","last_clean":"2024-01-17T23:00:33.078545+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-17T23:00:33.078545+0000","last_undegraded":"2024-01-17T23:00:33.078545+0000","last_fullsized":"2024-01-17T23:00:33.078545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080738+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-17T23:00:33.080738+0000","last_peered":"2024-01-17T23:00:33.080738+0000","last_clean":"2024-01-17T23:00:33.080738+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-17T23:00:33.080738+0000","last_undegraded":"2024-01-17T23:00:33.080738+0000","last_fullsized":"2024-01-17T23:00:33.080738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079407+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-17T23:00:33.079407+0000","last_peered":"2024-01-17T23:00:33.079407+0000","last_clean":"2024-01-17T23:00:33.079407+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-17T23:00:33.079407+0000","last_undegraded":"2024-01-17T23:00:33.079407+0000","last_fullsized":"2024-01-17T23:00:33.079407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080349+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-17T23:00:33.080349+0000","last_peered":"2024-01-17T23:00:33.080349+0000","last_clean":"2024-01-17T23:00:33.080349+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-17T23:00:33.080349+0000","last_undegraded":"2024-01-17T23:00:33.080349+0000","last_fullsized":"2024-01-17T23:00:33.080349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-17T23:00:33.093635+0000","last_peered":"2024-01-17T23:00:33.093635+0000","last_clean":"2024-01-17T23:00:33.093635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-17T23:00:33.093635+0000","last_undegraded":"2024-01-17T23:00:33.093635+0000","last_fullsized":"2024-01-17T23:00:33.093635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083611+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-17T23:00:33.083611+0000","last_peered":"2024-01-17T23:00:33.083611+0000","last_clean":"2024-01-17T23:00:33.083611+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-17T23:00:33.083611+0000","last_undegraded":"2024-01-17T23:00:33.083611+0000","last_fullsized":"2024-01-17T23:00:33.083611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076437+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-17T23:00:33.076437+0000","last_peered":"2024-01-17T23:00:33.076437+0000","last_clean":"2024-01-17T23:00:33.076437+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-17T23:00:33.076437+0000","last_undegraded":"2024-01-17T23:00:33.076437+0000","last_fullsized":"2024-01-17T23:00:33.076437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072962+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-17T23:00:33.072962+0000","last_peered":"2024-01-17T23:00:33.072962+0000","last_clean":"2024-01-17T23:00:33.072962+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:33.072962+0000","last_undegraded":"2024-01-17T23:00:33.072962+0000","last_fullsized":"2024-01-17T23:00:33.072962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088953+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-17T23:00:33.088953+0000","last_peered":"2024-01-17T23:00:33.088953+0000","last_clean":"2024-01-17T23:00:33.088953+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-17T23:00:33.088953+0000","last_undegraded":"2024-01-17T23:00:33.088953+0000","last_fullsized":"2024-01-17T23:00:33.088953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079933+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-17T23:00:33.079933+0000","last_peered":"2024-01-17T23:00:33.079933+0000","last_clean":"2024-01-17T23:00:33.079933+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-17T23:00:33.079933+0000","last_undegraded":"2024-01-17T23:00:33.079933+0000","last_fullsized":"2024-01-17T23:00:33.079933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076809+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-17T23:00:33.076809+0000","last_peered":"2024-01-17T23:00:33.076809+0000","last_clean":"2024-01-17T23:00:33.076809+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-17T23:00:33.076809+0000","last_undegraded":"2024-01-17T23:00:33.076809+0000","last_fullsized":"2024-01-17T23:00:33.076809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081484+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-17T23:00:33.081484+0000","last_peered":"2024-01-17T23:00:33.081484+0000","last_clean":"2024-01-17T23:00:33.081484+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-17T23:00:33.081484+0000","last_undegraded":"2024-01-17T23:00:33.081484+0000","last_fullsized":"2024-01-17T23:00:33.081484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089167+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-17T23:00:33.089167+0000","last_peered":"2024-01-17T23:00:33.089167+0000","last_clean":"2024-01-17T23:00:33.089167+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-17T23:00:33.089167+0000","last_undegraded":"2024-01-17T23:00:33.089167+0000","last_fullsized":"2024-01-17T23:00:33.089167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085186+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-17T23:00:33.085186+0000","last_peered":"2024-01-17T23:00:33.085186+0000","last_clean":"2024-01-17T23:00:33.085186+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-17T23:00:33.085186+0000","last_undegraded":"2024-01-17T23:00:33.085186+0000","last_fullsized":"2024-01-17T23:00:33.085186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091113+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-17T23:00:33.091113+0000","last_peered":"2024-01-17T23:00:33.091113+0000","last_clean":"2024-01-17T23:00:33.091113+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-17T23:00:33.091113+0000","last_undegraded":"2024-01-17T23:00:33.091113+0000","last_fullsized":"2024-01-17T23:00:33.091113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073171+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-17T23:00:33.073171+0000","last_peered":"2024-01-17T23:00:33.073171+0000","last_clean":"2024-01-17T23:00:33.073171+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-17T23:00:33.073171+0000","last_undegraded":"2024-01-17T23:00:33.073171+0000","last_fullsized":"2024-01-17T23:00:33.073171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082790+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-17T23:00:33.082790+0000","last_peered":"2024-01-17T23:00:33.082790+0000","last_clean":"2024-01-17T23:00:33.082790+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-17T23:00:33.082790+0000","last_undegraded":"2024-01-17T23:00:33.082790+0000","last_fullsized":"2024-01-17T23:00:33.082790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081012+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-17T23:00:33.081012+0000","last_peered":"2024-01-17T23:00:33.081012+0000","last_clean":"2024-01-17T23:00:33.081012+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-17T23:00:33.081012+0000","last_undegraded":"2024-01-17T23:00:33.081012+0000","last_fullsized":"2024-01-17T23:00:33.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076923+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-17T23:00:33.076923+0000","last_peered":"2024-01-17T23:00:33.076923+0000","last_clean":"2024-01-17T23:00:33.076923+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-17T23:00:33.076923+0000","last_undegraded":"2024-01-17T23:00:33.076923+0000","last_fullsized":"2024-01-17T23:00:33.076923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078627+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-17T23:00:33.078627+0000","last_peered":"2024-01-17T23:00:33.078627+0000","last_clean":"2024-01-17T23:00:33.078627+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-17T23:00:33.078627+0000","last_undegraded":"2024-01-17T23:00:33.078627+0000","last_fullsized":"2024-01-17T23:00:33.078627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091728+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-17T23:00:33.091728+0000","last_peered":"2024-01-17T23:00:33.091728+0000","last_clean":"2024-01-17T23:00:33.091728+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-17T23:00:33.091728+0000","last_undegraded":"2024-01-17T23:00:33.091728+0000","last_fullsized":"2024-01-17T23:00:33.091728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073276+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-17T23:00:33.073276+0000","last_peered":"2024-01-17T23:00:33.073276+0000","last_clean":"2024-01-17T23:00:33.073276+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:33.073276+0000","last_undegraded":"2024-01-17T23:00:33.073276+0000","last_fullsized":"2024-01-17T23:00:33.073276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079044+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-17T23:00:33.079044+0000","last_peered":"2024-01-17T23:00:33.079044+0000","last_clean":"2024-01-17T23:00:33.079044+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-17T23:00:33.079044+0000","last_undegraded":"2024-01-17T23:00:33.079044+0000","last_fullsized":"2024-01-17T23:00:33.079044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.090852+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-17T23:00:33.090852+0000","last_peered":"2024-01-17T23:00:33.090852+0000","last_clean":"2024-01-17T23:00:33.090852+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-17T23:00:33.090852+0000","last_undegraded":"2024-01-17T23:00:33.090852+0000","last_fullsized":"2024-01-17T23:00:33.090852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095187+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-17T23:00:33.095187+0000","last_peered":"2024-01-17T23:00:33.095187+0000","last_clean":"2024-01-17T23:00:33.095187+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-17T23:00:33.095187+0000","last_undegraded":"2024-01-17T23:00:33.095187+0000","last_fullsized":"2024-01-17T23:00:33.095187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091573+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-17T23:00:33.091573+0000","last_peered":"2024-01-17T23:00:33.091573+0000","last_clean":"2024-01-17T23:00:33.091573+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-17T23:00:33.091573+0000","last_undegraded":"2024-01-17T23:00:33.091573+0000","last_fullsized":"2024-01-17T23:00:33.091573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088626+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-17T23:00:33.088626+0000","last_peered":"2024-01-17T23:00:33.088626+0000","last_clean":"2024-01-17T23:00:33.088626+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-17T23:00:33.088626+0000","last_undegraded":"2024-01-17T23:00:33.088626+0000","last_fullsized":"2024-01-17T23:00:33.088626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072843+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-17T23:00:33.072843+0000","last_peered":"2024-01-17T23:00:33.072843+0000","last_clean":"2024-01-17T23:00:33.072843+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-17T23:00:33.072843+0000","last_undegraded":"2024-01-17T23:00:33.072843+0000","last_fullsized":"2024-01-17T23:00:33.072843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079212+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-17T23:00:33.079212+0000","last_peered":"2024-01-17T23:00:33.079212+0000","last_clean":"2024-01-17T23:00:33.079212+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-17T23:00:33.079212+0000","last_undegraded":"2024-01-17T23:00:33.079212+0000","last_fullsized":"2024-01-17T23:00:33.079212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083426+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-17T23:00:33.083426+0000","last_peered":"2024-01-17T23:00:33.083426+0000","last_clean":"2024-01-17T23:00:33.083426+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-17T23:00:33.083426+0000","last_undegraded":"2024-01-17T23:00:33.083426+0000","last_fullsized":"2024-01-17T23:00:33.083426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.084625+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-17T23:00:33.084625+0000","last_peered":"2024-01-17T23:00:33.084625+0000","last_clean":"2024-01-17T23:00:33.084625+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-17T23:00:33.084625+0000","last_undegraded":"2024-01-17T23:00:33.084625+0000","last_fullsized":"2024-01-17T23:00:33.084625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076521+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-17T23:00:33.076521+0000","last_peered":"2024-01-17T23:00:33.076521+0000","last_clean":"2024-01-17T23:00:33.076521+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-17T23:00:33.076521+0000","last_undegraded":"2024-01-17T23:00:33.076521+0000","last_fullsized":"2024-01-17T23:00:33.076521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089619+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-17T23:00:33.089619+0000","last_peered":"2024-01-17T23:00:33.089619+0000","last_clean":"2024-01-17T23:00:33.089619+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-17T23:00:33.089619+0000","last_undegraded":"2024-01-17T23:00:33.089619+0000","last_fullsized":"2024-01-17T23:00:33.089619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083407+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-17T23:00:33.083407+0000","last_peered":"2024-01-17T23:00:33.083407+0000","last_clean":"2024-01-17T23:00:33.083407+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-17T23:00:33.083407+0000","last_undegraded":"2024-01-17T23:00:33.083407+0000","last_fullsized":"2024-01-17T23:00:33.083407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075820+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-17T23:00:33.075820+0000","last_peered":"2024-01-17T23:00:33.075820+0000","last_clean":"2024-01-17T23:00:33.075820+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-17T23:00:33.075820+0000","last_undegraded":"2024-01-17T23:00:33.075820+0000","last_fullsized":"2024-01-17T23:00:33.075820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078004+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-17T23:00:33.078004+0000","last_peered":"2024-01-17T23:00:33.078004+0000","last_clean":"2024-01-17T23:00:33.078004+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-17T23:00:33.078004+0000","last_undegraded":"2024-01-17T23:00:33.078004+0000","last_fullsized":"2024-01-17T23:00:33.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078823+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-17T23:00:33.078823+0000","last_peered":"2024-01-17T23:00:33.078823+0000","last_clean":"2024-01-17T23:00:33.078823+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-17T23:00:33.078823+0000","last_undegraded":"2024-01-17T23:00:33.078823+0000","last_fullsized":"2024-01-17T23:00:33.078823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080561+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-17T23:00:33.080561+0000","last_peered":"2024-01-17T23:00:33.080561+0000","last_clean":"2024-01-17T23:00:33.080561+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-17T23:00:33.080561+0000","last_undegraded":"2024-01-17T23:00:33.080561+0000","last_fullsized":"2024-01-17T23:00:33.080561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089862+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-17T23:00:33.089862+0000","last_peered":"2024-01-17T23:00:33.089862+0000","last_clean":"2024-01-17T23:00:33.089862+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-17T23:00:33.089862+0000","last_undegraded":"2024-01-17T23:00:33.089862+0000","last_fullsized":"2024-01-17T23:00:33.089862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'10","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.815542+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-17T23:00:34.815542+0000","last_peered":"2024-01-17T23:00:34.815542+0000","last_clean":"2024-01-17T23:00:34.815542+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-17T23:00:34.815542+0000","last_undegraded":"2024-01-17T23:00:34.815542+0000","last_fullsized":"2024-01-17T23:00:34.815542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.690081+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-17T23:00:34.690081+0000","last_peered":"2024-01-17T23:00:34.690081+0000","last_clean":"2024-01-17T23:00:34.690081+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-17T23:00:34.690081+0000","last_undegraded":"2024-01-17T23:00:34.690081+0000","last_fullsized":"2024-01-17T23:00:34.690081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095175+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-17T23:00:33.095175+0000","last_peered":"2024-01-17T23:00:33.095175+0000","last_clean":"2024-01-17T23:00:33.095175+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-17T23:00:33.095175+0000","last_undegraded":"2024-01-17T23:00:33.095175+0000","last_fullsized":"2024-01-17T23:00:33.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076844+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-17T23:00:33.076844+0000","last_peered":"2024-01-17T23:00:33.076844+0000","last_clean":"2024-01-17T23:00:33.076844+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-17T23:00:33.076844+0000","last_undegraded":"2024-01-17T23:00:33.076844+0000","last_fullsized":"2024-01-17T23:00:33.076844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093112+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-17T23:00:33.093112+0000","last_peered":"2024-01-17T23:00:33.093112+0000","last_clean":"2024-01-17T23:00:33.093112+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-17T23:00:33.093112+0000","last_undegraded":"2024-01-17T23:00:33.093112+0000","last_fullsized":"2024-01-17T23:00:33.093112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079491+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-17T23:00:33.079491+0000","last_peered":"2024-01-17T23:00:33.079491+0000","last_clean":"2024-01-17T23:00:33.079491+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-17T23:00:33.079491+0000","last_undegraded":"2024-01-17T23:00:33.079491+0000","last_fullsized":"2024-01-17T23:00:33.079491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080801+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-17T23:00:33.080801+0000","last_peered":"2024-01-17T23:00:33.080801+0000","last_clean":"2024-01-17T23:00:33.080801+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-17T23:00:33.080801+0000","last_undegraded":"2024-01-17T23:00:33.080801+0000","last_fullsized":"2024-01-17T23:00:33.080801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075647+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-17T23:00:33.075647+0000","last_peered":"2024-01-17T23:00:33.075647+0000","last_clean":"2024-01-17T23:00:33.075647+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-17T23:00:33.075647+0000","last_undegraded":"2024-01-17T23:00:33.075647+0000","last_fullsized":"2024-01-17T23:00:33.075647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080583+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-17T23:00:33.080583+0000","last_peered":"2024-01-17T23:00:33.080583+0000","last_clean":"2024-01-17T23:00:33.080583+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-17T23:00:33.080583+0000","last_undegraded":"2024-01-17T23:00:33.080583+0000","last_fullsized":"2024-01-17T23:00:33.080583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086870+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-17T23:00:33.086870+0000","last_peered":"2024-01-17T23:00:33.086870+0000","last_clean":"2024-01-17T23:00:33.086870+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-17T23:00:33.086870+0000","last_undegraded":"2024-01-17T23:00:33.086870+0000","last_fullsized":"2024-01-17T23:00:33.086870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076683+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-17T23:00:33.076683+0000","last_peered":"2024-01-17T23:00:33.076683+0000","last_clean":"2024-01-17T23:00:33.076683+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-17T23:00:33.076683+0000","last_undegraded":"2024-01-17T23:00:33.076683+0000","last_fullsized":"2024-01-17T23:00:33.076683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079127+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-17T23:00:33.079127+0000","last_peered":"2024-01-17T23:00:33.079127+0000","last_clean":"2024-01-17T23:00:33.079127+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-17T23:00:33.079127+0000","last_undegraded":"2024-01-17T23:00:33.079127+0000","last_fullsized":"2024-01-17T23:00:33.079127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080106+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-17T23:00:33.080106+0000","last_peered":"2024-01-17T23:00:33.080106+0000","last_clean":"2024-01-17T23:00:33.080106+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-17T23:00:33.080106+0000","last_undegraded":"2024-01-17T23:00:33.080106+0000","last_fullsized":"2024-01-17T23:00:33.080106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079409+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-17T23:00:33.079409+0000","last_peered":"2024-01-17T23:00:33.079409+0000","last_clean":"2024-01-17T23:00:33.079409+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-17T23:00:33.079409+0000","last_undegraded":"2024-01-17T23:00:33.079409+0000","last_fullsized":"2024-01-17T23:00:33.079409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086481+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-17T23:00:33.086481+0000","last_peered":"2024-01-17T23:00:33.086481+0000","last_clean":"2024-01-17T23:00:33.086481+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-17T23:00:33.086481+0000","last_undegraded":"2024-01-17T23:00:33.086481+0000","last_fullsized":"2024-01-17T23:00:33.086481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075738+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-17T23:00:33.075738+0000","last_peered":"2024-01-17T23:00:33.075738+0000","last_clean":"2024-01-17T23:00:33.075738+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-17T23:00:33.075738+0000","last_undegraded":"2024-01-17T23:00:33.075738+0000","last_fullsized":"2024-01-17T23:00:33.075738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078135+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-17T23:00:33.078135+0000","last_peered":"2024-01-17T23:00:33.078135+0000","last_clean":"2024-01-17T23:00:33.078135+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-17T23:00:33.078135+0000","last_undegraded":"2024-01-17T23:00:33.078135+0000","last_fullsized":"2024-01-17T23:00:33.078135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083872+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-17T23:00:33.083872+0000","last_peered":"2024-01-17T23:00:33.083872+0000","last_clean":"2024-01-17T23:00:33.083872+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-17T23:00:33.083872+0000","last_undegraded":"2024-01-17T23:00:33.083872+0000","last_fullsized":"2024-01-17T23:00:33.083872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078709+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-17T23:00:33.078709+0000","last_peered":"2024-01-17T23:00:33.078709+0000","last_clean":"2024-01-17T23:00:33.078709+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-17T23:00:33.078709+0000","last_undegraded":"2024-01-17T23:00:33.078709+0000","last_fullsized":"2024-01-17T23:00:33.078709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461070+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-17T23:00:34.461070+0000","last_peered":"2024-01-17T23:00:34.461070+0000","last_clean":"2024-01-17T23:00:34.461070+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-17T23:00:34.461070+0000","last_undegraded":"2024-01-17T23:00:34.461070+0000","last_fullsized":"2024-01-17T23:00:34.461070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076686+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-17T23:00:33.076686+0000","last_peered":"2024-01-17T23:00:33.076686+0000","last_clean":"2024-01-17T23:00:33.076686+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-17T23:00:33.076686+0000","last_undegraded":"2024-01-17T23:00:33.076686+0000","last_fullsized":"2024-01-17T23:00:33.076686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093476+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-17T23:00:33.093476+0000","last_peered":"2024-01-17T23:00:33.093476+0000","last_clean":"2024-01-17T23:00:33.093476+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-17T23:00:33.093476+0000","last_undegraded":"2024-01-17T23:00:33.093476+0000","last_fullsized":"2024-01-17T23:00:33.093476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076015+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-17T23:00:33.076015+0000","last_peered":"2024-01-17T23:00:33.076015+0000","last_clean":"2024-01-17T23:00:33.076015+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-17T23:00:33.076015+0000","last_undegraded":"2024-01-17T23:00:33.076015+0000","last_fullsized":"2024-01-17T23:00:33.076015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083061+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-17T23:00:33.083061+0000","last_peered":"2024-01-17T23:00:33.083061+0000","last_clean":"2024-01-17T23:00:33.083061+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-17T23:00:33.083061+0000","last_undegraded":"2024-01-17T23:00:33.083061+0000","last_fullsized":"2024-01-17T23:00:33.083061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072920+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-17T23:00:33.072920+0000","last_peered":"2024-01-17T23:00:33.072920+0000","last_clean":"2024-01-17T23:00:33.072920+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-17T23:00:33.072920+0000","last_undegraded":"2024-01-17T23:00:33.072920+0000","last_fullsized":"2024-01-17T23:00:33.072920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083196+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-17T23:00:33.083196+0000","last_peered":"2024-01-17T23:00:33.083196+0000","last_clean":"2024-01-17T23:00:33.083196+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-17T23:00:33.083196+0000","last_undegraded":"2024-01-17T23:00:33.083196+0000","last_fullsized":"2024-01-17T23:00:33.083196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078650+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-17T23:00:33.078650+0000","last_peered":"2024-01-17T23:00:33.078650+0000","last_clean":"2024-01-17T23:00:33.078650+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-17T23:00:33.078650+0000","last_undegraded":"2024-01-17T23:00:33.078650+0000","last_fullsized":"2024-01-17T23:00:33.078650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.119356+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-17T23:00:34.119356+0000","last_peered":"2024-01-17T23:00:34.119356+0000","last_clean":"2024-01-17T23:00:34.119356+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-17T23:00:34.119356+0000","last_undegraded":"2024-01-17T23:00:34.119356+0000","last_fullsized":"2024-01-17T23:00:34.119356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076708+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-17T23:00:33.076708+0000","last_peered":"2024-01-17T23:00:33.076708+0000","last_clean":"2024-01-17T23:00:33.076708+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-17T23:00:33.076708+0000","last_undegraded":"2024-01-17T23:00:33.076708+0000","last_fullsized":"2024-01-17T23:00:33.076708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087751+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-17T23:00:33.087751+0000","last_peered":"2024-01-17T23:00:33.087751+0000","last_clean":"2024-01-17T23:00:33.087751+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-17T23:00:33.087751+0000","last_undegraded":"2024-01-17T23:00:33.087751+0000","last_fullsized":"2024-01-17T23:00:33.087751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076601+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-17T23:00:33.076601+0000","last_peered":"2024-01-17T23:00:33.076601+0000","last_clean":"2024-01-17T23:00:33.076601+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-17T23:00:33.076601+0000","last_undegraded":"2024-01-17T23:00:33.076601+0000","last_fullsized":"2024-01-17T23:00:33.076601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.198264+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-17T23:00:34.198264+0000","last_peered":"2024-01-17T23:00:34.198264+0000","last_clean":"2024-01-17T23:00:34.198264+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-17T23:00:34.198264+0000","last_undegraded":"2024-01-17T23:00:34.198264+0000","last_fullsized":"2024-01-17T23:00:34.198264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077231+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-17T23:00:33.077231+0000","last_peered":"2024-01-17T23:00:33.077231+0000","last_clean":"2024-01-17T23:00:33.077231+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-17T23:00:33.077231+0000","last_undegraded":"2024-01-17T23:00:33.077231+0000","last_fullsized":"2024-01-17T23:00:33.077231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082984+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-17T23:00:33.082984+0000","last_peered":"2024-01-17T23:00:33.082984+0000","last_clean":"2024-01-17T23:00:33.082984+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-17T23:00:33.082984+0000","last_undegraded":"2024-01-17T23:00:33.082984+0000","last_fullsized":"2024-01-17T23:00:33.082984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078535+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-17T23:00:33.078535+0000","last_peered":"2024-01-17T23:00:33.078535+0000","last_clean":"2024-01-17T23:00:33.078535+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-17T23:00:33.078535+0000","last_undegraded":"2024-01-17T23:00:33.078535+0000","last_fullsized":"2024-01-17T23:00:33.078535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085492+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-17T23:00:33.085492+0000","last_peered":"2024-01-17T23:00:33.085492+0000","last_clean":"2024-01-17T23:00:33.085492+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-17T23:00:33.085492+0000","last_undegraded":"2024-01-17T23:00:33.085492+0000","last_fullsized":"2024-01-17T23:00:33.085492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091752+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-17T23:00:33.091752+0000","last_peered":"2024-01-17T23:00:33.091752+0000","last_clean":"2024-01-17T23:00:33.091752+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-17T23:00:33.091752+0000","last_undegraded":"2024-01-17T23:00:33.091752+0000","last_fullsized":"2024-01-17T23:00:33.091752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073164+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-17T23:00:33.073164+0000","last_peered":"2024-01-17T23:00:33.073164+0000","last_clean":"2024-01-17T23:00:33.073164+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-17T23:00:33.073164+0000","last_undegraded":"2024-01-17T23:00:33.073164+0000","last_fullsized":"2024-01-17T23:00:33.073164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082519+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-17T23:00:33.082519+0000","last_peered":"2024-01-17T23:00:33.082519+0000","last_clean":"2024-01-17T23:00:33.082519+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-17T23:00:33.082519+0000","last_undegraded":"2024-01-17T23:00:33.082519+0000","last_fullsized":"2024-01-17T23:00:33.082519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079246+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-17T23:00:33.079246+0000","last_peered":"2024-01-17T23:00:33.079246+0000","last_clean":"2024-01-17T23:00:33.079246+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-17T23:00:33.079246+0000","last_undegraded":"2024-01-17T23:00:33.079246+0000","last_fullsized":"2024-01-17T23:00:33.079246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080180+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-17T23:00:33.080180+0000","last_peered":"2024-01-17T23:00:33.080180+0000","last_clean":"2024-01-17T23:00:33.080180+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-17T23:00:33.080180+0000","last_undegraded":"2024-01-17T23:00:33.080180+0000","last_fullsized":"2024-01-17T23:00:33.080180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077927+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-17T23:00:33.077927+0000","last_peered":"2024-01-17T23:00:33.077927+0000","last_clean":"2024-01-17T23:00:33.077927+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-17T23:00:33.077927+0000","last_undegraded":"2024-01-17T23:00:33.077927+0000","last_fullsized":"2024-01-17T23:00:33.077927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076524+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.076524+0000","last_peered":"2024-01-17T23:00:33.076524+0000","last_clean":"2024-01-17T23:00:33.076524+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-17T23:00:33.076524+0000","last_undegraded":"2024-01-17T23:00:33.076524+0000","last_fullsized":"2024-01-17T23:00:33.076524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093770+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-17T23:00:33.093770+0000","last_peered":"2024-01-17T23:00:33.093770+0000","last_clean":"2024-01-17T23:00:33.093770+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-17T23:00:33.093770+0000","last_undegraded":"2024-01-17T23:00:33.093770+0000","last_fullsized":"2024-01-17T23:00:33.093770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086205+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-17T23:00:33.086205+0000","last_peered":"2024-01-17T23:00:33.086205+0000","last_clean":"2024-01-17T23:00:33.086205+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-17T23:00:33.086205+0000","last_undegraded":"2024-01-17T23:00:33.086205+0000","last_fullsized":"2024-01-17T23:00:33.086205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087532+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-17T23:00:33.087532+0000","last_peered":"2024-01-17T23:00:33.087532+0000","last_clean":"2024-01-17T23:00:33.087532+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-17T23:00:33.087532+0000","last_undegraded":"2024-01-17T23:00:33.087532+0000","last_fullsized":"2024-01-17T23:00:33.087532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091518+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-17T23:00:33.091518+0000","last_peered":"2024-01-17T23:00:33.091518+0000","last_clean":"2024-01-17T23:00:33.091518+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-17T23:00:33.091518+0000","last_undegraded":"2024-01-17T23:00:33.091518+0000","last_fullsized":"2024-01-17T23:00:33.091518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075564+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-17T23:00:33.075564+0000","last_peered":"2024-01-17T23:00:33.075564+0000","last_clean":"2024-01-17T23:00:33.075564+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-17T23:00:33.075564+0000","last_undegraded":"2024-01-17T23:00:33.075564+0000","last_fullsized":"2024-01-17T23:00:33.075564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.459766+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-17T23:00:34.459766+0000","last_peered":"2024-01-17T23:00:34.459766+0000","last_clean":"2024-01-17T23:00:34.459766+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-17T23:00:34.459766+0000","last_undegraded":"2024-01-17T23:00:34.459766+0000","last_fullsized":"2024-01-17T23:00:34.459766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086625+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-17T23:00:33.086625+0000","last_peered":"2024-01-17T23:00:33.086625+0000","last_clean":"2024-01-17T23:00:33.086625+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-17T23:00:33.086625+0000","last_undegraded":"2024-01-17T23:00:33.086625+0000","last_fullsized":"2024-01-17T23:00:33.086625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080592+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-17T23:00:33.080592+0000","last_peered":"2024-01-17T23:00:33.080592+0000","last_clean":"2024-01-17T23:00:33.080592+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-17T23:00:33.080592+0000","last_undegraded":"2024-01-17T23:00:33.080592+0000","last_fullsized":"2024-01-17T23:00:33.080592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078960+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-17T23:00:33.078960+0000","last_peered":"2024-01-17T23:00:33.078960+0000","last_clean":"2024-01-17T23:00:33.078960+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-17T23:00:33.078960+0000","last_undegraded":"2024-01-17T23:00:33.078960+0000","last_fullsized":"2024-01-17T23:00:33.078960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078129+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-17T23:00:33.078129+0000","last_peered":"2024-01-17T23:00:33.078129+0000","last_clean":"2024-01-17T23:00:33.078129+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-17T23:00:33.078129+0000","last_undegraded":"2024-01-17T23:00:33.078129+0000","last_fullsized":"2024-01-17T23:00:33.078129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091203+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-17T23:00:33.091203+0000","last_peered":"2024-01-17T23:00:33.091203+0000","last_clean":"2024-01-17T23:00:33.091203+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-17T23:00:33.091203+0000","last_undegraded":"2024-01-17T23:00:33.091203+0000","last_fullsized":"2024-01-17T23:00:33.091203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":716931,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.70899999999999996}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.131},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1779999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.272}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.3169999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":129822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.68799999999999994}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.123}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.194}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.169}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.262},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.147}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":126071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.90600000000000003}]},{"osd":1,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.1120000000000001}]},{"osd":2,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.0449999999999999}]},{"osd":3,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.006}]},{"osd":6,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.0820000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":129822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.313},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.377}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.99199999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.85299999999999998}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.94799999999999995}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.79900000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":126141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.6630000000000003,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.4690000000000003,"5min":5.4690000000000003,"15min":5.4690000000000003},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.83399999999999996}]},{"osd":6,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.92700000000000005}]},{"osd":7,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.89500000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":716987,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.42399999999999999}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.38100000000000001}]},{"osd":3,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.317},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.496}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.72599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":126107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.63400000000000001}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.872},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.78900000000000003}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.995}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.246}]}]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.373}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.88500000000000001}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.85099999999999998}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.91200000000000003}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.94999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T23:00:57.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T23:00:58.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 Processor -- start 2024-01-17T23:00:58.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 -- start start 2024-01-17T23:00:58.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f40ac1517f0 0x7f40ac15b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac0ca3a0 0x7f40ac061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0c7d10 con 0x7f40ac0ca780 2024-01-17T23:00:58.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac1576d0 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40b1800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac157970 con 0x7f40ac1517f0 2024-01-17T23:00:58.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40aa000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac0ca3a0 0x7f40ac061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40aa000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f40ac0ca3a0 0x7f40ac061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38596/0 (socket says 172.21.15.67:38596) 2024-01-17T23:00:58.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.015+0000 7f40aa000640 1 -- 172.21.15.67:0/4028467238 learned_addr learned my addr 172.21.15.67:0/4028467238 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.019+0000 7f40aaa00640 1 --2- 172.21.15.67:0/4028467238 >> v2:172.21.15.137:3300/0 conn(0x7f40ac1517f0 0x7f40ac15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.019+0000 7f40aa000640 1 -- 172.21.15.67:0/4028467238 >> v2:172.21.15.137:3300/0 conn(0x7f40ac1517f0 msgr2=0x7f40ac15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.019+0000 7f40aa000640 1 --2- 172.21.15.67:0/4028467238 >> v2:172.21.15.137:3300/0 conn(0x7f40ac1517f0 0x7f40ac15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.019+0000 7f40aa000640 1 -- 172.21.15.67:0/4028467238 >> v1:172.21.15.137:6789/0 conn(0x7f40ac0ca780 legacy=0x7f40ac0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.019+0000 7f40aa000640 1 -- 172.21.15.67:0/4028467238 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac157c50 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.023+0000 7f40aa000640 1 --2- 172.21.15.67:0/4028467238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac061100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06fd20 tx=0x7f409401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620002be5580012 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:58.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40a9600640 1 -- 172.21.15.67:0/4028467238 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940aa620 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40a9600640 1 -- 172.21.15.67:0/4028467238 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940aa780 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40a9600640 1 -- 172.21.15.67:0/4028467238 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940aab10 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- 172.21.15.67:0/4028467238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca3a0 msgr2=0x7f40ac061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 --2- 172.21.15.67:0/4028467238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac061100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06fd20 tx=0x7f409401c4c0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- 172.21.15.67:0/4028467238 shutdown_connections 2024-01-17T23:00:58.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 --2- 172.21.15.67:0/4028467238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac061100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 --2- 172.21.15.67:0/4028467238 >> v2:172.21.15.137:3300/0 conn(0x7f40ac1517f0 0x7f40ac15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- 172.21.15.67:0/4028467238 >> 172.21.15.67:0/4028467238 conn(0x7f40ac06ad40 msgr2=0x7f40ac06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:58.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- 172.21.15.67:0/4028467238 shutdown_connections 2024-01-17T23:00:58.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- 172.21.15.67:0/4028467238 wait complete. 2024-01-17T23:00:58.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 Processor -- start 2024-01-17T23:00:58.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.027+0000 7f40b1800640 1 -- start start 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40ac1517f0 0x7f40ac0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac06d850 con 0x7f40ac0ca780 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac155600 con 0x7f40ac0ca3a0 2024-01-17T23:00:58.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40b1800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac1f6b90 con 0x7f40ac1517f0 2024-01-17T23:00:58.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40aa000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38604/0 (socket says 172.21.15.67:38604) 2024-01-17T23:00:58.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40aa000640 1 -- 172.21.15.67:0/3857717928 learned_addr learned my addr 172.21.15.67:0/3857717928 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:58.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40aaa00640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.031+0000 7f40ab400640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40ac1517f0 0x7f40ac0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 -- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40ac1517f0 msgr2=0x7f40ac0b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40ac1517f0 0x7f40ac0b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 -- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac0ca3a0 msgr2=0x7f40ac06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 -- 172.21.15.67:0/3857717928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940094d0 con 0x7f40ac0ca780 2024-01-17T23:00:58.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.035+0000 7f40aa000640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f409401ab70 tx=0x7f409401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:58.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.039+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940bd3f0 con 0x7f40ac0ca780 2024-01-17T23:00:58.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.039+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40940bd550 con 0x7f40ac0ca780 2024-01-17T23:00:58.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.039+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940bd900 con 0x7f40ac0ca780 2024-01-17T23:00:58.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.039+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac1f6610 con 0x7f40ac0ca780 2024-01-17T23:00:58.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.039+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac06c550 con 0x7f40ac0ca780 2024-01-17T23:00:58.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.043+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac0746a0 con 0x7f40ac0ca780 2024-01-17T23:00:58.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.299+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f40940b33f0 con 0x7f40ac0ca780 2024-01-17T23:00:58.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.299+0000 7f40a2a00640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 0x7f4084068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.299+0000 7f40aaa00640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 0x7f4084068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.299+0000 7f40aaa00640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 0x7f4084068d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0ccbc0 tx=0x7f409c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:58.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.311+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40940ef5e0 con 0x7f40ac0ca780 2024-01-17T23:00:58.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.311+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f40940eb920 con 0x7f40ac0ca780 2024-01-17T23:00:58.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.471+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40ac15ae90 con 0x7f4084066890 2024-01-17T23:00:58.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.499+0000 7f40a2a00640 1 -- 172.21.15.67:0/3857717928 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368877 (secure 0 0 0) 0x7f40ac15ae90 con 0x7f4084066890 2024-01-17T23:00:58.510 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:58.515 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-17T23:00:58.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.503+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 msgr2=0x7f4084068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.503+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 0x7f4084068d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0ccbc0 tx=0x7f409c008040 comp rx=0 tx=0).stop 2024-01-17T23:00:58.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.503+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 msgr2=0x7f40ac144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.503+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f409401ab70 tx=0x7f409401ad00 comp rx=0 tx=0).stop 2024-01-17T23:00:58.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.503+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 shutdown_connections 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4084066890 0x7f4084068d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f40ac1517f0 0x7f40ac0b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40ac0ca780 0x7f40ac144bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 --2- 172.21.15.67:0/3857717928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40ac0ca3a0 0x7f40ac06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 >> 172.21.15.67:0/3857717928 conn(0x7f40ac06ad40 msgr2=0x7f40ac0caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 shutdown_connections 2024-01-17T23:00:58.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.507+0000 7f40b1800640 1 -- 172.21.15.67:0/3857717928 wait complete. 2024-01-17T23:00:58.532 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-01-17T23:00:57.935473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597035,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":273,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218784,"kb_used_data":2656,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755936,"statfs":{"total":773094113280,"available":772870078464,"internally_reserved":0,"allocated":2719744,"data_stored":2201968,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2169,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004957"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248181+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-17T23:00:57.248181+0000","last_peered":"2024-01-17T23:00:57.248181+0000","last_clean":"2024-01-17T23:00:57.248181+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-17T23:00:57.248181+0000","last_undegraded":"2024-01-17T23:00:57.248181+0000","last_fullsized":"2024-01-17T23:00:57.248181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077894+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.077894+0000","last_peered":"2024-01-17T23:00:33.077894+0000","last_clean":"2024-01-17T23:00:33.077894+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-17T23:00:33.077894+0000","last_undegraded":"2024-01-17T23:00:33.077894+0000","last_fullsized":"2024-01-17T23:00:33.077894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075877+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-17T23:00:33.075877+0000","last_peered":"2024-01-17T23:00:33.075877+0000","last_clean":"2024-01-17T23:00:33.075877+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-17T23:00:33.075877+0000","last_undegraded":"2024-01-17T23:00:33.075877+0000","last_fullsized":"2024-01-17T23:00:33.075877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.195982+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-17T23:00:34.195982+0000","last_peered":"2024-01-17T23:00:34.195982+0000","last_clean":"2024-01-17T23:00:34.195982+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-17T23:00:34.195982+0000","last_undegraded":"2024-01-17T23:00:34.195982+0000","last_fullsized":"2024-01-17T23:00:34.195982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079362+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-17T23:00:33.079362+0000","last_peered":"2024-01-17T23:00:33.079362+0000","last_clean":"2024-01-17T23:00:33.079362+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-17T23:00:33.079362+0000","last_undegraded":"2024-01-17T23:00:33.079362+0000","last_fullsized":"2024-01-17T23:00:33.079362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093022+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-17T23:00:33.093022+0000","last_peered":"2024-01-17T23:00:33.093022+0000","last_clean":"2024-01-17T23:00:33.093022+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-17T23:00:33.093022+0000","last_undegraded":"2024-01-17T23:00:33.093022+0000","last_fullsized":"2024-01-17T23:00:33.093022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.131311+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-17T23:00:57.131311+0000","last_peered":"2024-01-17T23:00:57.131311+0000","last_clean":"2024-01-17T23:00:57.131311+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-17T23:00:57.131311+0000","last_undegraded":"2024-01-17T23:00:57.131311+0000","last_fullsized":"2024-01-17T23:00:57.131311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080814+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-17T23:00:33.080814+0000","last_peered":"2024-01-17T23:00:33.080814+0000","last_clean":"2024-01-17T23:00:33.080814+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-17T23:00:33.080814+0000","last_undegraded":"2024-01-17T23:00:33.080814+0000","last_fullsized":"2024-01-17T23:00:33.080814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093362+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-17T23:00:33.093362+0000","last_peered":"2024-01-17T23:00:33.093362+0000","last_clean":"2024-01-17T23:00:33.093362+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-17T23:00:33.093362+0000","last_undegraded":"2024-01-17T23:00:33.093362+0000","last_fullsized":"2024-01-17T23:00:33.093362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089926+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-17T23:00:33.089926+0000","last_peered":"2024-01-17T23:00:33.089926+0000","last_clean":"2024-01-17T23:00:33.089926+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-17T23:00:33.089926+0000","last_undegraded":"2024-01-17T23:00:33.089926+0000","last_fullsized":"2024-01-17T23:00:33.089926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080653+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-17T23:00:33.080653+0000","last_peered":"2024-01-17T23:00:33.080653+0000","last_clean":"2024-01-17T23:00:33.080653+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-17T23:00:33.080653+0000","last_undegraded":"2024-01-17T23:00:33.080653+0000","last_fullsized":"2024-01-17T23:00:33.080653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092397+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-17T23:00:33.092397+0000","last_peered":"2024-01-17T23:00:33.092397+0000","last_clean":"2024-01-17T23:00:33.092397+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-17T23:00:33.092397+0000","last_undegraded":"2024-01-17T23:00:33.092397+0000","last_fullsized":"2024-01-17T23:00:33.092397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082880+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-17T23:00:33.082880+0000","last_peered":"2024-01-17T23:00:33.082880+0000","last_clean":"2024-01-17T23:00:33.082880+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-17T23:00:33.082880+0000","last_undegraded":"2024-01-17T23:00:33.082880+0000","last_fullsized":"2024-01-17T23:00:33.082880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843181+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-17T23:00:54.843181+0000","last_peered":"2024-01-17T23:00:54.843181+0000","last_clean":"2024-01-17T23:00:54.843181+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-17T23:00:54.843181+0000","last_undegraded":"2024-01-17T23:00:54.843181+0000","last_fullsized":"2024-01-17T23:00:54.843181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095174+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-17T23:00:33.095174+0000","last_peered":"2024-01-17T23:00:33.095174+0000","last_clean":"2024-01-17T23:00:33.095174+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-17T23:00:33.095174+0000","last_undegraded":"2024-01-17T23:00:33.095174+0000","last_fullsized":"2024-01-17T23:00:33.095174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076603+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-17T23:00:33.076603+0000","last_peered":"2024-01-17T23:00:33.076603+0000","last_clean":"2024-01-17T23:00:33.076603+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-17T23:00:33.076603+0000","last_undegraded":"2024-01-17T23:00:33.076603+0000","last_fullsized":"2024-01-17T23:00:33.076603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081106+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-17T23:00:33.081106+0000","last_peered":"2024-01-17T23:00:33.081106+0000","last_clean":"2024-01-17T23:00:33.081106+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-17T23:00:33.081106+0000","last_undegraded":"2024-01-17T23:00:33.081106+0000","last_fullsized":"2024-01-17T23:00:33.081106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093356+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-17T23:00:33.093356+0000","last_peered":"2024-01-17T23:00:33.093356+0000","last_clean":"2024-01-17T23:00:33.093356+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-17T23:00:33.093356+0000","last_undegraded":"2024-01-17T23:00:33.093356+0000","last_fullsized":"2024-01-17T23:00:33.093356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075816+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-17T23:00:33.075816+0000","last_peered":"2024-01-17T23:00:33.075816+0000","last_clean":"2024-01-17T23:00:33.075816+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-17T23:00:33.075816+0000","last_undegraded":"2024-01-17T23:00:33.075816+0000","last_fullsized":"2024-01-17T23:00:33.075816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843510+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-17T23:00:54.843510+0000","last_peered":"2024-01-17T23:00:54.843510+0000","last_clean":"2024-01-17T23:00:54.843510+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-17T23:00:54.843510+0000","last_undegraded":"2024-01-17T23:00:54.843510+0000","last_fullsized":"2024-01-17T23:00:54.843510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077169+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-17T23:00:33.077169+0000","last_peered":"2024-01-17T23:00:33.077169+0000","last_clean":"2024-01-17T23:00:33.077169+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-17T23:00:33.077169+0000","last_undegraded":"2024-01-17T23:00:33.077169+0000","last_fullsized":"2024-01-17T23:00:33.077169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092641+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-17T23:00:33.092641+0000","last_peered":"2024-01-17T23:00:33.092641+0000","last_clean":"2024-01-17T23:00:33.092641+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-17T23:00:33.092641+0000","last_undegraded":"2024-01-17T23:00:33.092641+0000","last_fullsized":"2024-01-17T23:00:33.092641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843369+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-17T23:00:54.843369+0000","last_peered":"2024-01-17T23:00:54.843369+0000","last_clean":"2024-01-17T23:00:54.843369+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-17T23:00:54.843369+0000","last_undegraded":"2024-01-17T23:00:54.843369+0000","last_fullsized":"2024-01-17T23:00:54.843369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095681+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-17T23:00:33.095681+0000","last_peered":"2024-01-17T23:00:33.095681+0000","last_clean":"2024-01-17T23:00:33.095681+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-17T23:00:33.095681+0000","last_undegraded":"2024-01-17T23:00:33.095681+0000","last_fullsized":"2024-01-17T23:00:33.095681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079343+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-17T23:00:33.079343+0000","last_peered":"2024-01-17T23:00:33.079343+0000","last_clean":"2024-01-17T23:00:33.079343+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-17T23:00:33.079343+0000","last_undegraded":"2024-01-17T23:00:33.079343+0000","last_fullsized":"2024-01-17T23:00:33.079343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858140+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-17T23:00:54.858140+0000","last_peered":"2024-01-17T23:00:54.858140+0000","last_clean":"2024-01-17T23:00:54.858140+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-17T23:00:54.858140+0000","last_undegraded":"2024-01-17T23:00:54.858140+0000","last_fullsized":"2024-01-17T23:00:54.858140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092000+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-17T23:00:33.092000+0000","last_peered":"2024-01-17T23:00:33.092000+0000","last_clean":"2024-01-17T23:00:33.092000+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-17T23:00:33.092000+0000","last_undegraded":"2024-01-17T23:00:33.092000+0000","last_fullsized":"2024-01-17T23:00:33.092000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076680+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-17T23:00:33.076680+0000","last_peered":"2024-01-17T23:00:33.076680+0000","last_clean":"2024-01-17T23:00:33.076680+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-17T23:00:33.076680+0000","last_undegraded":"2024-01-17T23:00:33.076680+0000","last_fullsized":"2024-01-17T23:00:33.076680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.212080+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-17T23:00:57.212080+0000","last_peered":"2024-01-17T23:00:57.212080+0000","last_clean":"2024-01-17T23:00:57.212080+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-17T23:00:57.212080+0000","last_undegraded":"2024-01-17T23:00:57.212080+0000","last_fullsized":"2024-01-17T23:00:57.212080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075915+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-17T23:00:33.075915+0000","last_peered":"2024-01-17T23:00:33.075915+0000","last_clean":"2024-01-17T23:00:33.075915+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-17T23:00:33.075915+0000","last_undegraded":"2024-01-17T23:00:33.075915+0000","last_fullsized":"2024-01-17T23:00:33.075915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079329+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-17T23:00:33.079329+0000","last_peered":"2024-01-17T23:00:33.079329+0000","last_clean":"2024-01-17T23:00:33.079329+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-17T23:00:33.079329+0000","last_undegraded":"2024-01-17T23:00:33.079329+0000","last_fullsized":"2024-01-17T23:00:33.079329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:35.281250+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-17T23:00:35.281250+0000","last_peered":"2024-01-17T23:00:35.281250+0000","last_clean":"2024-01-17T23:00:35.281250+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-17T23:00:35.281250+0000","last_undegraded":"2024-01-17T23:00:35.281250+0000","last_fullsized":"2024-01-17T23:00:35.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078545+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-17T23:00:33.078545+0000","last_peered":"2024-01-17T23:00:33.078545+0000","last_clean":"2024-01-17T23:00:33.078545+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-17T23:00:33.078545+0000","last_undegraded":"2024-01-17T23:00:33.078545+0000","last_fullsized":"2024-01-17T23:00:33.078545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080738+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-17T23:00:33.080738+0000","last_peered":"2024-01-17T23:00:33.080738+0000","last_clean":"2024-01-17T23:00:33.080738+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-17T23:00:33.080738+0000","last_undegraded":"2024-01-17T23:00:33.080738+0000","last_fullsized":"2024-01-17T23:00:33.080738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079407+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-17T23:00:33.079407+0000","last_peered":"2024-01-17T23:00:33.079407+0000","last_clean":"2024-01-17T23:00:33.079407+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-17T23:00:33.079407+0000","last_undegraded":"2024-01-17T23:00:33.079407+0000","last_fullsized":"2024-01-17T23:00:33.079407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080349+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-17T23:00:33.080349+0000","last_peered":"2024-01-17T23:00:33.080349+0000","last_clean":"2024-01-17T23:00:33.080349+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-17T23:00:33.080349+0000","last_undegraded":"2024-01-17T23:00:33.080349+0000","last_fullsized":"2024-01-17T23:00:33.080349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-17T23:00:33.093635+0000","last_peered":"2024-01-17T23:00:33.093635+0000","last_clean":"2024-01-17T23:00:33.093635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-17T23:00:33.093635+0000","last_undegraded":"2024-01-17T23:00:33.093635+0000","last_fullsized":"2024-01-17T23:00:33.093635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.121860+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-17T23:00:34.121860+0000","last_peered":"2024-01-17T23:00:34.121860+0000","last_clean":"2024-01-17T23:00:34.121860+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-17T23:00:34.121860+0000","last_undegraded":"2024-01-17T23:00:34.121860+0000","last_fullsized":"2024-01-17T23:00:34.121860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076437+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-17T23:00:33.076437+0000","last_peered":"2024-01-17T23:00:33.076437+0000","last_clean":"2024-01-17T23:00:33.076437+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-17T23:00:33.076437+0000","last_undegraded":"2024-01-17T23:00:33.076437+0000","last_fullsized":"2024-01-17T23:00:33.076437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.117676+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-17T23:00:34.117676+0000","last_peered":"2024-01-17T23:00:34.117676+0000","last_clean":"2024-01-17T23:00:34.117676+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:34.117676+0000","last_undegraded":"2024-01-17T23:00:34.117676+0000","last_fullsized":"2024-01-17T23:00:34.117676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.129939+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-17T23:00:57.129939+0000","last_peered":"2024-01-17T23:00:57.129939+0000","last_clean":"2024-01-17T23:00:57.129939+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-17T23:00:57.129939+0000","last_undegraded":"2024-01-17T23:00:57.129939+0000","last_fullsized":"2024-01-17T23:00:57.129939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079933+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-17T23:00:33.079933+0000","last_peered":"2024-01-17T23:00:33.079933+0000","last_clean":"2024-01-17T23:00:33.079933+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-17T23:00:33.079933+0000","last_undegraded":"2024-01-17T23:00:33.079933+0000","last_fullsized":"2024-01-17T23:00:33.079933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076809+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-17T23:00:33.076809+0000","last_peered":"2024-01-17T23:00:33.076809+0000","last_clean":"2024-01-17T23:00:33.076809+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-17T23:00:33.076809+0000","last_undegraded":"2024-01-17T23:00:33.076809+0000","last_fullsized":"2024-01-17T23:00:33.076809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.653004+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-17T23:00:54.653004+0000","last_peered":"2024-01-17T23:00:54.653004+0000","last_clean":"2024-01-17T23:00:54.653004+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-17T23:00:54.653004+0000","last_undegraded":"2024-01-17T23:00:54.653004+0000","last_fullsized":"2024-01-17T23:00:54.653004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089167+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-17T23:00:33.089167+0000","last_peered":"2024-01-17T23:00:33.089167+0000","last_clean":"2024-01-17T23:00:33.089167+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-17T23:00:33.089167+0000","last_undegraded":"2024-01-17T23:00:33.089167+0000","last_fullsized":"2024-01-17T23:00:33.089167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085186+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-17T23:00:33.085186+0000","last_peered":"2024-01-17T23:00:33.085186+0000","last_clean":"2024-01-17T23:00:33.085186+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-17T23:00:33.085186+0000","last_undegraded":"2024-01-17T23:00:33.085186+0000","last_fullsized":"2024-01-17T23:00:33.085186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091113+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-17T23:00:33.091113+0000","last_peered":"2024-01-17T23:00:33.091113+0000","last_clean":"2024-01-17T23:00:33.091113+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-17T23:00:33.091113+0000","last_undegraded":"2024-01-17T23:00:33.091113+0000","last_fullsized":"2024-01-17T23:00:33.091113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073171+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-17T23:00:33.073171+0000","last_peered":"2024-01-17T23:00:33.073171+0000","last_clean":"2024-01-17T23:00:33.073171+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-17T23:00:33.073171+0000","last_undegraded":"2024-01-17T23:00:33.073171+0000","last_fullsized":"2024-01-17T23:00:33.073171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082790+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-17T23:00:33.082790+0000","last_peered":"2024-01-17T23:00:33.082790+0000","last_clean":"2024-01-17T23:00:33.082790+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-17T23:00:33.082790+0000","last_undegraded":"2024-01-17T23:00:33.082790+0000","last_fullsized":"2024-01-17T23:00:33.082790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081012+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-17T23:00:33.081012+0000","last_peered":"2024-01-17T23:00:33.081012+0000","last_clean":"2024-01-17T23:00:33.081012+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-17T23:00:33.081012+0000","last_undegraded":"2024-01-17T23:00:33.081012+0000","last_fullsized":"2024-01-17T23:00:33.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076923+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-17T23:00:33.076923+0000","last_peered":"2024-01-17T23:00:33.076923+0000","last_clean":"2024-01-17T23:00:33.076923+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-17T23:00:33.076923+0000","last_undegraded":"2024-01-17T23:00:33.076923+0000","last_fullsized":"2024-01-17T23:00:33.076923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078627+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-17T23:00:33.078627+0000","last_peered":"2024-01-17T23:00:33.078627+0000","last_clean":"2024-01-17T23:00:33.078627+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-17T23:00:33.078627+0000","last_undegraded":"2024-01-17T23:00:33.078627+0000","last_fullsized":"2024-01-17T23:00:33.078627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091728+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-17T23:00:33.091728+0000","last_peered":"2024-01-17T23:00:33.091728+0000","last_clean":"2024-01-17T23:00:33.091728+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-17T23:00:33.091728+0000","last_undegraded":"2024-01-17T23:00:33.091728+0000","last_fullsized":"2024-01-17T23:00:33.091728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073276+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-17T23:00:33.073276+0000","last_peered":"2024-01-17T23:00:33.073276+0000","last_clean":"2024-01-17T23:00:33.073276+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:33.073276+0000","last_undegraded":"2024-01-17T23:00:33.073276+0000","last_fullsized":"2024-01-17T23:00:33.073276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079044+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-17T23:00:33.079044+0000","last_peered":"2024-01-17T23:00:33.079044+0000","last_clean":"2024-01-17T23:00:33.079044+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-17T23:00:33.079044+0000","last_undegraded":"2024-01-17T23:00:33.079044+0000","last_fullsized":"2024-01-17T23:00:33.079044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.090852+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-17T23:00:33.090852+0000","last_peered":"2024-01-17T23:00:33.090852+0000","last_clean":"2024-01-17T23:00:33.090852+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-17T23:00:33.090852+0000","last_undegraded":"2024-01-17T23:00:33.090852+0000","last_fullsized":"2024-01-17T23:00:33.090852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095187+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-17T23:00:33.095187+0000","last_peered":"2024-01-17T23:00:33.095187+0000","last_clean":"2024-01-17T23:00:33.095187+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-17T23:00:33.095187+0000","last_undegraded":"2024-01-17T23:00:33.095187+0000","last_fullsized":"2024-01-17T23:00:33.095187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091573+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-17T23:00:33.091573+0000","last_peered":"2024-01-17T23:00:33.091573+0000","last_clean":"2024-01-17T23:00:33.091573+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-17T23:00:33.091573+0000","last_undegraded":"2024-01-17T23:00:33.091573+0000","last_fullsized":"2024-01-17T23:00:33.091573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088626+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-17T23:00:33.088626+0000","last_peered":"2024-01-17T23:00:33.088626+0000","last_clean":"2024-01-17T23:00:33.088626+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-17T23:00:33.088626+0000","last_undegraded":"2024-01-17T23:00:33.088626+0000","last_fullsized":"2024-01-17T23:00:33.088626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.822466+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-17T23:00:54.822466+0000","last_peered":"2024-01-17T23:00:54.822466+0000","last_clean":"2024-01-17T23:00:54.822466+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-17T23:00:54.822466+0000","last_undegraded":"2024-01-17T23:00:54.822466+0000","last_fullsized":"2024-01-17T23:00:54.822466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079212+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-17T23:00:33.079212+0000","last_peered":"2024-01-17T23:00:33.079212+0000","last_clean":"2024-01-17T23:00:33.079212+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-17T23:00:33.079212+0000","last_undegraded":"2024-01-17T23:00:33.079212+0000","last_fullsized":"2024-01-17T23:00:33.079212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083426+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-17T23:00:33.083426+0000","last_peered":"2024-01-17T23:00:33.083426+0000","last_clean":"2024-01-17T23:00:33.083426+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-17T23:00:33.083426+0000","last_undegraded":"2024-01-17T23:00:33.083426+0000","last_fullsized":"2024-01-17T23:00:33.083426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.247330+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-17T23:00:57.247330+0000","last_peered":"2024-01-17T23:00:57.247330+0000","last_clean":"2024-01-17T23:00:57.247330+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-17T23:00:57.247330+0000","last_undegraded":"2024-01-17T23:00:57.247330+0000","last_fullsized":"2024-01-17T23:00:57.247330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076521+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-17T23:00:33.076521+0000","last_peered":"2024-01-17T23:00:33.076521+0000","last_clean":"2024-01-17T23:00:33.076521+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-17T23:00:33.076521+0000","last_undegraded":"2024-01-17T23:00:33.076521+0000","last_fullsized":"2024-01-17T23:00:33.076521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089619+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-17T23:00:33.089619+0000","last_peered":"2024-01-17T23:00:33.089619+0000","last_clean":"2024-01-17T23:00:33.089619+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-17T23:00:33.089619+0000","last_undegraded":"2024-01-17T23:00:33.089619+0000","last_fullsized":"2024-01-17T23:00:33.089619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.652905+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-17T23:00:54.652905+0000","last_peered":"2024-01-17T23:00:54.652905+0000","last_clean":"2024-01-17T23:00:54.652905+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-17T23:00:54.652905+0000","last_undegraded":"2024-01-17T23:00:54.652905+0000","last_fullsized":"2024-01-17T23:00:54.652905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075820+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-17T23:00:33.075820+0000","last_peered":"2024-01-17T23:00:33.075820+0000","last_clean":"2024-01-17T23:00:33.075820+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-17T23:00:33.075820+0000","last_undegraded":"2024-01-17T23:00:33.075820+0000","last_fullsized":"2024-01-17T23:00:33.075820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078004+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-17T23:00:33.078004+0000","last_peered":"2024-01-17T23:00:33.078004+0000","last_clean":"2024-01-17T23:00:33.078004+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-17T23:00:33.078004+0000","last_undegraded":"2024-01-17T23:00:33.078004+0000","last_fullsized":"2024-01-17T23:00:33.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248035+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-17T23:00:57.248035+0000","last_peered":"2024-01-17T23:00:57.248035+0000","last_clean":"2024-01-17T23:00:57.248035+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-17T23:00:57.248035+0000","last_undegraded":"2024-01-17T23:00:57.248035+0000","last_fullsized":"2024-01-17T23:00:57.248035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080561+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-17T23:00:33.080561+0000","last_peered":"2024-01-17T23:00:33.080561+0000","last_clean":"2024-01-17T23:00:33.080561+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-17T23:00:33.080561+0000","last_undegraded":"2024-01-17T23:00:33.080561+0000","last_fullsized":"2024-01-17T23:00:33.080561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089862+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-17T23:00:33.089862+0000","last_peered":"2024-01-17T23:00:33.089862+0000","last_clean":"2024-01-17T23:00:33.089862+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-17T23:00:33.089862+0000","last_undegraded":"2024-01-17T23:00:33.089862+0000","last_fullsized":"2024-01-17T23:00:33.089862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.857814+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-17T23:00:54.857814+0000","last_peered":"2024-01-17T23:00:54.857814+0000","last_clean":"2024-01-17T23:00:54.857814+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-17T23:00:54.857814+0000","last_undegraded":"2024-01-17T23:00:54.857814+0000","last_fullsized":"2024-01-17T23:00:54.857814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.690081+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-17T23:00:34.690081+0000","last_peered":"2024-01-17T23:00:34.690081+0000","last_clean":"2024-01-17T23:00:34.690081+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-17T23:00:34.690081+0000","last_undegraded":"2024-01-17T23:00:34.690081+0000","last_fullsized":"2024-01-17T23:00:34.690081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095175+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-17T23:00:33.095175+0000","last_peered":"2024-01-17T23:00:33.095175+0000","last_clean":"2024-01-17T23:00:33.095175+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-17T23:00:33.095175+0000","last_undegraded":"2024-01-17T23:00:33.095175+0000","last_fullsized":"2024-01-17T23:00:33.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.115140+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-17T23:00:34.115140+0000","last_peered":"2024-01-17T23:00:34.115140+0000","last_clean":"2024-01-17T23:00:34.115140+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-17T23:00:34.115140+0000","last_undegraded":"2024-01-17T23:00:34.115140+0000","last_fullsized":"2024-01-17T23:00:34.115140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093112+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-17T23:00:33.093112+0000","last_peered":"2024-01-17T23:00:33.093112+0000","last_clean":"2024-01-17T23:00:33.093112+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-17T23:00:33.093112+0000","last_undegraded":"2024-01-17T23:00:33.093112+0000","last_fullsized":"2024-01-17T23:00:33.093112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079491+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-17T23:00:33.079491+0000","last_peered":"2024-01-17T23:00:33.079491+0000","last_clean":"2024-01-17T23:00:33.079491+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-17T23:00:33.079491+0000","last_undegraded":"2024-01-17T23:00:33.079491+0000","last_fullsized":"2024-01-17T23:00:33.079491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.651949+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-17T23:00:54.651949+0000","last_peered":"2024-01-17T23:00:54.651949+0000","last_clean":"2024-01-17T23:00:54.651949+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-17T23:00:54.651949+0000","last_undegraded":"2024-01-17T23:00:54.651949+0000","last_fullsized":"2024-01-17T23:00:54.651949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075647+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-17T23:00:33.075647+0000","last_peered":"2024-01-17T23:00:33.075647+0000","last_clean":"2024-01-17T23:00:33.075647+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-17T23:00:33.075647+0000","last_undegraded":"2024-01-17T23:00:33.075647+0000","last_fullsized":"2024-01-17T23:00:33.075647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080583+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-17T23:00:33.080583+0000","last_peered":"2024-01-17T23:00:33.080583+0000","last_clean":"2024-01-17T23:00:33.080583+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-17T23:00:33.080583+0000","last_undegraded":"2024-01-17T23:00:33.080583+0000","last_fullsized":"2024-01-17T23:00:33.080583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858838+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-17T23:00:54.858838+0000","last_peered":"2024-01-17T23:00:54.858838+0000","last_clean":"2024-01-17T23:00:54.858838+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-17T23:00:54.858838+0000","last_undegraded":"2024-01-17T23:00:54.858838+0000","last_fullsized":"2024-01-17T23:00:54.858838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076683+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-17T23:00:33.076683+0000","last_peered":"2024-01-17T23:00:33.076683+0000","last_clean":"2024-01-17T23:00:33.076683+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-17T23:00:33.076683+0000","last_undegraded":"2024-01-17T23:00:33.076683+0000","last_fullsized":"2024-01-17T23:00:33.076683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079127+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-17T23:00:33.079127+0000","last_peered":"2024-01-17T23:00:33.079127+0000","last_clean":"2024-01-17T23:00:33.079127+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-17T23:00:33.079127+0000","last_undegraded":"2024-01-17T23:00:33.079127+0000","last_fullsized":"2024-01-17T23:00:33.079127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080106+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-17T23:00:33.080106+0000","last_peered":"2024-01-17T23:00:33.080106+0000","last_clean":"2024-01-17T23:00:33.080106+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-17T23:00:33.080106+0000","last_undegraded":"2024-01-17T23:00:33.080106+0000","last_fullsized":"2024-01-17T23:00:33.080106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.120056+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-17T23:00:34.120056+0000","last_peered":"2024-01-17T23:00:34.120056+0000","last_clean":"2024-01-17T23:00:34.120056+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-17T23:00:34.120056+0000","last_undegraded":"2024-01-17T23:00:34.120056+0000","last_fullsized":"2024-01-17T23:00:34.120056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086481+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-17T23:00:33.086481+0000","last_peered":"2024-01-17T23:00:33.086481+0000","last_clean":"2024-01-17T23:00:33.086481+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-17T23:00:33.086481+0000","last_undegraded":"2024-01-17T23:00:33.086481+0000","last_fullsized":"2024-01-17T23:00:33.086481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075738+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-17T23:00:33.075738+0000","last_peered":"2024-01-17T23:00:33.075738+0000","last_clean":"2024-01-17T23:00:33.075738+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-17T23:00:33.075738+0000","last_undegraded":"2024-01-17T23:00:33.075738+0000","last_fullsized":"2024-01-17T23:00:33.075738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.130349+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-17T23:00:57.130349+0000","last_peered":"2024-01-17T23:00:57.130349+0000","last_clean":"2024-01-17T23:00:57.130349+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-17T23:00:57.130349+0000","last_undegraded":"2024-01-17T23:00:57.130349+0000","last_fullsized":"2024-01-17T23:00:57.130349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.244172+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-17T23:00:57.244172+0000","last_peered":"2024-01-17T23:00:57.244172+0000","last_clean":"2024-01-17T23:00:57.244172+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-17T23:00:57.244172+0000","last_undegraded":"2024-01-17T23:00:57.244172+0000","last_fullsized":"2024-01-17T23:00:57.244172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078709+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-17T23:00:33.078709+0000","last_peered":"2024-01-17T23:00:33.078709+0000","last_clean":"2024-01-17T23:00:33.078709+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-17T23:00:33.078709+0000","last_undegraded":"2024-01-17T23:00:33.078709+0000","last_fullsized":"2024-01-17T23:00:33.078709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461070+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-17T23:00:34.461070+0000","last_peered":"2024-01-17T23:00:34.461070+0000","last_clean":"2024-01-17T23:00:34.461070+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-17T23:00:34.461070+0000","last_undegraded":"2024-01-17T23:00:34.461070+0000","last_fullsized":"2024-01-17T23:00:34.461070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.657236+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-17T23:00:54.657236+0000","last_peered":"2024-01-17T23:00:54.657236+0000","last_clean":"2024-01-17T23:00:54.657236+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-17T23:00:54.657236+0000","last_undegraded":"2024-01-17T23:00:54.657236+0000","last_fullsized":"2024-01-17T23:00:54.657236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093476+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-17T23:00:33.093476+0000","last_peered":"2024-01-17T23:00:33.093476+0000","last_clean":"2024-01-17T23:00:33.093476+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-17T23:00:33.093476+0000","last_undegraded":"2024-01-17T23:00:33.093476+0000","last_fullsized":"2024-01-17T23:00:33.093476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076015+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-17T23:00:33.076015+0000","last_peered":"2024-01-17T23:00:33.076015+0000","last_clean":"2024-01-17T23:00:33.076015+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-17T23:00:33.076015+0000","last_undegraded":"2024-01-17T23:00:33.076015+0000","last_fullsized":"2024-01-17T23:00:33.076015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083061+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-17T23:00:33.083061+0000","last_peered":"2024-01-17T23:00:33.083061+0000","last_clean":"2024-01-17T23:00:33.083061+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-17T23:00:33.083061+0000","last_undegraded":"2024-01-17T23:00:33.083061+0000","last_fullsized":"2024-01-17T23:00:33.083061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072920+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-17T23:00:33.072920+0000","last_peered":"2024-01-17T23:00:33.072920+0000","last_clean":"2024-01-17T23:00:33.072920+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-17T23:00:33.072920+0000","last_undegraded":"2024-01-17T23:00:33.072920+0000","last_fullsized":"2024-01-17T23:00:33.072920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083196+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-17T23:00:33.083196+0000","last_peered":"2024-01-17T23:00:33.083196+0000","last_clean":"2024-01-17T23:00:33.083196+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-17T23:00:33.083196+0000","last_undegraded":"2024-01-17T23:00:33.083196+0000","last_fullsized":"2024-01-17T23:00:33.083196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078650+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-17T23:00:33.078650+0000","last_peered":"2024-01-17T23:00:33.078650+0000","last_clean":"2024-01-17T23:00:33.078650+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-17T23:00:33.078650+0000","last_undegraded":"2024-01-17T23:00:33.078650+0000","last_fullsized":"2024-01-17T23:00:33.078650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.119356+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-17T23:00:34.119356+0000","last_peered":"2024-01-17T23:00:34.119356+0000","last_clean":"2024-01-17T23:00:34.119356+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-17T23:00:34.119356+0000","last_undegraded":"2024-01-17T23:00:34.119356+0000","last_fullsized":"2024-01-17T23:00:34.119356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076708+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-17T23:00:33.076708+0000","last_peered":"2024-01-17T23:00:33.076708+0000","last_clean":"2024-01-17T23:00:33.076708+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-17T23:00:33.076708+0000","last_undegraded":"2024-01-17T23:00:33.076708+0000","last_fullsized":"2024-01-17T23:00:33.076708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087751+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-17T23:00:33.087751+0000","last_peered":"2024-01-17T23:00:33.087751+0000","last_clean":"2024-01-17T23:00:33.087751+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-17T23:00:33.087751+0000","last_undegraded":"2024-01-17T23:00:33.087751+0000","last_fullsized":"2024-01-17T23:00:33.087751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076601+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-17T23:00:33.076601+0000","last_peered":"2024-01-17T23:00:33.076601+0000","last_clean":"2024-01-17T23:00:33.076601+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-17T23:00:33.076601+0000","last_undegraded":"2024-01-17T23:00:33.076601+0000","last_fullsized":"2024-01-17T23:00:33.076601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.198264+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-17T23:00:34.198264+0000","last_peered":"2024-01-17T23:00:34.198264+0000","last_clean":"2024-01-17T23:00:34.198264+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-17T23:00:34.198264+0000","last_undegraded":"2024-01-17T23:00:34.198264+0000","last_fullsized":"2024-01-17T23:00:34.198264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077231+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-17T23:00:33.077231+0000","last_peered":"2024-01-17T23:00:33.077231+0000","last_clean":"2024-01-17T23:00:33.077231+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-17T23:00:33.077231+0000","last_undegraded":"2024-01-17T23:00:33.077231+0000","last_fullsized":"2024-01-17T23:00:33.077231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082984+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-17T23:00:33.082984+0000","last_peered":"2024-01-17T23:00:33.082984+0000","last_clean":"2024-01-17T23:00:33.082984+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-17T23:00:33.082984+0000","last_undegraded":"2024-01-17T23:00:33.082984+0000","last_fullsized":"2024-01-17T23:00:33.082984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078535+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-17T23:00:33.078535+0000","last_peered":"2024-01-17T23:00:33.078535+0000","last_clean":"2024-01-17T23:00:33.078535+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-17T23:00:33.078535+0000","last_undegraded":"2024-01-17T23:00:33.078535+0000","last_fullsized":"2024-01-17T23:00:33.078535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085492+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-17T23:00:33.085492+0000","last_peered":"2024-01-17T23:00:33.085492+0000","last_clean":"2024-01-17T23:00:33.085492+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-17T23:00:33.085492+0000","last_undegraded":"2024-01-17T23:00:33.085492+0000","last_fullsized":"2024-01-17T23:00:33.085492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091752+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-17T23:00:33.091752+0000","last_peered":"2024-01-17T23:00:33.091752+0000","last_clean":"2024-01-17T23:00:33.091752+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-17T23:00:33.091752+0000","last_undegraded":"2024-01-17T23:00:33.091752+0000","last_fullsized":"2024-01-17T23:00:33.091752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073164+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-17T23:00:33.073164+0000","last_peered":"2024-01-17T23:00:33.073164+0000","last_clean":"2024-01-17T23:00:33.073164+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-17T23:00:33.073164+0000","last_undegraded":"2024-01-17T23:00:33.073164+0000","last_fullsized":"2024-01-17T23:00:33.073164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082519+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-17T23:00:33.082519+0000","last_peered":"2024-01-17T23:00:33.082519+0000","last_clean":"2024-01-17T23:00:33.082519+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-17T23:00:33.082519+0000","last_undegraded":"2024-01-17T23:00:33.082519+0000","last_fullsized":"2024-01-17T23:00:33.082519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079246+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-17T23:00:33.079246+0000","last_peered":"2024-01-17T23:00:33.079246+0000","last_clean":"2024-01-17T23:00:33.079246+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-17T23:00:33.079246+0000","last_undegraded":"2024-01-17T23:00:33.079246+0000","last_fullsized":"2024-01-17T23:00:33.079246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080180+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-17T23:00:33.080180+0000","last_peered":"2024-01-17T23:00:33.080180+0000","last_clean":"2024-01-17T23:00:33.080180+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-17T23:00:33.080180+0000","last_undegraded":"2024-01-17T23:00:33.080180+0000","last_fullsized":"2024-01-17T23:00:33.080180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077927+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-17T23:00:33.077927+0000","last_peered":"2024-01-17T23:00:33.077927+0000","last_clean":"2024-01-17T23:00:33.077927+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-17T23:00:33.077927+0000","last_undegraded":"2024-01-17T23:00:33.077927+0000","last_fullsized":"2024-01-17T23:00:33.077927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076524+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.076524+0000","last_peered":"2024-01-17T23:00:33.076524+0000","last_clean":"2024-01-17T23:00:33.076524+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-17T23:00:33.076524+0000","last_undegraded":"2024-01-17T23:00:33.076524+0000","last_fullsized":"2024-01-17T23:00:33.076524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093770+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-17T23:00:33.093770+0000","last_peered":"2024-01-17T23:00:33.093770+0000","last_clean":"2024-01-17T23:00:33.093770+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-17T23:00:33.093770+0000","last_undegraded":"2024-01-17T23:00:33.093770+0000","last_fullsized":"2024-01-17T23:00:33.093770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086205+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-17T23:00:33.086205+0000","last_peered":"2024-01-17T23:00:33.086205+0000","last_clean":"2024-01-17T23:00:33.086205+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-17T23:00:33.086205+0000","last_undegraded":"2024-01-17T23:00:33.086205+0000","last_fullsized":"2024-01-17T23:00:33.086205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087532+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-17T23:00:33.087532+0000","last_peered":"2024-01-17T23:00:33.087532+0000","last_clean":"2024-01-17T23:00:33.087532+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-17T23:00:33.087532+0000","last_undegraded":"2024-01-17T23:00:33.087532+0000","last_fullsized":"2024-01-17T23:00:33.087532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091518+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-17T23:00:33.091518+0000","last_peered":"2024-01-17T23:00:33.091518+0000","last_clean":"2024-01-17T23:00:33.091518+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-17T23:00:33.091518+0000","last_undegraded":"2024-01-17T23:00:33.091518+0000","last_fullsized":"2024-01-17T23:00:33.091518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075564+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-17T23:00:33.075564+0000","last_peered":"2024-01-17T23:00:33.075564+0000","last_clean":"2024-01-17T23:00:33.075564+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-17T23:00:33.075564+0000","last_undegraded":"2024-01-17T23:00:33.075564+0000","last_fullsized":"2024-01-17T23:00:33.075564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.459766+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-17T23:00:34.459766+0000","last_peered":"2024-01-17T23:00:34.459766+0000","last_clean":"2024-01-17T23:00:34.459766+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-17T23:00:34.459766+0000","last_undegraded":"2024-01-17T23:00:34.459766+0000","last_fullsized":"2024-01-17T23:00:34.459766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086625+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-17T23:00:33.086625+0000","last_peered":"2024-01-17T23:00:33.086625+0000","last_clean":"2024-01-17T23:00:33.086625+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-17T23:00:33.086625+0000","last_undegraded":"2024-01-17T23:00:33.086625+0000","last_fullsized":"2024-01-17T23:00:33.086625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080592+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-17T23:00:33.080592+0000","last_peered":"2024-01-17T23:00:33.080592+0000","last_clean":"2024-01-17T23:00:33.080592+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-17T23:00:33.080592+0000","last_undegraded":"2024-01-17T23:00:33.080592+0000","last_fullsized":"2024-01-17T23:00:33.080592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078960+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-17T23:00:33.078960+0000","last_peered":"2024-01-17T23:00:33.078960+0000","last_clean":"2024-01-17T23:00:33.078960+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-17T23:00:33.078960+0000","last_undegraded":"2024-01-17T23:00:33.078960+0000","last_fullsized":"2024-01-17T23:00:33.078960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078129+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-17T23:00:33.078129+0000","last_peered":"2024-01-17T23:00:33.078129+0000","last_clean":"2024-01-17T23:00:33.078129+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-17T23:00:33.078129+0000","last_undegraded":"2024-01-17T23:00:33.078129+0000","last_fullsized":"2024-01-17T23:00:33.078129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091203+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-17T23:00:33.091203+0000","last_peered":"2024-01-17T23:00:33.091203+0000","last_clean":"2024-01-17T23:00:33.091203+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-17T23:00:33.091203+0000","last_undegraded":"2024-01-17T23:00:33.091203+0000","last_fullsized":"2024-01-17T23:00:33.091203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6667,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":13496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":717665,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.0029999999999999}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.0780000000000001}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.234}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.133},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2090000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.278},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1619999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":130500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.871}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.0569999999999999}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.018},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.80900000000000005}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1759999999999999}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.3420000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":127359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.879},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.747}]},{"osd":1,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.016},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.202},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.238}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.47099999999999997}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.495},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83699999999999997}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79500000000000004}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.80700000000000005}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94999999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":126813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":0.37},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.6630000000000003,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.4690000000000003,"5min":5.4690000000000003,"15min":5.4690000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.89400000000000002}]},{"osd":5,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.876}]},{"osd":6,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.747},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.82999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":717009,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.44900000000000001}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.52800000000000002}]},{"osd":3,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.54500000000000004}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.5},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.74399999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":126107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.117},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.83999999999999997}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.2090000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.96499999999999997}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.2470000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":125981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.378},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.49099999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.71699999999999997}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T23:00:58.538 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-17T23:00:58.538 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-17T23:00:58.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-17T23:00:58.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-17T23:00:58.539 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-17T23:00:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 Processor -- start 2024-01-17T23:00:58.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 -- start start 2024-01-17T23:00:58.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83581515a0 0x7f83580c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83580b0ff0 0x7f8358157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8358158510 con 0x7f83580cd560 2024-01-17T23:00:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cd370 con 0x7f83580b0ff0 2024-01-17T23:00:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.723+0000 7f835e400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580c2260 con 0x7f83581515a0 2024-01-17T23:00:58.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.727+0000 7f8357e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83580b0ff0 0x7f8358157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.727+0000 7f8357400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83581515a0 0x7f83580c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.727+0000 7f8357e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f83580b0ff0 0x7f8358157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38616/0 (socket says 172.21.15.67:38616) 2024-01-17T23:00:58.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.727+0000 7f8357e00640 1 -- 172.21.15.67:0/1508539329 learned_addr learned my addr 172.21.15.67:0/1508539329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.731+0000 7f8357e00640 1 -- 172.21.15.67:0/1508539329 >> v2:172.21.15.137:3300/0 conn(0x7f83581515a0 msgr2=0x7f83580c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.731+0000 7f8357e00640 1 --2- 172.21.15.67:0/1508539329 >> v2:172.21.15.137:3300/0 conn(0x7f83581515a0 0x7f83580c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.731+0000 7f8357e00640 1 -- 172.21.15.67:0/1508539329 >> v1:172.21.15.67:6789/0 conn(0x7f83580cd560 legacy=0x7f83580c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.731+0000 7f8357e00640 1 -- 172.21.15.67:0/1508539329 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580c33a0 con 0x7f83580b0ff0 2024-01-17T23:00:58.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.735+0000 7f8357e00640 1 --2- 172.21.15.67:0/1508539329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83580b0ff0 0x7f8358157fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83580cdde0 tx=0x7f835001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e183eb21b4706f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:58.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f8356000640 1 -- 172.21.15.67:0/1508539329 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500af400 con 0x7f83580b0ff0 2024-01-17T23:00:58.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f8356000640 1 -- 172.21.15.67:0/1508539329 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500ab050 con 0x7f83580b0ff0 2024-01-17T23:00:58.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f8356000640 1 -- 172.21.15.67:0/1508539329 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500af780 con 0x7f83580b0ff0 2024-01-17T23:00:58.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 -- 172.21.15.67:0/1508539329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83580b0ff0 msgr2=0x7f8358157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 --2- 172.21.15.67:0/1508539329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83580b0ff0 0x7f8358157fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83580cdde0 tx=0x7f835001f1c0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 -- 172.21.15.67:0/1508539329 shutdown_connections 2024-01-17T23:00:58.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 --2- 172.21.15.67:0/1508539329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83580b0ff0 0x7f8358157fd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 --2- 172.21.15.67:0/1508539329 >> v2:172.21.15.137:3300/0 conn(0x7f83581515a0 0x7f83580c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 -- 172.21.15.67:0/1508539329 >> 172.21.15.67:0/1508539329 conn(0x7f8358061100 msgr2=0x7f8358061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 -- 172.21.15.67:0/1508539329 shutdown_connections 2024-01-17T23:00:58.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.739+0000 7f835e400640 1 -- 172.21.15.67:0/1508539329 wait complete. 2024-01-17T23:00:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 Processor -- start 2024-01-17T23:00:58.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 -- start start 2024-01-17T23:00:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83580b0ff0 0x7f8358148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83580cd560 0x7f83580af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580af0b0 con 0x7f83581515a0 2024-01-17T23:00:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580ace40 con 0x7f83580b0ff0 2024-01-17T23:00:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f835e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83581f3370 con 0x7f83580cd560 2024-01-17T23:00:58.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f8357e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f8357400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83580b0ff0 0x7f8358148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f8357e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38622/0 (socket says 172.21.15.67:38622) 2024-01-17T23:00:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f8357e00640 1 -- 172.21.15.67:0/856511835 learned_addr learned my addr 172.21.15.67:0/856511835 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:58.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.743+0000 7f8356a00640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83580cd560 0x7f83580af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.747+0000 7f8357e00640 1 -- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83580cd560 msgr2=0x7f83580af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.747+0000 7f8357e00640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83580cd560 0x7f83580af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.747+0000 7f8357e00640 1 -- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83580b0ff0 msgr2=0x7f8358148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.747+0000 7f8357e00640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83580b0ff0 0x7f8358148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:58.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.747+0000 7f8357e00640 1 -- 172.21.15.67:0/856511835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009b30 con 0x7f83581515a0 2024-01-17T23:00:58.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.751+0000 7f8357e00640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83500b2040 tx=0x7f835001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:58.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500afd30 con 0x7f83581515a0 2024-01-17T23:00:58.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350009510 con 0x7f83581515a0 2024-01-17T23:00:58.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500ba660 con 0x7f83581515a0 2024-01-17T23:00:58.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83581f27f0 con 0x7f83581515a0 2024-01-17T23:00:58.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83581f2db0 con 0x7f83581515a0 2024-01-17T23:00:58.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.755+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83580746a0 con 0x7f83581515a0 2024-01-17T23:00:58.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.775+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f83500b6040 con 0x7f83581515a0 2024-01-17T23:00:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.775+0000 7f834f400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 0x7f8330068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.775+0000 7f8357400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 0x7f8330068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:58.779+0000 7f8357400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 0x7f8330068d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ac0 tx=0x7f8348009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:59.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.027+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83500f3ee0 con 0x7f83581515a0 2024-01-17T23:00:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.027+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f83500f0220 con 0x7f83581515a0 2024-01-17T23:00:59.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.227+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f83580c3e40 con 0x7f83581515a0 2024-01-17T23:00:59.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.371+0000 7f834f400640 1 -- 172.21.15.67:0/856511835 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164567 (secure 0 0 0) 0x7f83500f3840 con 0x7f83581515a0 2024-01-17T23:00:59.379 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:00:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 msgr2=0x7f8330068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 0x7f8330068d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ac0 tx=0x7f8348009190 comp rx=0 tx=0).stop 2024-01-17T23:00:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 msgr2=0x7f83580af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83500b2040 tx=0x7f835001bf60 comp rx=0 tx=0).stop 2024-01-17T23:00:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 shutdown_connections 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f83300668c0 0x7f8330068d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83581515a0 0x7f83580af8b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f83580cd560 0x7f83580af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 --2- 172.21.15.67:0/856511835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83580b0ff0 0x7f8358148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 >> 172.21.15.67:0/856511835 conn(0x7f8358061100 msgr2=0x7f835814acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 shutdown_connections 2024-01-17T23:00:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.375+0000 7f835e400640 1 -- 172.21.15.67:0/856511835 wait complete. 2024-01-17T23:00:59.402 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"active_gid":4116,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":942351233},{"type":"v1","addr":"172.21.15.137:6801","nonce":942351233}]},"active_addr":"172.21.15.137:6801/942351233","active_change":"2024-01-17T22:59:31.733537+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1352338335}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1949631606}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3812927907}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1161877927}]}]} 2024-01-17T23:00:59.405 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-17T23:00:59.406 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-17T23:00:59.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:00:59.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 Processor -- start 2024-01-17T23:00:59.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 -- start start 2024-01-17T23:00:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb00c15b620 0x7fb00c061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c061640 0x7fb00c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c0c7d10 con 0x7fb00c1517f0 2024-01-17T23:00:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c1576d0 con 0x7fb00c15b620 2024-01-17T23:00:59.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.543+0000 7fb013600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c157970 con 0x7fb00c061640 2024-01-17T23:00:59.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.551+0000 7fb00be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb00c15b620 0x7fb00c061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.551+0000 7fb00be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb00c15b620 0x7fb00c061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38630/0 (socket says 172.21.15.67:38630) 2024-01-17T23:00:59.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.551+0000 7fb00be00640 1 -- 172.21.15.67:0/2509919433 learned_addr learned my addr 172.21.15.67:0/2509919433 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.555+0000 7fb00be00640 1 -- 172.21.15.67:0/2509919433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c061640 msgr2=0x7fb00c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.555+0000 7fb00be00640 1 --2- 172.21.15.67:0/2509919433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c061640 0x7fb00c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.555+0000 7fb00be00640 1 -- 172.21.15.67:0/2509919433 >> v1:172.21.15.137:6789/0 conn(0x7fb00c1517f0 legacy=0x7fb00c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:00:59.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.555+0000 7fb00be00640 1 -- 172.21.15.67:0/2509919433 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c157c50 con 0x7fb00c15b620 2024-01-17T23:00:59.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.559+0000 7fb00be00640 1 --2- 172.21.15.67:0/2509919433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c15b620 0x7fb00c061100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb00c061ca0 tx=0x7faff401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95e6de6678b8376 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb00b400640 1 -- 172.21.15.67:0/2509919433 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40ac410 con 0x7fb00c15b620 2024-01-17T23:00:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb00b400640 1 -- 172.21.15.67:0/2509919433 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40ac570 con 0x7fb00c15b620 2024-01-17T23:00:59.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb00b400640 1 -- 172.21.15.67:0/2509919433 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40ac900 con 0x7fb00c15b620 2024-01-17T23:00:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 -- 172.21.15.67:0/2509919433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c15b620 msgr2=0x7fb00c061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 --2- 172.21.15.67:0/2509919433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c15b620 0x7fb00c061100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb00c061ca0 tx=0x7faff401c4e0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 -- 172.21.15.67:0/2509919433 shutdown_connections 2024-01-17T23:00:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 --2- 172.21.15.67:0/2509919433 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c061640 0x7fb00c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 --2- 172.21.15.67:0/2509919433 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c15b620 0x7fb00c061100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 -- 172.21.15.67:0/2509919433 >> 172.21.15.67:0/2509919433 conn(0x7fb00c06ad40 msgr2=0x7fb00c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:00:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 -- 172.21.15.67:0/2509919433 shutdown_connections 2024-01-17T23:00:59.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 -- 172.21.15.67:0/2509919433 wait complete. 2024-01-17T23:00:59.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.563+0000 7fb013600640 1 Processor -- start 2024-01-17T23:00:59.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 -- start start 2024-01-17T23:00:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb00c1517f0 0x7fb00c141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c15b620 0x7fb00c144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c146050 con 0x7fb00c061640 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c147370 con 0x7fb00c1517f0 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb013600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c0b0e70 con 0x7fb00c15b620 2024-01-17T23:00:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb010c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb010c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38640/0 (socket says 172.21.15.67:38640) 2024-01-17T23:00:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.567+0000 7fb010c00640 1 -- 172.21.15.67:0/3315460432 learned_addr learned my addr 172.21.15.67:0/3315460432 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:00:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.571+0000 7fb010c00640 1 -- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c15b620 msgr2=0x7fb00c144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.571+0000 7fb010c00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c15b620 0x7fb00c144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.571+0000 7fb010c00640 1 -- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb00c1517f0 msgr2=0x7fb00c141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:00:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.571+0000 7fb010c00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb00c1517f0 0x7fb00c141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:00:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.571+0000 7fb010c00640 1 -- 172.21.15.67:0/3315460432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40094d0 con 0x7fb00c061640 2024-01-17T23:00:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.575+0000 7fb010c00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c490 tx=0x7faffc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc003600 con 0x7fb00c061640 2024-01-17T23:00:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc003780 con 0x7fb00c061640 2024-01-17T23:00:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc003b30 con 0x7fb00c061640 2024-01-17T23:00:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c1f66b0 con 0x7fb00c061640 2024-01-17T23:00:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c146550 con 0x7fb00c061640 2024-01-17T23:00:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.579+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c06b620 con 0x7fb00c061640 2024-01-17T23:00:59.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.835+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7faffc003c90 con 0x7fb00c061640 2024-01-17T23:00:59.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.835+0000 7fb008c00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 0x7fafe4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:00:59.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.835+0000 7fb00be00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 0x7fafe4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:00:59.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.839+0000 7fb00be00640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 0x7fafe4068d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faff40ae000 tx=0x7faff4004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:00:59.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.851+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faffc013e70 con 0x7fb00c061640 2024-01-17T23:00:59.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:00:59.851+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7faffc050e70 con 0x7fb00c061640 2024-01-17T23:01:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.011+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb00c0b0fe0 con 0x7fb00c061640 2024-01-17T23:01:00.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb008c00640 1 -- 172.21.15.67:0/3315460432 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7faffc017090 con 0x7fb00c061640 2024-01-17T23:01:00.064 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:00.064 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:01:00.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 msgr2=0x7fafe4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 0x7fafe4068d50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faff40ae000 tx=0x7faff4004740 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 msgr2=0x7fb00c1f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c490 tx=0x7faffc001e80 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 shutdown_connections 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fafe4066890 0x7fafe4068d50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb00c15b620 0x7fb00c144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb00c1517f0 0x7fb00c141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 --2- 172.21.15.67:0/3315460432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb00c061640 0x7fb00c1f6170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 >> 172.21.15.67:0/3315460432 conn(0x7fb00c06ad40 msgr2=0x7fb00c073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 shutdown_connections 2024-01-17T23:01:00.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.059+0000 7fb013600640 1 -- 172.21.15.67:0/3315460432 wait complete. 2024-01-17T23:01:00.087 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-17T23:01:00.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:01:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 Processor -- start 2024-01-17T23:01:00.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 -- start start 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3cc1539a0 0x7fe3cc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc15d3f0 0x7fe3cc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc0c9890 con 0x7fe3cc0c79c0 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc06d570 con 0x7fe3cc1539a0 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc159bf0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3cbe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe3cc1539a0 0x7fe3cc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3d0c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc15d3f0 0x7fe3cc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3cb400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe3cc0c79c0 0x7fe3cc061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:54410/0 (socket says 172.21.15.67:54410) 2024-01-17T23:01:00.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.223+0000 7fe3cb400640 1 -- 172.21.15.67:0/1452587232 learned_addr learned my addr 172.21.15.67:0/1452587232 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:00.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.227+0000 7fe3cbe00640 1 -- 172.21.15.67:0/1452587232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc15d3f0 msgr2=0x7fe3cc15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:00.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.227+0000 7fe3cbe00640 1 --2- 172.21.15.67:0/1452587232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc15d3f0 0x7fe3cc15d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.227+0000 7fe3cbe00640 1 -- 172.21.15.67:0/1452587232 >> v1:172.21.15.67:6789/0 conn(0x7fe3cc0c79c0 legacy=0x7fe3cc061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.227+0000 7fe3cbe00640 1 -- 172.21.15.67:0/1452587232 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc15dd60 con 0x7fe3cc1539a0 2024-01-17T23:01:00.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.235+0000 7fe3cbe00640 1 --2- 172.21.15.67:0/1452587232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc1539a0 0x7fe3cc0ca410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed45c8ef4e77b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:00.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.235+0000 7fe3caa00640 1 -- 172.21.15.67:0/1452587232 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0ab650 con 0x7fe3cc1539a0 2024-01-17T23:01:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3caa00640 1 -- 172.21.15.67:0/1452587232 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0ab7b0 con 0x7fe3cc1539a0 2024-01-17T23:01:00.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3caa00640 1 -- 172.21.15.67:0/1452587232 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0abb40 con 0x7fe3cc1539a0 2024-01-17T23:01:00.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 -- 172.21.15.67:0/1452587232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc1539a0 msgr2=0x7fe3cc0ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/1452587232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc1539a0 0x7fe3cc0ca410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c450 comp rx=0 tx=0).stop 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 -- 172.21.15.67:0/1452587232 shutdown_connections 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/1452587232 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc15d3f0 0x7fe3cc15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/1452587232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc1539a0 0x7fe3cc0ca410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 -- 172.21.15.67:0/1452587232 >> 172.21.15.67:0/1452587232 conn(0x7fe3cc06ad40 msgr2=0x7fe3cc06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 -- 172.21.15.67:0/1452587232 shutdown_connections 2024-01-17T23:01:00.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 -- 172.21.15.67:0/1452587232 wait complete. 2024-01-17T23:01:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.239+0000 7fe3d2c00640 1 Processor -- start 2024-01-17T23:01:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 -- start start 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3cc0c79c0 0x7fe3cc0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc1539a0 0x7fe3cc1f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1f1750 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0b2180 con 0x7fe3cc0c79c0 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d2c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc1f1c90 con 0x7fe3cc1539a0 2024-01-17T23:01:00.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d0c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d0c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38662/0 (socket says 172.21.15.67:38662) 2024-01-17T23:01:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3d0c00640 1 -- 172.21.15.67:0/252697942 learned_addr learned my addr 172.21.15.67:0/252697942 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3cbe00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3cc0c79c0 0x7fe3cc0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.243+0000 7fe3cb400640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc1539a0 0x7fe3cc1f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.247+0000 7fe3d0c00640 1 -- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc1539a0 msgr2=0x7fe3cc1f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.247+0000 7fe3d0c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc1539a0 0x7fe3cc1f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.247+0000 7fe3d0c00640 1 -- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3cc0c79c0 msgr2=0x7fe3cc0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.247+0000 7fe3d0c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3cc0c79c0 0x7fe3cc0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.247+0000 7fe3d0c00640 1 -- 172.21.15.67:0/252697942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009420 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.251+0000 7fe3d0c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d30 tx=0x7fe3c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:00.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4009ba0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400f040 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40146c0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc1f5ba0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc1f1960 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.255+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc1f1e40 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.275+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe3c4014820 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.279+0000 7fe3c3e00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 0x7fe3a4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:00.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.279+0000 7fe3cbe00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 0x7fe3a4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:00.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.279+0000 7fe3cbe00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 0x7fe3a4068d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0af000 tx=0x7fe3bc0a7000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:00.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.279+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3c40567a0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.527+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe3c40523e0 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.695+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3cc1f1e40 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3c3e00640 1 -- 172.21.15.67:0/252697942 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7fe3cc1f1e40 con 0x7fe3cc15d3f0 2024-01-17T23:01:00.748 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:00.748 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:01:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 msgr2=0x7fe3a4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 0x7fe3a4068d50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0af000 tx=0x7fe3bc0a7000 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 msgr2=0x7fe3cc15bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d30 tx=0x7fe3c400c490 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 shutdown_connections 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe3a4066890 0x7fe3a4068d50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3cc15d3f0 0x7fe3cc15bec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe3cc1539a0 0x7fe3cc1f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 --2- 172.21.15.67:0/252697942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3cc0c79c0 0x7fe3cc0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 >> 172.21.15.67:0/252697942 conn(0x7fe3cc06ad40 msgr2=0x7fe3cc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 shutdown_connections 2024-01-17T23:01:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:00.743+0000 7fe3d2c00640 1 -- 172.21.15.67:0/252697942 wait complete. 2024-01-17T23:01:00.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-17T23:01:00.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-17T23:01:00.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-17T23:01:00.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-17T23:01:00.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-17T23:01:00.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-17T23:01:00.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-17T23:01:00.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-17T23:01:01.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.007+0000 7f5cd5c00640 1 Processor -- start 2024-01-17T23:01:01.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.007+0000 7f5cd5c00640 1 -- start start 2024-01-17T23:01:01.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 Processor -- start 2024-01-17T23:01:01.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5cd5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5cd0157c60 0x7f5cd006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 -- start start 2024-01-17T23:01:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5cd5c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd01611a0 con 0x7f5cd0072500 2024-01-17T23:01:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5cd5c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd015deb0 con 0x7f5cd0158040 2024-01-17T23:01:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5cd5c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd006e5e0 con 0x7f5cd0157c60 2024-01-17T23:01:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 0x7f85e00c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 0x7f85e014f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e0072b60 con 0x7f85e0071410 2024-01-17T23:01:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00c6fc0 con 0x7f85e00cbb90 2024-01-17T23:01:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f85e7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0155910 con 0x7f85e014f380 2024-01-17T23:01:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5ccea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5cd0157c60 0x7f5cd006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5ccea00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5cd0157c60 0x7f5cd006e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58102/0 (socket says 172.21.15.67:58102) 2024-01-17T23:01:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5ccea00640 1 -- 172.21.15.67:0/2987802467 learned_addr learned my addr 172.21.15.67:0/2987802467 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.011+0000 7f5ccf400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5cd0072500 0x7f5cd0161630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41422/0 (socket says 172.21.15.67:41422) 2024-01-17T23:01:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.015+0000 7f85e5200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 0x7f85e00c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.015+0000 7f85e5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 0x7f85e014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.015+0000 7f85e5200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 0x7f85e00c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60112/0 (socket says 172.21.15.67:60112) 2024-01-17T23:01:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.015+0000 7f85e5200640 1 -- 172.21.15.67:0/3536222795 learned_addr learned my addr 172.21.15.67:0/3536222795 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f5ccd600640 1 -- 172.21.15.67:0/2987802467 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550261338 0 0) 0x7f5cd01611a0 con 0x7f5cd0072500 2024-01-17T23:01:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f5ccd600640 1 -- 172.21.15.67:0/2987802467 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb0003530 con 0x7f5cd0072500 2024-01-17T23:01:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f85e5c00640 1 -- 172.21.15.67:0/3536222795 >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 msgr2=0x7f85e00c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f85e5c00640 1 --2- 172.21.15.67:0/3536222795 >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 0x7f85e00c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f85e5c00640 1 -- 172.21.15.67:0/3536222795 >> v1:172.21.15.137:6789/0 conn(0x7f85e0071410 legacy=0x7f85e0071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.019+0000 7f85e5c00640 1 -- 172.21.15.67:0/3536222795 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0155bf0 con 0x7f85e014f380 2024-01-17T23:01:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.023+0000 7f6047e00640 1 Processor -- start 2024-01-17T23:01:01.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.027+0000 7f6047e00640 1 -- start start 2024-01-17T23:01:01.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.027+0000 7f6047e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f6048071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.027+0000 7f6047e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6048072990 con 0x7f60481594a0 2024-01-17T23:01:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.027+0000 7f85e5c00640 1 --2- 172.21.15.67:0/3536222795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 0x7f85e014f760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097c0 tx=0x7f85c801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc70e66a3e8eef5d server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f6047e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60481557e0 con 0x7f60480c5b00 2024-01-17T23:01:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f6047e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6048155aa0 con 0x7f604814fae0 2024-01-17T23:01:01.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f5ccea00640 1 -- 172.21.15.67:0/2987802467 >> v1:172.21.15.137:6789/0 conn(0x7f5cd0158040 legacy=0x7f5cd00c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f5ccea00640 1 -- 172.21.15.67:0/2987802467 >> v1:172.21.15.67:6789/0 conn(0x7f5cd0072500 legacy=0x7f5cd0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f5ccea00640 1 -- 172.21.15.67:0/2987802467 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd015ea10 con 0x7f5cd0157c60 2024-01-17T23:01:01.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f6047400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f60481594a0 0x7f6048160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41428/0 (socket says 172.21.15.67:41428) 2024-01-17T23:01:01.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.031+0000 7f6047400640 1 -- 172.21.15.67:0/463165424 learned_addr learned my addr 172.21.15.67:0/463165424 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:01.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 Processor -- start 2024-01-17T23:01:01.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 -- start start 2024-01-17T23:01:01.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4e4806d7a0 0x7f4e48161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e48154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480c2920 con 0x7f4e4806d3c0 2024-01-17T23:01:01.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4806f5b0 con 0x7f4e4806d7a0 2024-01-17T23:01:01.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f4e4e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480c5ff0 con 0x7f4e4806f9d0 2024-01-17T23:01:01.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f735e800640 1 Processor -- start 2024-01-17T23:01:01.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.035+0000 7f735e800640 1 -- start start 2024-01-17T23:01:01.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592828808 0 0) 0x7f6048072990 con 0x7f60481594a0 2024-01-17T23:01:01.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6028003530 con 0x7f60481594a0 2024-01-17T23:01:01.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 Processor -- start 2024-01-17T23:01:01.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 -- start start 2024-01-17T23:01:01.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f0da5c00640 1 Processor -- start 2024-01-17T23:01:01.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e48154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f735e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f735806d7a0 0x7f7358161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f735e800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580c2920 con 0x7f735806d3c0 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f735e800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580c5ff0 con 0x7f735806f9d0 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f735e800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735806f5b0 con 0x7f735806d7a0 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f0da5c00640 1 -- start start 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f77d5200640 1 Processor -- start 2024-01-17T23:01:01.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f5ccea00640 1 --2- 172.21.15.67:0/2987802467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0157c60 0x7f5cd006e0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009870 tx=0x7f5cb801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9728dd099b43cf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f77d5200640 1 -- start start 2024-01-17T23:01:01.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f85df400640 1 -- 172.21.15.67:0/3536222795 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80ab600 con 0x7f85e014f380 2024-01-17T23:01:01.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f85df400640 1 -- 172.21.15.67:0/3536222795 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c80a7050 con 0x7f85e014f380 2024-01-17T23:01:01.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f85df400640 1 -- 172.21.15.67:0/3536222795 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80ab980 con 0x7f85e014f380 2024-01-17T23:01:01.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f6046a00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f6048071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554150820 0x7f8554157030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8554159a10 0x7f85540c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8554150c00 con 0x7f85540c93d0 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8554156ba0 con 0x7f8554159a10 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f855a600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554159e30 con 0x7f8554150820 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.039+0000 7f0da5c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0da006d7a0 0x7f0da0161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f0da5c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 0x7f0da0154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f0da5c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00c2920 con 0x7f0da006d3c0 2024-01-17T23:01:01.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f0da5c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da006f5b0 con 0x7f0da006d7a0 2024-01-17T23:01:01.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f0da5c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00c5ff0 con 0x7f0da006f9d0 2024-01-17T23:01:01.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- 172.21.15.67:0/3536222795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 msgr2=0x7f85e014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- 172.21.15.67:0/3536222795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 0x7f85e014f760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097c0 tx=0x7f85c801c430 comp rx=0 tx=0).stop 2024-01-17T23:01:01.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e48154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55604/0 (socket says 172.21.15.67:55604) 2024-01-17T23:01:01.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f4e47e00640 1 -- 172.21.15.67:0/3376683077 learned_addr learned my addr 172.21.15.67:0/3376683077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- 172.21.15.67:0/3536222795 shutdown_connections 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- 172.21.15.67:0/3536222795 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e014f380 0x7f85e014f760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- 172.21.15.67:0/3536222795 >> v2:172.21.15.67:3300/0 conn(0x7f85e00cbb90 0x7f85e00c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- 172.21.15.67:0/3536222795 >> 172.21.15.67:0/3536222795 conn(0x7f85e00cb070 msgr2=0x7f85e00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- 172.21.15.67:0/3536222795 shutdown_connections 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- 172.21.15.67:0/3536222795 wait complete. 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f77d5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d00c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f77d5200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d0071340 0x7f77d0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f77d5200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d00726d0 con 0x7f77d014fa50 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f77d5200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d0071b90 con 0x7f77d0071340 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f77d5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d01567d0 con 0x7f77d00c6120 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 Processor -- start 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- start start 2024-01-17T23:01:01.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3376683077 >> v2:172.21.15.67:3300/0 conn(0x7f4e4806d7a0 0x7f4e48161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e0071410 0x7f85e0148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85e00cbb90 0x7f85e0149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e014f380 0x7f85e00c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c4570 con 0x7f85e00cbb90 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c2e00 con 0x7f85e014f380 2024-01-17T23:01:01.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.043+0000 7f85e7c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c3290 con 0x7f85e0071410 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510284614 0 0) 0x7f6028003530 con 0x7f60481594a0 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 msgr2=0x7f6048071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f6048071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 >> v1:172.21.15.137:6789/0 conn(0x7f60480c5b00 legacy=0x7f6048158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048155d80 con 0x7f60481594a0 2024-01-17T23:01:01.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f6040001a20 con 0x7f60481594a0 2024-01-17T23:01:01.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f0d9e000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0da006d7a0 0x7f0da0161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 >> v1:172.21.15.67:6789/0 conn(0x7f60481594a0 legacy=0x7f6048160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6028003bf0 0x7f6028004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6028004650 0x7f602800b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f602800d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048155aa0 con 0x7f6028003bf0 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602800dd40 con 0x7f6028004650 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602800df00 con 0x7f604814fae0 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f0d9f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 0x7f0da0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f0d9f400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 0x7f0da0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58126/0 (socket says 172.21.15.67:58126) 2024-01-17T23:01:01.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f0d9f400640 1 -- 172.21.15.67:0/3692282613 learned_addr learned my addr 172.21.15.67:0/3692282613 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f4e46a00640 1 -- 172.21.15.67:0/3376683077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 msgr2=0x7f4e48154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3376683077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e48154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f4e46a00640 1 -- 172.21.15.67:0/3376683077 >> v1:172.21.15.67:6789/0 conn(0x7f4e4806d3c0 legacy=0x7f4e480c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f4e46a00640 1 -- 172.21.15.67:0/3376683077 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480c62d0 con 0x7f4e4806d7a0 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.047+0000 7f8553e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8554159a10 0x7f85540c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f8553e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8554159a10 0x7f85540c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58112/0 (socket says 172.21.15.67:58112) 2024-01-17T23:01:01.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f8553e00640 1 -- 172.21.15.67:0/1210167558 learned_addr learned my addr 172.21.15.67:0/1210167558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f0d9e000640 1 -- 172.21.15.67:0/3692282613 >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 msgr2=0x7f0da0154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f0d9e000640 1 --2- 172.21.15.67:0/3692282613 >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 0x7f0da0154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f0d9e000640 1 -- 172.21.15.67:0/3692282613 >> v1:172.21.15.67:6789/0 conn(0x7f0da006d3c0 legacy=0x7f0da00c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f0d9e000640 1 -- 172.21.15.67:0/3692282613 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00c62d0 con 0x7f0da006d7a0 2024-01-17T23:01:01.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.051+0000 7f7356a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f735806d7a0 0x7f7358161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.055+0000 7f77cfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d0071340 0x7f77d0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.055+0000 7f7356a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f735806d7a0 0x7f7358161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60134/0 (socket says 172.21.15.67:60134) 2024-01-17T23:01:01.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.055+0000 7f7356a00640 1 -- 172.21.15.67:0/2256851898 learned_addr learned my addr 172.21.15.67:0/2256851898 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.055+0000 7f77cfe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77d0071340 0x7f77d0158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60148/0 (socket says 172.21.15.67:60148) 2024-01-17T23:01:01.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.055+0000 7f77cfe00640 1 -- 172.21.15.67:0/3400705478 learned_addr learned my addr 172.21.15.67:0/3400705478 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f8553e00640 1 -- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554150820 msgr2=0x7f8554157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f8553e00640 1 --2- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554150820 0x7f8554157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f8553e00640 1 -- 172.21.15.67:0/1210167558 >> v1:172.21.15.67:6789/0 conn(0x7f85540c93d0 legacy=0x7f85540cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f8553e00640 1 -- 172.21.15.67:0/1210167558 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540c1670 con 0x7f8554159a10 2024-01-17T23:01:01.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f85e5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e0071410 0x7f85e0148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f77cea00640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d00c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f77cfe00640 1 -- 172.21.15.67:0/3400705478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 msgr2=0x7f77d00c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f77cfe00640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d00c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f77cfe00640 1 -- 172.21.15.67:0/3400705478 >> v1:172.21.15.137:6789/0 conn(0x7f77d014fa50 legacy=0x7f77d00c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.059+0000 7f77cfe00640 1 -- 172.21.15.67:0/3400705478 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0156230 con 0x7f77d0071340 2024-01-17T23:01:01.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f85e5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e0071410 0x7f85e0148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55624/0 (socket says 172.21.15.67:55624) 2024-01-17T23:01:01.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f85e5200640 1 -- 172.21.15.67:0/2271473757 learned_addr learned my addr 172.21.15.67:0/2271473757 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f7356a00640 1 -- 172.21.15.67:0/2256851898 >> v1:172.21.15.137:6789/0 conn(0x7f735806f9d0 legacy=0x7f7358154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f7356a00640 1 -- 172.21.15.67:0/2256851898 >> v1:172.21.15.67:6789/0 conn(0x7f735806d3c0 legacy=0x7f73580c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f7356a00640 1 -- 172.21.15.67:0/2256851898 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580c62d0 con 0x7f735806d7a0 2024-01-17T23:01:01.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.063+0000 7f6046a00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6028003bf0 0x7f6028004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.067+0000 7f77cfe00640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d0071340 0x7f77d0158e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77c80098a0 tx=0x7f77c801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74f8f6e3368d142 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.067+0000 7f8553e00640 1 --2- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554159a10 0x7f85540c1130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be9c0436ef4dec4 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.067+0000 7f85dfe00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85e00cbb90 0x7f85e0149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5ccd600640 1 -- 172.21.15.67:0/2987802467 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80a8a30 con 0x7f5cd0157c60 2024-01-17T23:01:01.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5ccd600640 1 -- 172.21.15.67:0/2987802467 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb80a8b90 con 0x7f5cd0157c60 2024-01-17T23:01:01.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5ccd600640 1 -- 172.21.15.67:0/2987802467 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80b0440 con 0x7f5cd0157c60 2024-01-17T23:01:01.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6047400640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f602800d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 -- 172.21.15.67:0/2987802467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0157c60 msgr2=0x7f5cd006e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 --2- 172.21.15.67:0/2987802467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0157c60 0x7f5cd006e0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009870 tx=0x7f5cb801ed30 comp rx=0 tx=0).stop 2024-01-17T23:01:01.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f85e5c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e014f380 0x7f85e00c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 -- 172.21.15.67:0/2987802467 shutdown_connections 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 --2- 172.21.15.67:0/2987802467 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0157c60 0x7f5cd006e0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 -- 172.21.15.67:0/2987802467 >> 172.21.15.67:0/2987802467 conn(0x7f5cd00cb070 msgr2=0x7f5cd00cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 -- 172.21.15.67:0/2987802467 shutdown_connections 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6046a00640 1 -- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 msgr2=0x7f602800d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6046a00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f604814fae0 0x7f602800d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6046a00640 1 -- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6028004650 msgr2=0x7f602800b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6046a00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6028004650 0x7f602800b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f6046a00640 1 -- 172.21.15.67:0/463165424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60481557e0 con 0x7f6028003bf0 2024-01-17T23:01:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.071+0000 7f5cd5c00640 1 -- 172.21.15.67:0/2987802467 wait complete. 2024-01-17T23:01:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 Processor -- start 2024-01-17T23:01:01.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 -- start start 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0072500 0x7f5cd00c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cd0157c60 0x7f5cd00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 0x7f5cd0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00c2c30 con 0x7f5cd0157c60 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0152f90 con 0x7f5cd0072500 2024-01-17T23:01:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.075+0000 7f5cd5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0151f10 con 0x7f5cd0158040 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f85dfe00640 1 -- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e0071410 msgr2=0x7f85e0148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f85dfe00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f85e0071410 0x7f85e0148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f85dfe00640 1 -- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e014f380 msgr2=0x7f85e00c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f85dfe00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85e014f380 0x7f85e00c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f85dfe00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009420 con 0x7f85e00cbb90 2024-01-17T23:01:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.079+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3376683077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d7a0 0x7f4e48161260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097c0 tx=0x7f4e3001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1297c05b874cc1ac server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.087+0000 7f0d9e000640 1 --2- 172.21.15.67:0/3692282613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006d7a0 0x7f0da0161260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c9120 tx=0x7f0d9001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14b60a2323f8777 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.087+0000 7f85dfe00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85e00cbb90 0x7f85e0149840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c360 tx=0x7f85d000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f8553400640 1 -- 172.21.15.67:0/1210167558 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a5820 con 0x7f8554159a10 2024-01-17T23:01:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f8553400640 1 -- 172.21.15.67:0/1210167558 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c0a5980 con 0x7f8554159a10 2024-01-17T23:01:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f8553400640 1 -- 172.21.15.67:0/1210167558 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0a5d10 con 0x7f8554159a10 2024-01-17T23:01:01.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554159a10 msgr2=0x7f85540c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 --2- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554159a10 0x7f85540c1130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f854c009e50 tx=0x7f854c01c9a0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.097 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-17T23:01:01.094+0000 f9d6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- 172.21.15.67:0/1210167558 shutdown_connections 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 --2- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554159a10 0x7f85540c1130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 --2- 172.21.15.67:0/1210167558 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554150820 0x7f8554157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- 172.21.15.67:0/1210167558 >> 172.21.15.67:0/1210167558 conn(0x7f855406e150 msgr2=0x7f855406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- 172.21.15.67:0/1210167558 shutdown_connections 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- 172.21.15.67:0/1210167558 wait complete. 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f5ccea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0072500 0x7f5cd00c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f5ccf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 0x7f5cd0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77ce000640 1 -- 172.21.15.67:0/3400705478 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a8990 con 0x7f77d0071340 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77ce000640 1 -- 172.21.15.67:0/3400705478 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c80a8af0 con 0x7f77d0071340 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77ce000640 1 -- 172.21.15.67:0/3400705478 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c80a8e80 con 0x7f77d0071340 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 -- 172.21.15.67:0/3400705478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d0071340 msgr2=0x7f77d0158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d0071340 0x7f77d0158e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77c80098a0 tx=0x7f77c801ecd0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f5ccf400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 0x7f5cd0151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55644/0 (socket says 172.21.15.67:55644) 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f5ccf400640 1 -- 172.21.15.67:0/1175711288 learned_addr learned my addr 172.21.15.67:0/1175711288 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 -- 172.21.15.67:0/3400705478 shutdown_connections 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d0071340 0x7f77d0158e10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 --2- 172.21.15.67:0/3400705478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d00c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 -- 172.21.15.67:0/3400705478 >> 172.21.15.67:0/3400705478 conn(0x7f77d006ee50 msgr2=0x7f77d006f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 Processor -- start 2024-01-17T23:01:01.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f6046a00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6028003bf0 0x7f6028004030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6038009670 tx=0x7f6038020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b082f7dc8ab43d7c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f855a600640 1 -- start start 2024-01-17T23:01:01.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.091+0000 7f77d5200640 1 -- 172.21.15.67:0/3400705478 shutdown_connections 2024-01-17T23:01:01.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 -- 172.21.15.67:0/3400705478 wait complete. 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e46000640 1 -- 172.21.15.67:0/3376683077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a88f0 con 0x7f4e4806d7a0 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e46000640 1 -- 172.21.15.67:0/3376683077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300a8a50 con 0x7f4e4806d7a0 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e46000640 1 -- 172.21.15.67:0/3376683077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a8de0 con 0x7f4e4806d7a0 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 0x7f85540ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554150820 0x7f8554154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554159a10 0x7f8554154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554158f00 con 0x7f85540c93d0 2024-01-17T23:01:01.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554155b90 con 0x7f8554150820 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f855a600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8554157cc0 con 0x7f8554159a10 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 -- 172.21.15.67:0/3376683077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d7a0 msgr2=0x7f4e48161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3376683077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d7a0 0x7f4e48161260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4e300097c0 tx=0x7f4e3001ec30 comp rx=0 tx=0).stop 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 -- 172.21.15.67:0/3376683077 shutdown_connections 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3376683077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e48154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3376683077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d7a0 0x7f4e48161260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 -- 172.21.15.67:0/3376683077 >> 172.21.15.67:0/3376683077 conn(0x7f4e4806e070 msgr2=0x7f4e4806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 Processor -- start 2024-01-17T23:01:01.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 -- 172.21.15.67:0/3376683077 shutdown_connections 2024-01-17T23:01:01.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 -- 172.21.15.67:0/3376683077 wait complete. 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 -- start start 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77d0071340 0x7f77d00c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d01ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d014fa50 0x7f77d01efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d014e700 con 0x7f77d014fa50 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0150730 con 0x7f77d0071340 2024-01-17T23:01:01.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f77d5200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d014e970 con 0x7f77d00c6120 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.095+0000 7f4e4e400640 1 Processor -- start 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 -- start start 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d3c0 0x7f4e4814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e4806d7a0 0x7f4e4814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e481f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4814a7c0 con 0x7f4e4806d3c0 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4814df20 con 0x7f4e4806d7a0 2024-01-17T23:01:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f4e4e400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e481f47a0 con 0x7f4e4806f9d0 2024-01-17T23:01:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f5ccf400640 1 -- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0072500 msgr2=0x7f5cd00c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f5ccf400640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cd0072500 0x7f5cd00c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f5ccf400640 1 -- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cd0157c60 msgr2=0x7f5cd00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f5ccf400640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5cd0157c60 0x7f5cd00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.099+0000 7f5ccf400640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80094d0 con 0x7f5cd0158040 2024-01-17T23:01:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0d9d600640 1 -- 172.21.15.67:0/3692282613 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900a8910 con 0x7f0da006d7a0 2024-01-17T23:01:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0d9d600640 1 -- 172.21.15.67:0/3692282613 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900a8a70 con 0x7f0da006d7a0 2024-01-17T23:01:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0d9d600640 1 -- 172.21.15.67:0/3692282613 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900a8e00 con 0x7f0da006d7a0 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f5ccf400640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 0x7f5cd0151190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c7c0 tx=0x7f5cc800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 -- 172.21.15.67:0/3692282613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006d7a0 msgr2=0x7f0da0161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 --2- 172.21.15.67:0/3692282613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006d7a0 0x7f0da0161260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0da00c9120 tx=0x7f0d9001ec10 comp rx=0 tx=0).stop 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 -- 172.21.15.67:0/3692282613 shutdown_connections 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 --2- 172.21.15.67:0/3692282613 >> v2:172.21.15.137:3300/0 conn(0x7f0da006f9d0 0x7f0da0154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 --2- 172.21.15.67:0/3692282613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006d7a0 0x7f0da0161260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.103+0000 7f0da5c00640 1 -- 172.21.15.67:0/3692282613 >> 172.21.15.67:0/3692282613 conn(0x7f0da006e070 msgr2=0x7f0da006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- 172.21.15.67:0/3692282613 shutdown_connections 2024-01-17T23:01:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- 172.21.15.67:0/3692282613 wait complete. 2024-01-17T23:01:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f8559200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 0x7f85540ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380a9a80 con 0x7f6028003bf0 2024-01-17T23:01:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380a9be0 con 0x7f6028003bf0 2024-01-17T23:01:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6045600640 1 -- 172.21.15.67:0/463165424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380b1440 con 0x7f6028003bf0 2024-01-17T23:01:01.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 Processor -- start 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- start start 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 -- 172.21.15.67:0/463165424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6028003bf0 msgr2=0x7f6028004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 --2- 172.21.15.67:0/463165424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6028003bf0 0x7f6028004030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6038009670 tx=0x7f6038020e80 comp rx=0 tx=0).stop 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047400640 1 -- 172.21.15.67:0/463165424 reap_dead start 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 -- 172.21.15.67:0/463165424 shutdown_connections 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 -- 172.21.15.67:0/463165424 >> 172.21.15.67:0/463165424 conn(0x7f604806ee50 msgr2=0x7f604806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 -- 172.21.15.67:0/463165424 shutdown_connections 2024-01-17T23:01:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f6047e00640 1 -- 172.21.15.67:0/463165424 wait complete. 2024-01-17T23:01:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0da006d3c0 0x7f0da0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f8559200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 0x7f85540ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60180/0 (socket says 172.21.15.67:60180) 2024-01-17T23:01:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f8559200640 1 -- 172.21.15.67:0/2134796422 learned_addr learned my addr 172.21.15.67:0/2134796422 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0da006d7a0 0x7f0da014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 0x7f0da0152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00c9380 con 0x7f0da006f9d0 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01f3f30 con 0x7f0da006d7a0 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.107+0000 7f0da5c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00cb8b0 con 0x7f0da006d3c0 2024-01-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f7356a00640 1 --2- 172.21.15.67:0/2256851898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806d7a0 0x7f7358161260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7340009870 tx=0x7f734001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4997181817029105 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 Processor -- start 2024-01-17T23:01:01.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 -- start start 2024-01-17T23:01:01.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6028003bf0 0x7f604814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481516a0 0x7f604814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f604814cde0 0x7f60481eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604814ab50 con 0x7f60481516a0 2024-01-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604814a560 con 0x7f604814cde0 2024-01-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.111+0000 7f6047e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60481eb640 con 0x7f6028003bf0 2024-01-17T23:01:01.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.115+0000 7f77cea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d01ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.115+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e481f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.115+0000 7f77cea00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d01ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55656/0 (socket says 172.21.15.67:55656) 2024-01-17T23:01:01.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.115+0000 7f77cea00640 1 -- 172.21.15.67:0/654809269 learned_addr learned my addr 172.21.15.67:0/654809269 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.119+0000 7f8559200640 1 -- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554159a10 msgr2=0x7f8554154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.119+0000 7f8559200640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f8554159a10 0x7f8554154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.119+0000 7f8559200640 1 -- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554150820 msgr2=0x7f8554154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.119+0000 7f8559200640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8554150820 0x7f8554154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.119+0000 7f8559200640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009b30 con 0x7f85540c93d0 2024-01-17T23:01:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0003600 con 0x7f85e00cbb90 2024-01-17T23:01:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0003760 con 0x7f85e00cbb90 2024-01-17T23:01:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0003b50 con 0x7f85e00cbb90 2024-01-17T23:01:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e014d070 con 0x7f85e00cbb90 2024-01-17T23:01:01.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00c27b0 con 0x7f85e00cbb90 2024-01-17T23:01:01.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85e014fca0 con 0x7f85e00cbb90 2024-01-17T23:01:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f7356000640 1 -- 172.21.15.67:0/2256851898 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400a89b0 con 0x7f735806d7a0 2024-01-17T23:01:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f7356000640 1 -- 172.21.15.67:0/2256851898 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73400a8b10 con 0x7f735806d7a0 2024-01-17T23:01:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f7356000640 1 -- 172.21.15.67:0/2256851898 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400a8ea0 con 0x7f735806d7a0 2024-01-17T23:01:01.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f8559200640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 0x7f85540ca910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b550 tx=0x7f853c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 -- 172.21.15.67:0/2256851898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806d7a0 msgr2=0x7f7358161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 --2- 172.21.15.67:0/2256851898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806d7a0 0x7f7358161260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7340009870 tx=0x7f734001ecb0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 -- 172.21.15.67:0/2256851898 shutdown_connections 2024-01-17T23:01:01.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 --2- 172.21.15.67:0/2256851898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806d7a0 0x7f7358161260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 -- 172.21.15.67:0/2256851898 >> 172.21.15.67:0/2256851898 conn(0x7f735806e070 msgr2=0x7f735806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 -- 172.21.15.67:0/2256851898 shutdown_connections 2024-01-17T23:01:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.123+0000 7f735e800640 1 -- 172.21.15.67:0/2256851898 wait complete. 2024-01-17T23:01:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f0d9f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 0x7f0da0152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f77cea00640 1 -- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77d0071340 msgr2=0x7f77d00c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f77cea00640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77d0071340 0x7f77d00c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f77cea00640 1 -- 172.21.15.67:0/654809269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d014fa50 msgr2=0x7f77d01efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f77cea00640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77d014fa50 0x7f77d01efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f77cea00640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80094d0 con 0x7f77d00c6120 2024-01-17T23:01:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 Processor -- start 2024-01-17T23:01:01.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 -- start start 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f735806d3c0 0x7f73581606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f735806d7a0 0x7f735814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806f9d0 0x7f7358149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735814c840 con 0x7f735806f9d0 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735814a2e0 con 0x7f735806d3c0 2024-01-17T23:01:01.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.127+0000 7f735e800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73581f7950 con 0x7f735806d7a0 2024-01-17T23:01:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.131+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e481f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55666/0 (socket says 172.21.15.67:55666) 2024-01-17T23:01:01.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.131+0000 7f4e47e00640 1 -- 172.21.15.67:0/3627687163 learned_addr learned my addr 172.21.15.67:0/3627687163 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.135+0000 7f0d9f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 0x7f0da0152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60210/0 (socket says 172.21.15.67:60210) 2024-01-17T23:01:01.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.135+0000 7f0d9f400640 1 -- 172.21.15.67:0/256249856 learned_addr learned my addr 172.21.15.67:0/256249856 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.139+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e4806d7a0 0x7f4e4814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.143+0000 7f4e47e00640 1 -- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e4806d7a0 msgr2=0x7f4e4814a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.143+0000 7f4e47e00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e4806d7a0 0x7f4e4814a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.143+0000 7f4e47e00640 1 -- 172.21.15.67:0/3627687163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d3c0 msgr2=0x7f4e4814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.143+0000 7f4e47e00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e4806d3c0 0x7f4e4814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.143+0000 7f4e47e00640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009420 con 0x7f4e4806f9d0 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800a640 con 0x7f5cd0158040 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc800a7a0 con 0x7f5cd0158040 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800ab50 con 0x7f5cd0158040 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd01521b0 con 0x7f5cd0158040 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd01526f0 con 0x7f5cd0158040 2024-01-17T23:01:01.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.147+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cd015e730 con 0x7f5cd0158040 2024-01-17T23:01:01.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.151+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f85d0003cb0 con 0x7f85e00cbb90 2024-01-17T23:01:01.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.151+0000 7f77cea00640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d01ef6f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c7f0 tx=0x7f77b800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.151+0000 7f85dcc00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f85b8066890 0x7f85b8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.151+0000 7f85e5200640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f85b8066890 0x7f85b8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.151+0000 7f85e5200640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f85b8066890 0x7f85b8068d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85d80114a0 tx=0x7f85d800b040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f0d9ea00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0da006d3c0 0x7f0da0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85d0013e70 con 0x7f85e00cbb90 2024-01-17T23:01:01.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85dcc00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f85b80700f0 0x7f85b8072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85b8072c60 con 0x7f85b80700f0 2024-01-17T23:01:01.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d00510c0 con 0x7f85e00cbb90 2024-01-17T23:01:01.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85e5c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f85b80700f0 0x7f85b8072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85e5c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f85b80700f0 0x7f85b8072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f6046a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6028003bf0 0x7f604814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.155+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== osd.0 v2:172.21.15.67:6808/3222856110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f85b8072c60 con 0x7f85b80700f0 2024-01-17T23:01:01.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.159+0000 7f0d9e000640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0da006d7a0 0x7f0da014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f7357400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f735806d3c0 0x7f73581606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f0d9f400640 1 -- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0da006d3c0 msgr2=0x7f0da0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f0d9f400640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0da006d3c0 0x7f0da0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f7357400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f735806d3c0 0x7f73581606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58182/0 (socket says 172.21.15.67:58182) 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f7357400640 1 -- 172.21.15.67:0/2722893944 learned_addr learned my addr 172.21.15.67:0/2722893944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f0d9f400640 1 -- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0da006d7a0 msgr2=0x7f0da014ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f0d9f400640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0da006d7a0 0x7f0da014ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.163+0000 7f0d9f400640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009420 con 0x7f0da006f9d0 2024-01-17T23:01:01.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.167+0000 7f7357e00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806f9d0 0x7f7358149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.167+0000 7f6047400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f604814cde0 0x7f60481eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.167+0000 7f6046a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6028003bf0 0x7f604814d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55686/0 (socket says 172.21.15.67:55686) 2024-01-17T23:01:01.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.167+0000 7f6046a00640 1 -- 172.21.15.67:0/1831040480 learned_addr learned my addr 172.21.15.67:0/1831040480 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f0d9f400640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 0x7f0da0152e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800efc0 tx=0x7f0d9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c010870 con 0x7f85540c93d0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0109f0 con 0x7f85540c93d0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c010da0 con 0x7f85540c93d0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8554157900 con 0x7f85540c93d0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85541560c0 con 0x7f85540c93d0 2024-01-17T23:01:01.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.171+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8554156830 con 0x7f85540c93d0 2024-01-17T23:01:01.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.175+0000 7f7357e00640 1 -- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f735806d7a0 msgr2=0x7f735814c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.175+0000 7f7357e00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f735806d7a0 0x7f735814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.175+0000 7f7357e00640 1 -- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f735806d3c0 msgr2=0x7f73581606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.175+0000 7f7357e00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f735806d3c0 0x7f73581606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.175+0000 7f7357e00640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73400094d0 con 0x7f735806f9d0 2024-01-17T23:01:01.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f6046000640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481516a0 0x7f604814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 --> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85e01555e0 con 0x7f85b80700f0 2024-01-17T23:01:01.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f4e47e00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e481f76c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007bd0 tx=0x7f4e4000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85dcc00640 1 -- 172.21.15.67:0/2271473757 <== osd.0 v2:172.21.15.67:6808/3222856110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85c80ab520 con 0x7f85b80700f0 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f85b80700f0 msgr2=0x7f85b8072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f85b80700f0 0x7f85b8072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f85b8066890 msgr2=0x7f85b8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f85b8066890 0x7f85b8068d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85d80114a0 tx=0x7f85d800b040 comp rx=0 tx=0).stop 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85e00cbb90 msgr2=0x7f85e0149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 --2- 172.21.15.67:0/2271473757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85e00cbb90 0x7f85e0149840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d000c360 tx=0x7f85d000c820 comp rx=0 tx=0).stop 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e5c00640 1 -- 172.21.15.67:0/2271473757 reap_dead start 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 shutdown_connections 2024-01-17T23:01:01.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 >> 172.21.15.67:0/2271473757 conn(0x7f85e00cb070 msgr2=0x7f85e00c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 shutdown_connections 2024-01-17T23:01:01.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f85e7c00640 1 -- 172.21.15.67:0/2271473757 wait complete. 2024-01-17T23:01:01.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.179+0000 7f7357e00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806f9d0 0x7f7358149da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f735000c7e0 tx=0x7f735000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.206 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:01.206 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T23:01:01.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f6046000640 1 -- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6028003bf0 msgr2=0x7f604814d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f6046000640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6028003bf0 0x7f604814d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f6046000640 1 -- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f604814cde0 msgr2=0x7f60481eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f6046000640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f604814cde0 0x7f60481eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f6046000640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048151fa0 con 0x7f60481516a0 2024-01-17T23:01:01.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350003d90 con 0x7f735806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735000ce90 con 0x7f735806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500052b0 con 0x7f735806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73581f76b0 con 0x7f735806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.203+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735815fed0 con 0x7f735806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000dd50 con 0x7f4e4806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000f040 con 0x7f4e4806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40003bc0 con 0x7f4e4806f9d0 2024-01-17T23:01:01.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e481f7230 con 0x7f4e4806f9d0 2024-01-17T23:01:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f6046000640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481516a0 0x7f604814af70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f603000c410 tx=0x7f603000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e481f6f00 con 0x7f4e4806f9d0 2024-01-17T23:01:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73580c5c90 con 0x7f735806f9d0 2024-01-17T23:01:01.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.207+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e480c5c90 con 0x7f4e4806f9d0 2024-01-17T23:01:01.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.219+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f853c00f3c0 con 0x7f85540c93d0 2024-01-17T23:01:01.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.223+0000 7f8550c00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f852c066890 0x7f852c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.223+0000 7f8553e00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f852c066890 0x7f852c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.223+0000 7f8553e00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f852c066890 0x7f852c068d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f854c0ae000 tx=0x7f854c004ac0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.231+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f853c055c40 con 0x7f85540c93d0 2024-01-17T23:01:01.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8550c00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7f852c070170 0x7f852c072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f852c072ce0 con 0x7f852c070170 2024-01-17T23:01:01.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f853c051880 con 0x7f85540c93d0 2024-01-17T23:01:01.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8559c00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7f852c070170 0x7f852c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8559c00640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7f852c070170 0x7f852c072610 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.235+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== osd.4 v2:172.21.15.137:6802/2141080358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f852c072ce0 con 0x7f852c070170 2024-01-17T23:01:01.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80077a0 con 0x7f77d00c6120 2024-01-17T23:01:01.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8007900 con 0x7f77d00c6120 2024-01-17T23:01:01.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8007cb0 con 0x7f77d00c6120 2024-01-17T23:01:01.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d01f35c0 con 0x7f77d00c6120 2024-01-17T23:01:01.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d014f280 con 0x7f77d00c6120 2024-01-17T23:01:01.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.239+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77d0072970 con 0x7f77d00c6120 2024-01-17T23:01:01.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.247+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7350005410 con 0x7f735806f9d0 2024-01-17T23:01:01.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.251+0000 7f734f400640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7330066890 0x7f7330068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.251+0000 7f7357400640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7330066890 0x7f7330068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.251+0000 7f7357400640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7330066890 0x7f7330068d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73480099a0 tx=0x7f73480090e0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.251+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 --> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85540746a0 con 0x7f852c070170 2024-01-17T23:01:01.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f8550c00640 1 -- 172.21.15.67:0/2134796422 <== osd.4 v2:172.21.15.137:6802/2141080358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85540746a0 con 0x7f852c070170 2024-01-17T23:01:01.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7350013e70 con 0x7f735806f9d0 2024-01-17T23:01:01.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f734f400640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f7330070170 0x7f7330072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7330072ce0 con 0x7f7330070170 2024-01-17T23:01:01.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7350001710 con 0x7f735806f9d0 2024-01-17T23:01:01.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7f852c070170 msgr2=0x7f852c072610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7f852c070170 0x7f852c072610 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f7356a00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f7330070170 0x7f7330072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f852c066890 msgr2=0x7f852c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f852c066890 0x7f852c068d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f854c0ae000 tx=0x7f854c004ac0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 msgr2=0x7f85540ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 --2- 172.21.15.67:0/2134796422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85540c93d0 0x7f85540ca910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b550 tx=0x7f853c00ba10 comp rx=0 tx=0).stop 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f8559c00640 1 -- 172.21.15.67:0/2134796422 reap_dead start 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800cd20 con 0x7f0da006f9d0 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800f040 con 0x7f0da006f9d0 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98003be0 con 0x7f0da006f9d0 2024-01-17T23:01:01.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 shutdown_connections 2024-01-17T23:01:01.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 >> 172.21.15.67:0/2134796422 conn(0x7f855406e150 msgr2=0x7f85540c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f7356a00640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f7330070170 0x7f7330072610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 shutdown_connections 2024-01-17T23:01:01.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f855a600640 1 -- 172.21.15.67:0/2134796422 wait complete. 2024-01-17T23:01:01.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da01f4120 con 0x7f0da006f9d0 2024-01-17T23:01:01.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da00cb2f0 con 0x7f0da006f9d0 2024-01-17T23:01:01.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0da00c5c90 con 0x7f0da006f9d0 2024-01-17T23:01:01.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.255+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== osd.3 v2:172.21.15.67:6822/3364232548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7330072ce0 con 0x7f7330070170 2024-01-17T23:01:01.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030003600 con 0x7f60481516a0 2024-01-17T23:01:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030003760 con 0x7f60481516a0 2024-01-17T23:01:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030003b10 con 0x7f60481516a0 2024-01-17T23:01:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60481521f0 con 0x7f60481516a0 2024-01-17T23:01:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60481527b0 con 0x7f60481516a0 2024-01-17T23:01:01.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.259+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f604814fec0 con 0x7f60481516a0 2024-01-17T23:01:01.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 --> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f735806f1d0 con 0x7f7330070170 2024-01-17T23:01:01.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f734f400640 1 -- 172.21.15.67:0/2722893944 <== osd.3 v2:172.21.15.67:6822/3364232548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f73400a88d0 con 0x7f7330070170 2024-01-17T23:01:01.291 INFO:teuthology.orchestra.run.smithi067.stdout:60129542163 2024-01-17T23:01:01.291 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-17T23:01:01.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f7330070170 msgr2=0x7f7330072610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f7330070170 0x7f7330072610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7330066890 msgr2=0x7f7330068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7330066890 0x7f7330068d50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f73480099a0 tx=0x7f73480090e0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806f9d0 msgr2=0x7f7358149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f735e800640 1 --2- 172.21.15.67:0/2722893944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f735806f9d0 0x7f7358149da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f735000c7e0 tx=0x7f735000cca0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.283+0000 7f7357e00640 1 -- 172.21.15.67:0/2722893944 reap_dead start 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.287+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 shutdown_connections 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.287+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 >> 172.21.15.67:0/2722893944 conn(0x7f735806e070 msgr2=0x7f73580c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.287+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 shutdown_connections 2024-01-17T23:01:01.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.287+0000 7f735e800640 1 -- 172.21.15.67:0/2722893944 wait complete. 2024-01-17T23:01:01.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0d98003d40 con 0x7f0da006f9d0 2024-01-17T23:01:01.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d96a00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0d78066890 0x7f0d78068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d9ea00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0d78066890 0x7f0d78068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d9ea00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0d78066890 0x7f0d78068d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098e0 tx=0x7f0d88009060 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d98056a50 con 0x7f0da006f9d0 2024-01-17T23:01:01.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d96a00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f0d78070170 0x7f0d78072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.291+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d78072ce0 con 0x7f0d78070170 2024-01-17T23:01:01.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.295+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d9800ce80 con 0x7f0da006f9d0 2024-01-17T23:01:01.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.295+0000 7f0d9e000640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f0d78070170 0x7f0d78072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.295+0000 7f0d9e000640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f0d78070170 0x7f0d78072610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.295+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== osd.6 v2:172.21.15.137:6818/2947557560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0d78072ce0 con 0x7f0d78070170 2024-01-17T23:01:01.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.307+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6030003c70 con 0x7f60481516a0 2024-01-17T23:01:01.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f603ea00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6020066890 0x7f6020068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f6046a00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6020066890 0x7f6020068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f6046a00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6020066890 0x7f6020068d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6038020ec0 tx=0x7f60380046d0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6030054cc0 con 0x7f60481516a0 2024-01-17T23:01:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f603ea00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7f60200700f0 0x7f6020072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6020072c60 con 0x7f60200700f0 2024-01-17T23:01:01.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.311+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6030051000 con 0x7f60481516a0 2024-01-17T23:01:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.315+0000 7f6047400640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7f60200700f0 0x7f6020072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.315+0000 7f6047400640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7f60200700f0 0x7f6020072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.321 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:01.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-17T23:01:01.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.315+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== osd.2 v2:172.21.15.67:6800/549028895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6020072c60 con 0x7f60200700f0 2024-01-17T23:01:01.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.315+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f5cc800acb0 con 0x7f5cd0158040 2024-01-17T23:01:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.319+0000 7f5cc6a00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5ca8066890 0x7f5ca8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.319+0000 7f5ccea00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5ca8066890 0x7f5ca8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.319+0000 7f5ccea00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5ca8066890 0x7f5ca8068d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80b2000 tx=0x7f5cb80aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 --> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0da006f1d0 con 0x7f0d78070170 2024-01-17T23:01:01.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0d96a00640 1 -- 172.21.15.67:0/256249856 <== osd.6 v2:172.21.15.137:6818/2947557560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d900a8be0 con 0x7f0d78070170 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f0d78070170 msgr2=0x7f0d78072610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f0d78070170 0x7f0d78072610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0d78066890 msgr2=0x7f0d78068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0d78066890 0x7f0d78068d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d880098e0 tx=0x7f0d88009060 comp rx=0 tx=0).stop 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 msgr2=0x7f0da0152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 --2- 172.21.15.67:0/256249856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0da006f9d0 0x7f0da0152e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800efc0 tx=0x7f0d9800c490 comp rx=0 tx=0).stop 2024-01-17T23:01:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0d9f400640 1 -- 172.21.15.67:0/256249856 reap_dead start 2024-01-17T23:01:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 shutdown_connections 2024-01-17T23:01:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 >> 172.21.15.67:0/256249856 conn(0x7f0da006e070 msgr2=0x7f0da01619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 shutdown_connections 2024-01-17T23:01:01.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.327+0000 7f0da5c00640 1 -- 172.21.15.67:0/256249856 wait complete. 2024-01-17T23:01:01.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 --> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6048156340 con 0x7f60200700f0 2024-01-17T23:01:01.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f603ea00640 1 -- 172.21.15.67:0/1831040480 <== osd.2 v2:172.21.15.67:6800/549028895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6040005730 con 0x7f60200700f0 2024-01-17T23:01:01.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7f60200700f0 msgr2=0x7f6020072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7f60200700f0 0x7f6020072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6020066890 msgr2=0x7f6020068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6020066890 0x7f6020068d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6038020ec0 tx=0x7f60380046d0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481516a0 msgr2=0x7f604814af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 --2- 172.21.15.67:0/1831040480 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60481516a0 0x7f604814af70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f603000c410 tx=0x7f603000c810 comp rx=0 tx=0).stop 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047400640 1 -- 172.21.15.67:0/1831040480 reap_dead start 2024-01-17T23:01:01.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 shutdown_connections 2024-01-17T23:01:01.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 >> 172.21.15.67:0/1831040480 conn(0x7f604806ee50 msgr2=0x7f6048154160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 shutdown_connections 2024-01-17T23:01:01.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.335+0000 7f6047e00640 1 -- 172.21.15.67:0/1831040480 wait complete. 2024-01-17T23:01:01.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.351+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f77b80113f0 con 0x7f77d00c6120 2024-01-17T23:01:01.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.355+0000 7f77c7400640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f77a8066890 0x7f77a8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.355+0000 7f77cf400640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f77a8066890 0x7f77a8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.355+0000 7f77cf400640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f77a8066890 0x7f77a8068d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77c0001c90 tx=0x7f77c0007d20 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.359+0000 7fb954a00640 1 Processor -- start 2024-01-17T23:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.359+0000 7fb954a00640 1 -- start start 2024-01-17T23:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb954a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb94c153bb0 0x7fb94c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb954a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c15db50 con 0x7fb94c06f1f0 2024-01-17T23:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb954a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c15ccf0 con 0x7fb94c159920 2024-01-17T23:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb954a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c15cf40 con 0x7fb94c153bb0 2024-01-17T23:01:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:60129542163 2024-01-17T23:01:01.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-17T23:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb951600640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb94c06f1f0 0x7fb94c0c24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41454/0 (socket says 172.21.15.67:41454) 2024-01-17T23:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb951600640 1 -- 172.21.15.67:0/2537833802 learned_addr learned my addr 172.21.15.67:0/2537833802 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.363+0000 7fb952000640 1 --2- 172.21.15.67:0/2537833802 >> v2:172.21.15.137:3300/0 conn(0x7fb94c153bb0 0x7fb94c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.367+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568043413 0 0) 0x7fb94c15db50 con 0x7fb94c06f1f0 2024-01-17T23:01:01.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.367+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb92c003530 con 0x7fb94c06f1f0 2024-01-17T23:01:01.375 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:01.375 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-17T23:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2816034575 0 0) 0x7fb92c003530 con 0x7fb94c06f1f0 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 >> v2:172.21.15.137:3300/0 conn(0x7fb94c153bb0 msgr2=0x7fb94c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 --2- 172.21.15.67:0/2537833802 >> v2:172.21.15.137:3300/0 conn(0x7fb94c153bb0 0x7fb94c06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 >> v1:172.21.15.137:6789/0 conn(0x7fb94c159920 legacy=0x7fb94c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c15d220 con 0x7fb94c06f1f0 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fb93c001680 con 0x7fb94c06f1f0 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 >> v1:172.21.15.67:6789/0 conn(0x7fb94c06f1f0 legacy=0x7fb94c0c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92c0039d0 0x7fb92c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 0x7fb92c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0051e0 0x7fb92c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15cf40 con 0x7fb92c0047d0 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00c120 con 0x7fb92c0051e0 2024-01-17T23:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.371+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c00c2e0 con 0x7fb92c0039d0 2024-01-17T23:01:01.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.375+0000 7fb951600640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 0x7fb92c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb951600640 1 -- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92c0039d0 msgr2=0x7fb92c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb951600640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb92c0039d0 0x7fb92c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb951600640 1 -- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0051e0 msgr2=0x7fb92c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb951600640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0051e0 0x7fb92c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb951600640 1 -- 172.21.15.67:0/2537833802 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c003530 con 0x7fb92c0047d0 2024-01-17T23:01:01.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.379+0000 7fb952a00640 1 -- 172.21.15.67:0/2537833802 reap_dead start 2024-01-17T23:01:01.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.387+0000 7fb951600640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 0x7fb92c004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c0e0 tx=0x7fb93c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84c66223e5cac3e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0a5af0 con 0x7fb92c0047d0 2024-01-17T23:01:01.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c0a5c70 con 0x7fb92c0047d0 2024-01-17T23:01:01.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb950c00640 1 -- 172.21.15.67:0/2537833802 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c005b20 con 0x7fb92c0047d0 2024-01-17T23:01:01.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb954a00640 1 -- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 msgr2=0x7fb92c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb954a00640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 0x7fb92c004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00c0e0 tx=0x7fb93c01cb60 comp rx=0 tx=0).stop 2024-01-17T23:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb954a00640 1 -- 172.21.15.67:0/2537833802 shutdown_connections 2024-01-17T23:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb954a00640 1 --2- 172.21.15.67:0/2537833802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb92c0047d0 0x7fb92c004c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.391+0000 7fb954a00640 1 -- 172.21.15.67:0/2537833802 >> 172.21.15.67:0/2537833802 conn(0x7fb94c06fc50 msgr2=0x7fb94c070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7fb954a00640 1 -- 172.21.15.67:0/2537833802 shutdown_connections 2024-01-17T23:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7fb954a00640 1 -- 172.21.15.67:0/2537833802 wait complete. 2024-01-17T23:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4e40004030 con 0x7f4e4806f9d0 2024-01-17T23:01:01.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7fb954a00640 1 Processor -- start 2024-01-17T23:01:01.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7fb954a00640 1 -- start start 2024-01-17T23:01:01.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.395+0000 7f4e3f400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4e20066890 0x7f4e20068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7f4e47400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4e20066890 0x7f4e20068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0047d0 0x7fb94c1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c14eba0 0x7fb94c1ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c14b080 con 0x7fb94c14a6c0 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15bfb0 con 0x7fb92c0047d0 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb954a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c14e230 con 0x7fb94c14eba0 2024-01-17T23:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7f4e47400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4e20066890 0x7f4e20068d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009650 tx=0x7f4e38006bb0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb952a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb952000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0047d0 0x7fb94c1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb952a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60264/0 (socket says 172.21.15.67:60264) 2024-01-17T23:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.399+0000 7fb952a00640 1 -- 172.21.15.67:0/2274575282 learned_addr learned my addr 172.21.15.67:0/2274575282 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7fb952a00640 1 -- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c14eba0 msgr2=0x7fb94c1ea610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7fb952a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c14eba0 0x7fb94c1ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7fb952a00640 1 -- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0047d0 msgr2=0x7fb94c1f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7fb952a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0047d0 0x7fb94c1f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7fb952a00640 1 -- 172.21.15.67:0/2274575282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c15aa40 con 0x7fb94c14a6c0 2024-01-17T23:01:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5cc8055170 con 0x7f5cd0158040 2024-01-17T23:01:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.403+0000 7f5cc6a00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f5ca80700f0 0x7f5ca8072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.407+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ca8072c60 con 0x7f5ca80700f0 2024-01-17T23:01:01.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.407+0000 7f5cce000640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f5ca80700f0 0x7f5ca8072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.407+0000 7f5cce000640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f5ca80700f0 0x7f5ca8072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.407+0000 7fb952a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb94c15a870 tx=0x7fb93400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.407+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== osd.1 v2:172.21.15.67:6816/2710123956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5ca8072c60 con 0x7f5ca80700f0 2024-01-17T23:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340072d0 con 0x7fb94c14a6c0 2024-01-17T23:01:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb934007430 con 0x7fb94c14a6c0 2024-01-17T23:01:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340057d0 con 0x7fb94c14a6c0 2024-01-17T23:01:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c14d900 con 0x7fb94c14a6c0 2024-01-17T23:01:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c14dec0 con 0x7fb94c14a6c0 2024-01-17T23:01:01.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.415+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c0052a0 con 0x7fb94c14a6c0 2024-01-17T23:01:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.419+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77b8055f10 con 0x7f77d00c6120 2024-01-17T23:01:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.419+0000 7f77c7400640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7f77a80700f0 0x7f77a8072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.419+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77a8072c60 con 0x7f77a80700f0 2024-01-17T23:01:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.423+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cc80514b0 con 0x7f5cd0158040 2024-01-17T23:01:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.423+0000 7f77cfe00640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7f77a80700f0 0x7f77a8072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.423+0000 7f77cfe00640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7f77a80700f0 0x7f77a8072590 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.427+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== osd.7 v2:172.21.15.137:6810/2951291350 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f77a8072c60 con 0x7f77a80700f0 2024-01-17T23:01:01.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e40055420 con 0x7f4e4806f9d0 2024-01-17T23:01:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f4e3f400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7f4e200700f0 0x7f4e20072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e20072c60 con 0x7f4e200700f0 2024-01-17T23:01:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b800a3c0 con 0x7f77d00c6120 2024-01-17T23:01:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7f4e200700f0 0x7f4e20072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f4e46a00640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7f4e200700f0 0x7f4e20072590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.431+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 --> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cd015e450 con 0x7f5ca80700f0 2024-01-17T23:01:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.435+0000 7f5cc6a00640 1 -- 172.21.15.67:0/1175711288 <== osd.1 v2:172.21.15.67:6816/2710123956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5cc00050b0 con 0x7f5ca80700f0 2024-01-17T23:01:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.435+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e4000deb0 con 0x7f4e4806f9d0 2024-01-17T23:01:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.435+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f5ca80700f0 msgr2=0x7f5ca8072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.435+0000 7f5cd5c00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f5ca80700f0 0x7f5ca8072590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.435+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== osd.5 v2:172.21.15.137:6819/748642727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4e20072c60 con 0x7f4e200700f0 2024-01-17T23:01:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.439+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5ca8066890 msgr2=0x7f5ca8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.439+0000 7f5cd5c00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5ca8066890 0x7f5ca8068d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80b2000 tx=0x7f5cb80aa070 comp rx=0 tx=0).stop 2024-01-17T23:01:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.439+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 msgr2=0x7f5cd0151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.439+0000 7f5cd5c00640 1 --2- 172.21.15.67:0/1175711288 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5cd0158040 0x7f5cd0151190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c7c0 tx=0x7f5cc800cc80 comp rx=0 tx=0).stop 2024-01-17T23:01:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.443+0000 7f5ccf400640 1 -- 172.21.15.67:0/1175711288 reap_dead start 2024-01-17T23:01:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.443+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 shutdown_connections 2024-01-17T23:01:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.443+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 >> 172.21.15.67:0/1175711288 conn(0x7f5cd00cb070 msgr2=0x7f5cd00ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.443+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 shutdown_connections 2024-01-17T23:01:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.443+0000 7f5cd5c00640 1 -- 172.21.15.67:0/1175711288 wait complete. 2024-01-17T23:01:01.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.455+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 --> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77d01564f0 con 0x7f77a80700f0 2024-01-17T23:01:01.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.459+0000 7f77c7400640 1 -- 172.21.15.67:0/654809269 <== osd.7 v2:172.21.15.137:6810/2951291350 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77c80a88b0 con 0x7f77a80700f0 2024-01-17T23:01:01.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7f77a80700f0 msgr2=0x7f77a8072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7f77a80700f0 0x7f77a8072590 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f77a8066890 msgr2=0x7f77a8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f77a8066890 0x7f77a8068d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77c0001c90 tx=0x7f77c0007d20 comp rx=0 tx=0).stop 2024-01-17T23:01:01.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 msgr2=0x7f77d01ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77d5200640 1 --2- 172.21.15.67:0/654809269 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f77d00c6120 0x7f77d01ef6f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c7f0 tx=0x7f77b800ccb0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.463+0000 7f77cfe00640 1 -- 172.21.15.67:0/654809269 reap_dead start 2024-01-17T23:01:01.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.467+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 shutdown_connections 2024-01-17T23:01:01.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.467+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 >> 172.21.15.67:0/654809269 conn(0x7f77d006ee50 msgr2=0x7f77d0156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.467+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 --> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e4806f1d0 con 0x7f4e200700f0 2024-01-17T23:01:01.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.467+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 shutdown_connections 2024-01-17T23:01:01.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.467+0000 7f77d5200640 1 -- 172.21.15.67:0/654809269 wait complete. 2024-01-17T23:01:01.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e3f400640 1 -- 172.21.15.67:0/3627687163 <== osd.5 v2:172.21.15.137:6819/748642727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e300a8bc0 con 0x7f4e200700f0 2024-01-17T23:01:01.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7f4e200700f0 msgr2=0x7f4e20072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7f4e200700f0 0x7f4e20072590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4e20066890 msgr2=0x7f4e20068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4e20066890 0x7f4e20068d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009650 tx=0x7f4e38006bb0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 msgr2=0x7f4e481f76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 --2- 172.21.15.67:0/3627687163 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4e4806f9d0 0x7f4e481f76c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e40007bd0 tx=0x7f4e4000d4a0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e47e00640 1 -- 172.21.15.67:0/3627687163 reap_dead start 2024-01-17T23:01:01.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 shutdown_connections 2024-01-17T23:01:01.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.471+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 >> 172.21.15.67:0/3627687163 conn(0x7f4e4806e070 msgr2=0x7f4e480c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.475+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 shutdown_connections 2024-01-17T23:01:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.475+0000 7f4e4e400640 1 -- 172.21.15.67:0/3627687163 wait complete. 2024-01-17T23:01:01.483 INFO:teuthology.orchestra.run.smithi067.stdout:64424509460 2024-01-17T23:01:01.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T23:01:01.509 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:01.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-17T23:01:01.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.507+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb934005950 con 0x7fb94c14a6c0 2024-01-17T23:01:01.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.507+0000 7f9832400640 1 Processor -- start 2024-01-17T23:01:01.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.507+0000 7f9832400640 1 -- start start 2024-01-17T23:01:01.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.507+0000 7fb94a000640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 0x7fb924068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7fb952000640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 0x7fb924068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f9832400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f982c06d3c0 0x7f982c161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f9832400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0c2920 con 0x7f982c06d7a0 2024-01-17T23:01:01.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f9832400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0c5ff0 con 0x7f982c06f9d0 2024-01-17T23:01:01.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f9832400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c06f5b0 con 0x7f982c06d3c0 2024-01-17T23:01:01.519 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:01.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-17T23:01:01.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7fb952000640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 0x7fb924068d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb944004b40 tx=0x7fb944009870 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f982b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f982c06d3c0 0x7f982c161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f982be00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f982c06f9d0 0x7f982c154610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50006/0 (socket says 172.21.15.67:50006) 2024-01-17T23:01:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.511+0000 7f982be00640 1 -- 172.21.15.67:0/1895422809 learned_addr learned my addr 172.21.15.67:0/1895422809 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.515+0000 7fad5a000640 1 Processor -- start 2024-01-17T23:01:01.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.515+0000 7fad5a000640 1 -- start start 2024-01-17T23:01:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.519+0000 7fad5a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fad5406d7a0 0x7fad54161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.519+0000 7fad5a000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad5406f9d0 0x7fad54154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.519+0000 7fad5a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad540c2920 con 0x7fad5406d3c0 2024-01-17T23:01:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.519+0000 7fad5a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5406f5b0 con 0x7fad5406d7a0 2024-01-17T23:01:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.519+0000 7fad5a000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540c5ff0 con 0x7fad5406f9d0 2024-01-17T23:01:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.523+0000 7f982b400640 1 -- 172.21.15.67:0/1895422809 >> v1:172.21.15.137:6789/0 conn(0x7f982c06f9d0 legacy=0x7f982c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.523+0000 7f982b400640 1 -- 172.21.15.67:0/1895422809 >> v1:172.21.15.67:6789/0 conn(0x7f982c06d7a0 legacy=0x7f982c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.523+0000 7f982b400640 1 -- 172.21.15.67:0/1895422809 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0c62d0 con 0x7f982c06d3c0 2024-01-17T23:01:01.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.535+0000 7f982b400640 1 --2- 172.21.15.67:0/1895422809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06d3c0 0x7f982c161260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f982c0cbf70 tx=0x7f981c01ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e615cc4fad0f87 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.543+0000 7fad53e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad5406f9d0 0x7fad54154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.547+0000 7fad53e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad5406f9d0 0x7fad54154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58216/0 (socket says 172.21.15.67:58216) 2024-01-17T23:01:01.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.547+0000 7fad53e00640 1 -- 172.21.15.67:0/1456521998 learned_addr learned my addr 172.21.15.67:0/1456521998 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f982a000640 1 -- 172.21.15.67:0/1895422809 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a8930 con 0x7f982c06d3c0 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f982a000640 1 -- 172.21.15.67:0/1895422809 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0a8a90 con 0x7f982c06d3c0 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f982a000640 1 -- 172.21.15.67:0/1895422809 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a8e20 con 0x7f982c06d3c0 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f9832400640 1 -- 172.21.15.67:0/1895422809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06d3c0 msgr2=0x7f982c161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f9832400640 1 --2- 172.21.15.67:0/1895422809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06d3c0 0x7f982c161260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f982c0cbf70 tx=0x7f981c01ec30 comp rx=0 tx=0).stop 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f9832400640 1 -- 172.21.15.67:0/1895422809 shutdown_connections 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f9832400640 1 --2- 172.21.15.67:0/1895422809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06d3c0 0x7f982c161260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.551+0000 7f9832400640 1 -- 172.21.15.67:0/1895422809 >> 172.21.15.67:0/1895422809 conn(0x7f982c06e070 msgr2=0x7f982c06e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7f9832400640 1 -- 172.21.15.67:0/1895422809 shutdown_connections 2024-01-17T23:01:01.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7f9832400640 1 -- 172.21.15.67:0/1895422809 wait complete. 2024-01-17T23:01:01.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7f9832400640 1 Processor -- start 2024-01-17T23:01:01.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7fad53e00640 1 -- 172.21.15.67:0/1456521998 >> v2:172.21.15.67:3300/0 conn(0x7fad5406d7a0 msgr2=0x7fad54161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7fad53e00640 1 --2- 172.21.15.67:0/1456521998 >> v2:172.21.15.67:3300/0 conn(0x7fad5406d7a0 0x7fad54161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7fad53e00640 1 -- 172.21.15.67:0/1456521998 >> v1:172.21.15.137:6789/0 conn(0x7fad5406d3c0 legacy=0x7fad540c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.555+0000 7fad53e00640 1 -- 172.21.15.67:0/1456521998 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540c62d0 con 0x7fad5406f9d0 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 -- start start 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c06d7a0 0x7f982c1e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06f9d0 0x7f982c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1e9df0 con 0x7f982c06d7a0 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c151220 con 0x7f982c06f9d0 2024-01-17T23:01:01.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f9832400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1e9550 con 0x7f982c06d3c0 2024-01-17T23:01:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.559+0000 7f982b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.563+0000 7f982b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55726/0 (socket says 172.21.15.67:55726) 2024-01-17T23:01:01.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.563+0000 7f982b400640 1 -- 172.21.15.67:0/1476255670 learned_addr learned my addr 172.21.15.67:0/1476255670 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7fad53e00640 1 --2- 172.21.15.67:0/1456521998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad54154610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad540c9120 tx=0x7fad4c01f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e1bc46ca99d035 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982be00640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06f9d0 0x7f982c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982b400640 1 -- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06f9d0 msgr2=0x7f982c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982b400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06f9d0 0x7f982c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982b400640 1 -- 172.21.15.67:0/1476255670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c06d7a0 msgr2=0x7f982c1e88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982b400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c06d7a0 0x7f982c1e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.571+0000 7f982b400640 1 -- 172.21.15.67:0/1476255670 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009420 con 0x7f982c06d3c0 2024-01-17T23:01:01.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.583+0000 7f982b400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f981c01b840 tx=0x7f981c01b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7fbb7cc00640 1 Processor -- start 2024-01-17T23:01:01.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7fbb7cc00640 1 -- start start 2024-01-17T23:01:01.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7fad52000640 1 -- 172.21.15.67:0/1456521998 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0af400 con 0x7fad5406f9d0 2024-01-17T23:01:01.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7fad52000640 1 -- 172.21.15.67:0/1456521998 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c0ab050 con 0x7fad5406f9d0 2024-01-17T23:01:01.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7fad52000640 1 -- 172.21.15.67:0/1456521998 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0af400 con 0x7fad5406f9d0 2024-01-17T23:01:01.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7f2cfa200640 1 Processor -- start 2024-01-17T23:01:01.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.587+0000 7f2cfa200640 1 -- start start 2024-01-17T23:01:01.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 -- 172.21.15.67:0/1456521998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 msgr2=0x7fad54154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 --2- 172.21.15.67:0/1456521998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad54154610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad540c9120 tx=0x7fad4c01f1a0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fbb7cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 -- 172.21.15.67:0/1456521998 shutdown_connections 2024-01-17T23:01:01.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 --2- 172.21.15.67:0/1456521998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad54154610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 --2- 172.21.15.67:0/1456521998 >> v2:172.21.15.67:3300/0 conn(0x7fad5406d7a0 0x7fad54161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 -- 172.21.15.67:0/1456521998 >> 172.21.15.67:0/1456521998 conn(0x7fad5406e070 msgr2=0x7fad5406e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fbb7cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbb7806f9d0 0x7fbb78154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fbb7cc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780c2920 con 0x7fbb7806d7a0 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fbb7cc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7806f5b0 con 0x7fbb7806f9d0 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fbb7cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780c5ff0 con 0x7fbb7806d3c0 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 -- 172.21.15.67:0/1456521998 shutdown_connections 2024-01-17T23:01:01.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7fad5a000640 1 -- 172.21.15.67:0/1456521998 wait complete. 2024-01-17T23:01:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7f2cfa200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7f2cfa200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 0x7f2cf40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7f2cfa200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf41611c0 con 0x7f2cf4061100 2024-01-17T23:01:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7f2cfa200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40c7cd0 con 0x7f2cf40c3fa0 2024-01-17T23:01:01.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.591+0000 7f2cfa200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41613f0 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b0e00 con 0x7f982c06d3c0 2024-01-17T23:01:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0b9400 con 0x7f982c06d3c0 2024-01-17T23:01:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b97b0 con 0x7f982c06d3c0 2024-01-17T23:01:01.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 Processor -- start 2024-01-17T23:01:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c1e9830 con 0x7f982c06d3c0 2024-01-17T23:01:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c15cc60 con 0x7f982c06d3c0 2024-01-17T23:01:01.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 -- start start 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad5406d3c0 0x7fad5415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad5406d7a0 0x7fad540c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54159540 con 0x7fad5406d3c0 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad54158fa0 con 0x7fad5406f9d0 2024-01-17T23:01:01.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fad5a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54159260 con 0x7fad5406d7a0 2024-01-17T23:01:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c15caa0 con 0x7f982c06d3c0 2024-01-17T23:01:01.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7fbb75e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.595+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7f2cf2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 0x7f2cf40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fad53e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7f2cf2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 0x7f2cf40ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58248/0 (socket says 172.21.15.67:58248) 2024-01-17T23:01:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7f2cf2a00640 1 -- 172.21.15.67:0/2291949915 learned_addr learned my addr 172.21.15.67:0/2291949915 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fbb75e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55732/0 (socket says 172.21.15.67:55732) 2024-01-17T23:01:01.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fbb75e00640 1 -- 172.21.15.67:0/1485342749 learned_addr learned my addr 172.21.15.67:0/1485342749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fad53e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58254/0 (socket says 172.21.15.67:58254) 2024-01-17T23:01:01.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fad53e00640 1 -- 172.21.15.67:0/9597184 learned_addr learned my addr 172.21.15.67:0/9597184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.599+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb934013e70 con 0x7fb94c14a6c0 2024-01-17T23:01:01.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.607+0000 7fbb75e00640 1 -- 172.21.15.67:0/1485342749 >> v2:172.21.15.67:3300/0 conn(0x7fbb7806f9d0 msgr2=0x7fbb78154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.607+0000 7fbb75e00640 1 --2- 172.21.15.67:0/1485342749 >> v2:172.21.15.67:3300/0 conn(0x7fbb7806f9d0 0x7fbb78154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.607+0000 7fbb75e00640 1 -- 172.21.15.67:0/1485342749 >> v1:172.21.15.67:6789/0 conn(0x7fbb7806d7a0 legacy=0x7fbb780c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.607+0000 7fbb75e00640 1 -- 172.21.15.67:0/1485342749 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780c62d0 con 0x7fbb7806d3c0 2024-01-17T23:01:01.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7f2cf3400640 1 -- 172.21.15.67:0/2291949915 >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 msgr2=0x7f2cf40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7f2cf3400640 1 --2- 172.21.15.67:0/2291949915 >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 0x7f2cf40ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7f2cf3400640 1 -- 172.21.15.67:0/2291949915 >> v1:172.21.15.67:6789/0 conn(0x7f2cf4061100 legacy=0x7f2cf406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7f2cf3400640 1 -- 172.21.15.67:0/2291949915 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4161690 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7fad53e00640 1 -- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad5406d7a0 msgr2=0x7fad540c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7fad53e00640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad5406d7a0 0x7fad540c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7fad53e00640 1 -- 172.21.15.67:0/9597184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad5406d3c0 msgr2=0x7fad5415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7fad53e00640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad5406d3c0 0x7fad5415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.611+0000 7fad53e00640 1 -- 172.21.15.67:0/9597184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c009b30 con 0x7fad5406f9d0 2024-01-17T23:01:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.623+0000 7f2cf3400640 1 --2- 172.21.15.67:0/2291949915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf415e7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40097c0 tx=0x7f2ce401c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b892f0648c9883 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.623+0000 7fbb75e00640 1 --2- 172.21.15.67:0/1485342749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009870 tx=0x7fbb6801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339dc32e267bad8a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.631+0000 7fad53e00640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0b2040 tx=0x7fad4c01bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.643+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0af400 con 0x7fad5406f9d0 2024-01-17T23:01:01.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.643+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c009510 con 0x7fad5406f9d0 2024-01-17T23:01:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.643+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0b8640 con 0x7fad5406f9d0 2024-01-17T23:01:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.643+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5415d8d0 con 0x7fad5406f9d0 2024-01-17T23:01:01.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.643+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5415de90 con 0x7fad5406f9d0 2024-01-17T23:01:01.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.647+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad540746a0 con 0x7fad5406f9d0 2024-01-17T23:01:01.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 Processor -- start 2024-01-17T23:01:01.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 -- start start 2024-01-17T23:01:01.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 0x7fc6b015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6b00c3fa0 0x7fc6b00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b01611c0 con 0x7fc6b0061100 2024-01-17T23:01:01.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00c7cd0 con 0x7fc6b00c3fa0 2024-01-17T23:01:01.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.679+0000 7fc6b7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01613f0 con 0x7fc6b00c3bc0 2024-01-17T23:01:01.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 Processor -- start 2024-01-17T23:01:01.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 -- start start 2024-01-17T23:01:01.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cb40 0x7f32840c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f328414cf20 0x7f32840c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32840c2c60 0x7f32840cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32841571e0 con 0x7f32840c2c60 2024-01-17T23:01:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840c6820 con 0x7f328414cf20 2024-01-17T23:01:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.699+0000 7f328bc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c6540 con 0x7f328414cb40 2024-01-17T23:01:01.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.711+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fad4c0b6040 con 0x7fad5406f9d0 2024-01-17T23:01:01.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.711+0000 7fad4b400640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 0x7fad2c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fad53400640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 0x7fad2c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 Processor -- start 2024-01-17T23:01:01.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fad53400640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 0x7fad2c068d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad44009670 tx=0x7fad44006bd0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 -- start start 2024-01-17T23:01:01.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa57c0c73d0 0x7fa57c157440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c06a6e0 con 0x7fa57c0c77b0 2024-01-17T23:01:01.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c06aca0 con 0x7fa57c0c73d0 2024-01-17T23:01:01.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.715+0000 7fa583a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c157cf0 con 0x7fa57c06f210 2024-01-17T23:01:01.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.719+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fad4c0f4410 con 0x7fad5406f9d0 2024-01-17T23:01:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.767+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb934050a10 con 0x7fb94c14a6c0 2024-01-17T23:01:01.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.787+0000 7f3289c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32840c2c60 0x7f32840cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.787+0000 7f3289c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f32840c2c60 0x7f32840cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60324/0 (socket says 172.21.15.67:60324) 2024-01-17T23:01:01.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.787+0000 7f3289c00640 1 -- 172.21.15.67:0/2323557980 learned_addr learned my addr 172.21.15.67:0/2323557980 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.795+0000 7f3289c00640 1 -- 172.21.15.67:0/2323557980 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cb40 msgr2=0x7f32840c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.795+0000 7f3289c00640 1 --2- 172.21.15.67:0/2323557980 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cb40 0x7f32840c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.795+0000 7f3289c00640 1 -- 172.21.15.67:0/2323557980 >> v2:172.21.15.137:3300/0 conn(0x7f328414cf20 msgr2=0x7f32840c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.795+0000 7f3289c00640 1 --2- 172.21.15.67:0/2323557980 >> v2:172.21.15.137:3300/0 conn(0x7f328414cf20 0x7f32840c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.795+0000 7f3289c00640 1 -- 172.21.15.67:0/2323557980 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284156420 con 0x7f32840c2c60 2024-01-17T23:01:01.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.799+0000 7fc6b5200640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc6b0061100 0x7fc6b006bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41484/0 (socket says 172.21.15.67:41484) 2024-01-17T23:01:01.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.799+0000 7fc6b5200640 1 -- 172.21.15.67:0/3474349800 learned_addr learned my addr 172.21.15.67:0/3474349800 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:01.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.803+0000 7f3289c00640 1 --2- 172.21.15.67:0/2323557980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32840c2c60 0x7f32840cb1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f32840c8db0 tx=0x7f327c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c1cdd7565cd9e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.803+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487087727 0 0) 0x7fc6b01611c0 con 0x7fc6b0061100 2024-01-17T23:01:01.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.803+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc690003530 con 0x7fc6b0061100 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157922729 0 0) 0x7fc690003530 con 0x7fc6b0061100 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 msgr2=0x7fc6b015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 0x7fc6b015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00c3fa0 msgr2=0x7fc6b00ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 --2- 172.21.15.67:0/3474349800 >> v2:172.21.15.137:3300/0 conn(0x7fc6b00c3fa0 0x7fc6b00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0161690 con 0x7fc6b0061100 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fc6a8001a00 con 0x7fc6b0061100 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 >> v1:172.21.15.67:6789/0 conn(0x7fc6b0061100 legacy=0x7fc6b006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc690003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 0x7fc6900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690004f10 0x7fc69000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00c7cd0 con 0x7fc690003980 2024-01-17T23:01:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01613f0 con 0x7fc690004f10 2024-01-17T23:01:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690005690 con 0x7fc6b00c3bc0 2024-01-17T23:01:01.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f3283400640 1 -- 172.21.15.67:0/2323557980 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0ac410 con 0x7f32840c2c60 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f3283400640 1 -- 172.21.15.67:0/2323557980 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c0ac570 con 0x7f32840c2c60 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f3283400640 1 -- 172.21.15.67:0/2323557980 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0ac900 con 0x7f32840c2c60 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 -- 172.21.15.67:0/2323557980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32840c2c60 msgr2=0x7f32840cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 --2- 172.21.15.67:0/2323557980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32840c2c60 0x7f32840cb1b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f32840c8db0 tx=0x7f327c01c500 comp rx=0 tx=0).stop 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 -- 172.21.15.67:0/2323557980 shutdown_connections 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 --2- 172.21.15.67:0/2323557980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f32840c2c60 0x7f32840cb1b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 --2- 172.21.15.67:0/2323557980 >> v2:172.21.15.137:3300/0 conn(0x7f328414cf20 0x7f32840c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 --2- 172.21.15.67:0/2323557980 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cb40 0x7f32840c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 -- 172.21.15.67:0/2323557980 >> 172.21.15.67:0/2323557980 conn(0x7f3284071670 msgr2=0x7f328406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 -- 172.21.15.67:0/2323557980 shutdown_connections 2024-01-17T23:01:01.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.811+0000 7f328bc00640 1 -- 172.21.15.67:0/2323557980 wait complete. 2024-01-17T23:01:01.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 Processor -- start 2024-01-17T23:01:01.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 -- start start 2024-01-17T23:01:01.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc690003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32840c2c60 0x7f32841f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cf20 0x7f32841540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32841efc20 con 0x7f328414cb40 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32841ef010 con 0x7f32840c2c60 2024-01-17T23:01:01.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.815+0000 7f328bc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32841ef2f0 con 0x7f328414cf20 2024-01-17T23:01:01.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7fc6afe00640 1 -- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 msgr2=0x7fc6900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b00c3bc0 0x7fc6900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7fc6afe00640 1 -- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690004f10 msgr2=0x7fc69000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc690004f10 0x7fc69000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7fc6afe00640 1 -- 172.21.15.67:0/3474349800 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690003530 con 0x7fc690003980 2024-01-17T23:01:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7f3283e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7f3283e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60352/0 (socket says 172.21.15.67:60352) 2024-01-17T23:01:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.819+0000 7f3283e00640 1 -- 172.21.15.67:0/3351550573 learned_addr learned my addr 172.21.15.67:0/3351550573 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.823+0000 7f3283e00640 1 -- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cf20 msgr2=0x7f32841540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.823+0000 7f3283e00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cf20 0x7f32841540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.823+0000 7f3283e00640 1 -- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32840c2c60 msgr2=0x7f32841f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.823+0000 7f3283e00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32840c2c60 0x7f32841f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.823+0000 7f3283e00640 1 -- 172.21.15.67:0/3351550573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c0094d0 con 0x7f328414cb40 2024-01-17T23:01:01.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.827+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc690003da0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009890 tx=0x7fc6a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6701529573e8bf server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.827+0000 7f3283e00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f326c00b3f0 tx=0x7f326c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011830 con 0x7f328414cb40 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c011990 con 0x7f328414cb40 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32841ef5d0 con 0x7f328414cb40 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011d40 con 0x7f328414cb40 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841eecc0 con 0x7f328414cb40 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00ab600 con 0x7fc690003980 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a00a7050 con 0x7fc690003980 2024-01-17T23:01:01.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6aea00640 1 -- 172.21.15.67:0/3474349800 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00aba00 con 0x7fc690003980 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 -- 172.21.15.67:0/3474349800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 msgr2=0x7fc690003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3474349800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc690003da0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009890 tx=0x7fc6a001c3a0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b5200640 1 -- 172.21.15.67:0/3474349800 reap_dead start 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 -- 172.21.15.67:0/3474349800 shutdown_connections 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 -- 172.21.15.67:0/3474349800 >> 172.21.15.67:0/3474349800 conn(0x7fc6b006ad40 msgr2=0x7fc6b006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32840746a0 con 0x7f328414cb40 2024-01-17T23:01:01.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 -- 172.21.15.67:0/3474349800 shutdown_connections 2024-01-17T23:01:01.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.835+0000 7fc6b7200640 1 -- 172.21.15.67:0/3474349800 wait complete. 2024-01-17T23:01:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 Processor -- start 2024-01-17T23:01:01.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 -- start start 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc6b0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 0x7fc6b01f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b015f350 0x7fc6b015f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0158550 con 0x7fc690003980 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b015dba0 con 0x7fc6b015d720 2024-01-17T23:01:01.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.839+0000 7fc6b7200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01f6f80 con 0x7fc6b015f350 2024-01-17T23:01:01.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.843+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc6b0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.859+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc6b0159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60364/0 (socket says 172.21.15.67:60364) 2024-01-17T23:01:01.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.859+0000 7fc6afe00640 1 -- 172.21.15.67:0/3823451376 learned_addr learned my addr 172.21.15.67:0/3823451376 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.859+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f326c01a400 con 0x7f328414cb40 2024-01-17T23:01:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.859+0000 7f3280c00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 0x7f325c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.859+0000 7f3289200640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 0x7f325c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.863+0000 7f3289200640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 0x7f325c068d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f327400ab90 tx=0x7f3274009250 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.863+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f326c055e70 con 0x7f328414cb40 2024-01-17T23:01:01.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.947+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb91c005820 con 0x7fb94c14a6c0 2024-01-17T23:01:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.963+0000 7f2cf2000640 1 -- 172.21.15.67:0/2291949915 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40ab600 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.963+0000 7f2cf2000640 1 -- 172.21.15.67:0/2291949915 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40a7050 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.963+0000 7f2cf2000640 1 -- 172.21.15.67:0/2291949915 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40ab980 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.963+0000 7f2cfa200640 1 -- 172.21.15.67:0/2291949915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 msgr2=0x7f2cf415e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.963+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2291949915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf415e7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40097c0 tx=0x7f2ce401c320 comp rx=0 tx=0).stop 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- 172.21.15.67:0/2291949915 shutdown_connections 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2291949915 >> v2:172.21.15.137:3300/0 conn(0x7f2cf40c3fa0 0x7f2cf40ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2291949915 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf415e7e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- 172.21.15.67:0/2291949915 >> 172.21.15.67:0/2291949915 conn(0x7f2cf406ad40 msgr2=0x7f2cf406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- 172.21.15.67:0/2291949915 shutdown_connections 2024-01-17T23:01:01.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- 172.21.15.67:0/2291949915 wait complete. 2024-01-17T23:01:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 Processor -- start 2024-01-17T23:01:01.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- start start 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cf4061100 0x7f2cf40cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf41f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4159a50 con 0x7f2cf4061100 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf40ccf10 con 0x7f2cf40c3fa0 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7f2cfa200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41f6890 con 0x7f2cf40c3bc0 2024-01-17T23:01:01.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.967+0000 7fa582400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:01.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.979+0000 7fa582400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55774/0 (socket says 172.21.15.67:55774) 2024-01-17T23:01:01.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.979+0000 7fa582400640 1 -- 172.21.15.67:0/2023568512 learned_addr learned my addr 172.21.15.67:0/2023568512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:01.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.987+0000 7fa582400640 1 -- 172.21.15.67:0/2023568512 >> v2:172.21.15.137:3300/0 conn(0x7fa57c0c73d0 msgr2=0x7fa57c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.987+0000 7fa582400640 1 --2- 172.21.15.67:0/2023568512 >> v2:172.21.15.137:3300/0 conn(0x7fa57c0c73d0 0x7fa57c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.987+0000 7fa582400640 1 -- 172.21.15.67:0/2023568512 >> v1:172.21.15.137:6789/0 conn(0x7fa57c0c77b0 legacy=0x7fa57c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:01.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.987+0000 7fa582400640 1 -- 172.21.15.67:0/2023568512 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c157fd0 con 0x7fa57c06f210 2024-01-17T23:01:01.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb74a00640 1 -- 172.21.15.67:0/1485342749 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680a89b0 con 0x7fbb7806d3c0 2024-01-17T23:01:01.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb74a00640 1 -- 172.21.15.67:0/1485342749 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680a8b10 con 0x7fbb7806d3c0 2024-01-17T23:01:01.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb74a00640 1 -- 172.21.15.67:0/1485342749 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680a8ea0 con 0x7fbb7806d3c0 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- 172.21.15.67:0/1485342749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 msgr2=0x7fbb78161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/1485342749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009870 tx=0x7fbb6801ecf0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- 172.21.15.67:0/1485342749 shutdown_connections 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/1485342749 >> v2:172.21.15.67:3300/0 conn(0x7fbb7806f9d0 0x7fbb78154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/1485342749 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806d3c0 0x7fbb78161260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:01.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- 172.21.15.67:0/1485342749 >> 172.21.15.67:0/1485342749 conn(0x7fbb7806e070 msgr2=0x7fbb7806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:01.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- 172.21.15.67:0/1485342749 shutdown_connections 2024-01-17T23:01:01.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- 172.21.15.67:0/1485342749 wait complete. 2024-01-17T23:01:01.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 Processor -- start 2024-01-17T23:01:01.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.991+0000 7fbb7cc00640 1 -- start start 2024-01-17T23:01:02.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fad4c0f0050 con 0x7fad5406f9d0 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb7806d3c0 0x7fbb780ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb7806d7a0 0x7fbb781f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7814e900 con 0x7fbb7806d3c0 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7814e4c0 con 0x7fbb7806d7a0 2024-01-17T23:01:02.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:01.995+0000 7fbb7cc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb781f7630 con 0x7fbb7806f9d0 2024-01-17T23:01:02.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.007+0000 7fc6af400640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 0x7fc6b01f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.007+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.011+0000 7fc6b5200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b015f350 0x7fc6b015f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.015+0000 7fc6af400640 1 -- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b015f350 msgr2=0x7fc6b015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.015+0000 7fc6af400640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b015f350 0x7fc6b015f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.015+0000 7fc6af400640 1 -- 172.21.15.67:0/3823451376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 msgr2=0x7fc6b0159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.015+0000 7fc6af400640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc6b0159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.015+0000 7fc6af400640 1 -- 172.21.15.67:0/3823451376 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b015c9f0 con 0x7fc6b015d720 2024-01-17T23:01:02.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.019+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58320/0 (socket says 172.21.15.67:58320) 2024-01-17T23:01:02.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.019+0000 7f2cf3e00640 1 -- 172.21.15.67:0/2802471832 learned_addr learned my addr 172.21.15.67:0/2802471832 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:02.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.031+0000 7f2cf3e00640 1 -- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 msgr2=0x7f2cf41f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.031+0000 7f2cf3e00640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf41f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.031+0000 7f2cf3e00640 1 -- 172.21.15.67:0/2802471832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cf4061100 msgr2=0x7f2cf40cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.031+0000 7f2cf3e00640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cf4061100 0x7f2cf40cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.031+0000 7f2cf3e00640 1 -- 172.21.15.67:0/2802471832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009420 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.035+0000 7fc6af400640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 0x7fc6b01f6a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc69800b480 tx=0x7fc69800b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.039+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f981c0b7040 con 0x7f982c06d3c0 2024-01-17T23:01:02.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.039+0000 7fa582400640 1 --2- 172.21.15.67:0/2023568512 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa574009e50 tx=0x7fa57401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f638cce43d62a1b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.039+0000 7f9823400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 0x7f9804068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.039+0000 7f982aa00640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 0x7f9804068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.039+0000 7f982aa00640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 0x7f9804068d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9814007fd0 tx=0x7f98140079a0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fbb75400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb7806d7a0 0x7fbb781f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698010610 con 0x7fc6b015d720 2024-01-17T23:01:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698010770 con 0x7fc6b015d720 2024-01-17T23:01:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b015fd10 con 0x7fc6b015d720 2024-01-17T23:01:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698010b20 con 0x7fc6b015d720 2024-01-17T23:01:02.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.043+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b00c29c0 con 0x7fc6b015d720 2024-01-17T23:01:02.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.047+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b006b620 con 0x7fc6b015d720 2024-01-17T23:01:02.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.051+0000 7f2cf3e00640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c7b0 tx=0x7f2cec00cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.055+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f981c0f3d70 con 0x7f982c06d3c0 2024-01-17T23:01:02.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.079+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f981c120e60 con 0x7f982c06d3c0 2024-01-17T23:01:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.103+0000 7fbb76800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.103+0000 7fbb76800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55832/0 (socket says 172.21.15.67:55832) 2024-01-17T23:01:02.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.103+0000 7fbb76800640 1 -- 172.21.15.67:0/2154824863 learned_addr learned my addr 172.21.15.67:0/2154824863 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:02.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7fbb76800640 1 -- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb7806d7a0 msgr2=0x7fbb781f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7fbb76800640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb7806d7a0 0x7fbb781f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7fbb76800640 1 -- 172.21.15.67:0/2154824863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb7806d3c0 msgr2=0x7fbb780ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7fbb76800640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb7806d3c0 0x7fbb780ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7fbb76800640 1 -- 172.21.15.67:0/2154824863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680094d0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.111+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f326c051ab0 con 0x7f328414cb40 2024-01-17T23:01:02.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.119+0000 7fbb76800640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000b970 tx=0x7fbb7000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa57b400640 1 -- 172.21.15.67:0/2023568512 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740a5730 con 0x7fa57c06f210 2024-01-17T23:01:02.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa57b400640 1 -- 172.21.15.67:0/2023568512 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740a5890 con 0x7fa57c06f210 2024-01-17T23:01:02.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa57b400640 1 -- 172.21.15.67:0/2023568512 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740a5c20 con 0x7fa57c06f210 2024-01-17T23:01:02.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fb94a000640 1 -- 172.21.15.67:0/2274575282 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb934017070 con 0x7fb94c14a6c0 2024-01-17T23:01:02.129 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 -- 172.21.15.67:0/2023568512 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 msgr2=0x7fa57c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 --2- 172.21.15.67:0/2023568512 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa574009e50 tx=0x7fa57401c9a0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 -- 172.21.15.67:0/2023568512 shutdown_connections 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 --2- 172.21.15.67:0/2023568512 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c151290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 --2- 172.21.15.67:0/2023568512 >> v2:172.21.15.137:3300/0 conn(0x7fa57c0c73d0 0x7fa57c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 -- 172.21.15.67:0/2023568512 >> 172.21.15.67:0/2023568512 conn(0x7fa57c061100 msgr2=0x7fa57c06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 -- 172.21.15.67:0/2023568512 shutdown_connections 2024-01-17T23:01:02.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.123+0000 7fa583a00640 1 -- 172.21.15.67:0/2023568512 wait complete. 2024-01-17T23:01:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 msgr2=0x7fb924068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 0x7fb924068d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb944004b40 tx=0x7fb944009870 comp rx=0 tx=0).stop 2024-01-17T23:01:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 msgr2=0x7fb94c14ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb94c15a870 tx=0x7fb93400c820 comp rx=0 tx=0).stop 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 Processor -- start 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 shutdown_connections 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb9240668c0 0x7fb924068d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb94c14a6c0 0x7fb94c14ab40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb94c14eba0 0x7fb94c1ea610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 --2- 172.21.15.67:0/2274575282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92c0047d0 0x7fb94c1f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 >> 172.21.15.67:0/2274575282 conn(0x7fb94c06fc50 msgr2=0x7fb94c14f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 -- start start 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 shutdown_connections 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fb954a00640 1 -- 172.21.15.67:0/2274575282 wait complete. 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa57c0c77b0 0x7fa57c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c143620 con 0x7fa57c0c73d0 2024-01-17T23:01:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c143be0 con 0x7fa57c0c77b0 2024-01-17T23:01:02.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fa583a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c1419f0 con 0x7fa57c06f210 2024-01-17T23:01:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000cb40 con 0x7fbb7806f9d0 2024-01-17T23:01:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000ccc0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.127+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70014680 con 0x7fbb7806f9d0 2024-01-17T23:01:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.131+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb781f78f0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.131+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7814f1a0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.131+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb780746a0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.131+0000 7fa581000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.0 2024-01-17T23:01:02.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.159+0000 7fa57be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.163+0000 7fa57be00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60402/0 (socket says 172.21.15.67:60402) 2024-01-17T23:01:02.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.163+0000 7fa57be00640 1 -- 172.21.15.67:0/4112451483 learned_addr learned my addr 172.21.15.67:0/4112451483 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 -- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 msgr2=0x7fa57c140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 -- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa57c0c77b0 msgr2=0x7fa57c14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa57c0c77b0 0x7fa57c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 -- 172.21.15.67:0/4112451483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009b30 con 0x7fa57c0c73d0 2024-01-17T23:01:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.167+0000 7fa57be00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c490 tx=0x7fa564001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564003600 con 0x7fa57c0c73d0 2024-01-17T23:01:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c141cd0 con 0x7fa57c0c73d0 2024-01-17T23:01:02.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c143870 con 0x7fa57c0c73d0 2024-01-17T23:01:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0746a0 con 0x7fa57c0c73d0 2024-01-17T23:01:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564001130 con 0x7fa57c0c73d0 2024-01-17T23:01:02.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.171+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564007230 con 0x7fa57c0c73d0 2024-01-17T23:01:02.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.263+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad540cb6b0 con 0x7fad5406f9d0 2024-01-17T23:01:02.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.283+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f32840c9270 con 0x7f328414cb40 2024-01-17T23:01:02.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.335+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f982c15caa0 con 0x7f982c06d3c0 2024-01-17T23:01:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.363+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc698010c80 con 0x7fc6b015d720 2024-01-17T23:01:02.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.363+0000 7fc6a7e00640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 0x7fc688068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.363+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 0x7fc688068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.367+0000 7fc6afe00640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 0x7fc688068d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009890 tx=0x7fc6a0004850 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.371+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc698055110 con 0x7fc6b015d720 2024-01-17T23:01:02.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.403+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc698051450 con 0x7fc6b015d720 2024-01-17T23:01:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.431+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa564007390 con 0x7fa57c0c73d0 2024-01-17T23:01:02.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.435+0000 7fa578c00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.435+0000 7fa581000640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.435+0000 7fa581000640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 0x7fa554068d30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00a830 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.439+0000 7fad4b400640 1 -- 172.21.15.67:0/9597184 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad4c0b4090 con 0x7fad5406f9d0 2024-01-17T23:01:02.446 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:02.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 msgr2=0x7fad2c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 0x7fad2c068d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad44009670 tx=0x7fad44006bd0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 msgr2=0x7fad541f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0b2040 tx=0x7fad4c01bf40 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 shutdown_connections 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fad2c0668c0 0x7fad2c068d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad5406f9d0 0x7fad541f6900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fad5406d7a0 0x7fad540c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 --2- 172.21.15.67:0/9597184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad5406d3c0 0x7fad5415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 >> 172.21.15.67:0/9597184 conn(0x7fad5406e070 msgr2=0x7fad541617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 shutdown_connections 2024-01-17T23:01:02.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7fad5a000640 1 -- 172.21.15.67:0/9597184 wait complete. 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec003d90 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec005070 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec005420 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf40cc6f0 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf4158940 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.443+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf406b620 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.455+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa564007640 con 0x7fa57c0c73d0 2024-01-17T23:01:02.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.455+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa564050d80 con 0x7fa57c0c73d0 2024-01-17T23:01:02.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.459+0000 7f3280c00640 1 -- 172.21.15.67:0/3351550573 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f326c015070 con 0x7f328414cb40 2024-01-17T23:01:02.465 INFO:teuthology.orchestra.run.smithi067.stdout:64424509456 2024-01-17T23:01:02.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.459+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fbb7001d3b0 con 0x7fbb7806f9d0 2024-01-17T23:01:02.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.459+0000 7fbb6e000640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 0x7fbb50068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbb70084a80 con 0x7fbb7806f9d0 2024-01-17T23:01:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7fbb75e00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 0x7fbb50068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 msgr2=0x7f325c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 0x7f325c068d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f327400ab90 tx=0x7f3274009250 comp rx=0 tx=0).stop 2024-01-17T23:01:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 msgr2=0x7f32841576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f326c00b3f0 tx=0x7f326c00b8b0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 shutdown_connections 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f325c0668c0 0x7f325c068d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f328414cf20 0x7f32841540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f328414cb40 0x7f32841576c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 --2- 172.21.15.67:0/3351550573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32840c2c60 0x7f32841f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 >> 172.21.15.67:0/3351550573 conn(0x7f3284071670 msgr2=0x7f32840ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 shutdown_connections 2024-01-17T23:01:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7fbb75e00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 0x7fbb50068d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb680b2000 tx=0x7fbb68004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.463+0000 7f328bc00640 1 -- 172.21.15.67:0/3351550573 wait complete. 2024-01-17T23:01:02.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.3 2024-01-17T23:01:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.471+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fbb70051810 con 0x7fbb7806f9d0 2024-01-17T23:01:02.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509457 got 64424509456 for osd.7 2024-01-17T23:01:02.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9823400640 1 -- 172.21.15.67:0/1476255670 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f981c0b5030 con 0x7f982c06d3c0 2024-01-17T23:01:02.573 INFO:teuthology.orchestra.run.smithi067.stdout:60129542162 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 msgr2=0x7f9804068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 0x7f9804068d50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9814007fd0 tx=0x7f98140079a0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 msgr2=0x7f982c160100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f981c01b840 tx=0x7f981c01b9d0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 shutdown_connections 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9804066890 0x7f9804068d50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f982c06f9d0 0x7f982c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f982c06d7a0 0x7f982c1e88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 --2- 172.21.15.67:0/1476255670 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f982c06d3c0 0x7f982c160100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 >> 172.21.15.67:0/1476255670 conn(0x7f982c06e070 msgr2=0x7f982c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 shutdown_connections 2024-01-17T23:01:02.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.567+0000 7f9832400640 1 -- 172.21.15.67:0/1476255670 wait complete. 2024-01-17T23:01:02.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542162 for osd.4 2024-01-17T23:01:02.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.639+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa57c0c6d20 con 0x7fa57c0c73d0 2024-01-17T23:01:02.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa578c00640 1 -- 172.21.15.67:0/4112451483 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa564017020 con 0x7fa57c0c73d0 2024-01-17T23:01:02.649 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 msgr2=0x7fa554068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 0x7fa554068d30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00a830 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2024-01-17T23:01:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 msgr2=0x7fa57c140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa56400c490 tx=0x7fa564001e80 comp rx=0 tx=0).stop 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6b00746a0 con 0x7fc6b015d720 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 shutdown_connections 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa554066870 0x7fa554068d30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa57c0c77b0 0x7fa57c14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa57c0c73d0 0x7fa57c140e70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 --2- 172.21.15.67:0/4112451483 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa57c06f210 0x7fa57c140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.643+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 >> 172.21.15.67:0/4112451483 conn(0x7fa57c061100 msgr2=0x7fa57c14b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.647+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 shutdown_connections 2024-01-17T23:01:02.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.647+0000 7fa583a00640 1 -- 172.21.15.67:0/4112451483 wait complete. 2024-01-17T23:01:02.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.5 2024-01-17T23:01:02.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.679+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb78153390 con 0x7fbb7806f9d0 2024-01-17T23:01:02.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.691+0000 7fbb6e000640 1 -- 172.21.15.67:0/2154824863 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb70019090 con 0x7fbb7806f9d0 2024-01-17T23:01:02.699 INFO:teuthology.orchestra.run.smithi067.stdout:60129542161 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 msgr2=0x7fbb50068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 0x7fbb50068d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb680b2000 tx=0x7fbb68004740 comp rx=0 tx=0).stop 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 msgr2=0x7fbb781f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000b970 tx=0x7fbb7000be30 comp rx=0 tx=0).stop 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 shutdown_connections 2024-01-17T23:01:02.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fbb50066890 0x7fbb50068d50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fbb7806f9d0 0x7fbb781f5750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb7806d7a0 0x7fbb781f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 --2- 172.21.15.67:0/2154824863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb7806d3c0 0x7fbb780ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 >> 172.21.15.67:0/2154824863 conn(0x7fbb7806e070 msgr2=0x7fbb781617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 shutdown_connections 2024-01-17T23:01:02.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.695+0000 7fbb7cc00640 1 -- 172.21.15.67:0/2154824863 wait complete. 2024-01-17T23:01:02.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542161 for osd.2 2024-01-17T23:01:02.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6a7e00640 1 -- 172.21.15.67:0/3823451376 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc69801e020 con 0x7fc6b015d720 2024-01-17T23:01:02.764 INFO:teuthology.orchestra.run.smithi067.stdout:64424509459 2024-01-17T23:01:02.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 msgr2=0x7fc688068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 0x7fc688068d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009890 tx=0x7fc6a0004850 comp rx=0 tx=0).stop 2024-01-17T23:01:02.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 msgr2=0x7fc6b01f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:02.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 0x7fc6b01f6a40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc69800b480 tx=0x7fc69800b940 comp rx=0 tx=0).stop 2024-01-17T23:01:02.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 shutdown_connections 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc6880668c0 0x7fc688068d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc6b015f350 0x7fc6b015f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6b015d720 0x7fc6b01f6a40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 --2- 172.21.15.67:0/3823451376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc690003980 0x7fc6b0159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 >> 172.21.15.67:0/3823451376 conn(0x7fc6b006ad40 msgr2=0x7fc6b00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 shutdown_connections 2024-01-17T23:01:02.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.759+0000 7fc6b7200640 1 -- 172.21.15.67:0/3823451376 wait complete. 2024-01-17T23:01:02.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509459 for osd.1 2024-01-17T23:01:02.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.803+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2cec005580 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.807+0000 7f2ceb400640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 0x7f2ccc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.807+0000 7f2cf3400640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 0x7f2ccc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.807+0000 7f2cf3400640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 0x7f2ccc068d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40ad000 tx=0x7f2ce4004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:02.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.819+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2cec013e70 con 0x7f2cf40c3fa0 2024-01-17T23:01:02.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:02.855+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2cec051090 con 0x7f2cf40c3fa0 2024-01-17T23:01:03.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.023+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2cf40746a0 con 0x7f2cf40c3fa0 2024-01-17T23:01:03.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.031+0000 7f2ceb400640 1 -- 172.21.15.67:0/2802471832 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2cec0546b0 con 0x7f2cf40c3fa0 2024-01-17T23:01:03.039 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:03.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 msgr2=0x7f2ccc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 0x7f2ccc068d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40ad000 tx=0x7f2ce4004740 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 msgr2=0x7f2cf41f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c7b0 tx=0x7f2cec00cc70 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 shutdown_connections 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2ccc066890 0x7f2ccc068d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2cf40c3fa0 0x7f2cf41f6d20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2cf40c3bc0 0x7f2cf41f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 --2- 172.21.15.67:0/2802471832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cf4061100 0x7f2cf40cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 >> 172.21.15.67:0/2802471832 conn(0x7f2cf406ad40 msgr2=0x7f2cf415dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 shutdown_connections 2024-01-17T23:01:03.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.035+0000 7f2cfa200640 1 -- 172.21.15.67:0/2802471832 wait complete. 2024-01-17T23:01:03.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509457 for osd.6 2024-01-17T23:01:03.165 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-17T23:01:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 Processor -- start 2024-01-17T23:01:03.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 -- start start 2024-01-17T23:01:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09f0153970 0x7f09f015a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f015a6b0 con 0x7f09f00cc010 2024-01-17T23:01:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f006ac50 con 0x7f09f006e970 2024-01-17T23:01:03.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.299+0000 7f09f4c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f006af30 con 0x7f09f0153970 2024-01-17T23:01:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.303+0000 7f09ee800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f09f00cc010 0x7f09f0164070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41496/0 (socket says 172.21.15.67:41496) 2024-01-17T23:01:03.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.303+0000 7f09ee800640 1 -- 172.21.15.67:0/3386954752 learned_addr learned my addr 172.21.15.67:0/3386954752 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:03.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.303+0000 7f09ede00640 1 --2- 172.21.15.67:0/3386954752 >> v2:172.21.15.137:3300/0 conn(0x7f09f0153970 0x7f09f015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.303+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347738153 0 0) 0x7f09f015a6b0 con 0x7f09f00cc010 2024-01-17T23:01:03.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.303+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d0003530 con 0x7f09f00cc010 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4232234226 0 0) 0x7f09d0003530 con 0x7f09f00cc010 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 >> v2:172.21.15.137:3300/0 conn(0x7f09f0153970 msgr2=0x7f09f015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 --2- 172.21.15.67:0/3386954752 >> v2:172.21.15.137:3300/0 conn(0x7f09f0153970 0x7f09f015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 >> v1:172.21.15.137:6789/0 conn(0x7f09f006e970 legacy=0x7f09f015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f006e160 con 0x7f09f00cc010 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f09e8001a00 con 0x7f09f00cc010 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 >> v1:172.21.15.67:6789/0 conn(0x7f09f00cc010 legacy=0x7f09f0164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00039d0 0x7f09d0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 0x7f09d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09d0005190 0x7f09d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006af30 con 0x7f09d00047d0 2024-01-17T23:01:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000c070 con 0x7f09d0005190 2024-01-17T23:01:03.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.307+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000c230 con 0x7f09d00039d0 2024-01-17T23:01:03.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.311+0000 7f09ede00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00039d0 0x7f09d0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.311+0000 7f09ed400640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 0x7f09d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ed400640 1 -- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00039d0 msgr2=0x7f09d0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ed400640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00039d0 0x7f09d0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ed400640 1 -- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09d0005190 msgr2=0x7f09d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ed400640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09d0005190 0x7f09d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ed400640 1 -- 172.21.15.67:0/3386954752 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0003530 con 0x7f09d00047d0 2024-01-17T23:01:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.315+0000 7f09ee800640 1 -- 172.21.15.67:0/3386954752 reap_dead start 2024-01-17T23:01:03.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.319+0000 7f09ed400640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 0x7f09d0004c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09d8001750 tx=0x7f09d801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0236b5e6a4b801 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80052d0 con 0x7f09d00047d0 2024-01-17T23:01:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d80a7050 con 0x7f09d00047d0 2024-01-17T23:01:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09eca00640 1 -- 172.21.15.67:0/3386954752 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d8003840 con 0x7f09d00047d0 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 -- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 msgr2=0x7f09d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 0x7f09d0004c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09d8001750 tx=0x7f09d801c3a0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 -- 172.21.15.67:0/3386954752 shutdown_connections 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3386954752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d00047d0 0x7f09d0004c50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 -- 172.21.15.67:0/3386954752 >> 172.21.15.67:0/3386954752 conn(0x7f09f0072670 msgr2=0x7f09f006fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 -- 172.21.15.67:0/3386954752 shutdown_connections 2024-01-17T23:01:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 -- 172.21.15.67:0/3386954752 wait complete. 2024-01-17T23:01:03.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.323+0000 7f09f4c00640 1 Processor -- start 2024-01-17T23:01:03.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 -- start start 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09f01f33e0 0x7f09f01efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f00cb260 0x7f09f0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01f0360 con 0x7f09f01f33e0 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00c62d0 con 0x7f09f00cb260 2024-01-17T23:01:03.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09f4c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01f2990 con 0x7f09d00047d0 2024-01-17T23:01:03.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09ede00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09ede00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55866/0 (socket says 172.21.15.67:55866) 2024-01-17T23:01:03.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.327+0000 7f09ede00640 1 -- 172.21.15.67:0/3723066770 learned_addr learned my addr 172.21.15.67:0/3723066770 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.331+0000 7f09ee800640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f00cb260 0x7f09f0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ed400640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09f01f33e0 0x7f09f01efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ede00640 1 -- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f00cb260 msgr2=0x7f09f0156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ede00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f00cb260 0x7f09f0156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ede00640 1 -- 172.21.15.67:0/3723066770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09f01f33e0 msgr2=0x7f09f01efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ede00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09f01f33e0 0x7f09f01efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.335+0000 7f09ede00640 1 -- 172.21.15.67:0/3723066770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f01f3840 con 0x7f09d00047d0 2024-01-17T23:01:03.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.343+0000 7f09ede00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f09e0011900 tx=0x7f09e0011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e00095b0 con 0x7f09d00047d0 2024-01-17T23:01:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0004240 con 0x7f09d00047d0 2024-01-17T23:01:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000f8e0 con 0x7f09d00047d0 2024-01-17T23:01:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f015bcb0 con 0x7f09d00047d0 2024-01-17T23:01:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f015c270 con 0x7f09d00047d0 2024-01-17T23:01:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.359+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f006c830 con 0x7f09d00047d0 2024-01-17T23:01:03.473 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-17T23:01:03.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-17T23:01:03.600 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-17T23:01:03.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 Processor -- start 2024-01-17T23:01:03.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 -- start start 2024-01-17T23:01:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f640c9650 0x7f1f640c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406efe0 con 0x7f1f64151a90 2024-01-17T23:01:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406ed00 con 0x7f1f640c8970 2024-01-17T23:01:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f69400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6415b5d0 con 0x7f1f640c9650 2024-01-17T23:01:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f61e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1f640c9650 0x7f1f640c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f63200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1f640c8970 0x7f1f640c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50058/0 (socket says 172.21.15.67:50058) 2024-01-17T23:01:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.611+0000 7f1f63200640 1 -- 172.21.15.67:0/1736565773 learned_addr learned my addr 172.21.15.67:0/1736565773 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.615+0000 7f1f61e00640 1 -- 172.21.15.67:0/1736565773 >> v1:172.21.15.137:6789/0 conn(0x7f1f640c8970 legacy=0x7f1f640c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.615+0000 7f1f61e00640 1 -- 172.21.15.67:0/1736565773 >> v1:172.21.15.67:6789/0 conn(0x7f1f64151a90 legacy=0x7f1f64157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.615+0000 7f1f61e00640 1 -- 172.21.15.67:0/1736565773 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6415ac30 con 0x7f1f640c9650 2024-01-17T23:01:03.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.623+0000 7f1f61e00640 1 --2- 172.21.15.67:0/1736565773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f640c9650 0x7f1f640c7200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097c0 tx=0x7f1f4c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247126716f61d9fd server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f61400640 1 -- 172.21.15.67:0/1736565773 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a8970 con 0x7f1f640c9650 2024-01-17T23:01:03.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f61400640 1 -- 172.21.15.67:0/1736565773 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0a8ad0 con 0x7f1f640c9650 2024-01-17T23:01:03.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f61400640 1 -- 172.21.15.67:0/1736565773 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0a8e60 con 0x7f1f640c9650 2024-01-17T23:01:03.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 -- 172.21.15.67:0/1736565773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f640c9650 msgr2=0x7f1f640c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 --2- 172.21.15.67:0/1736565773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f640c9650 0x7f1f640c7200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097c0 tx=0x7f1f4c01ec70 comp rx=0 tx=0).stop 2024-01-17T23:01:03.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 -- 172.21.15.67:0/1736565773 shutdown_connections 2024-01-17T23:01:03.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 --2- 172.21.15.67:0/1736565773 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f640c9650 0x7f1f640c7200 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 -- 172.21.15.67:0/1736565773 >> 172.21.15.67:0/1736565773 conn(0x7f1f6406fc50 msgr2=0x7f1f64070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:03.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 -- 172.21.15.67:0/1736565773 shutdown_connections 2024-01-17T23:01:03.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.627+0000 7f1f69400640 1 -- 172.21.15.67:0/1736565773 wait complete. 2024-01-17T23:01:03.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 Processor -- start 2024-01-17T23:01:03.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 -- start start 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f640c8970 0x7f1f640cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f640c9650 0x7f1f640c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f640c7bb0 con 0x7f1f64151a90 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641e0880 con 0x7f1f640c8970 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.631+0000 7f1f69400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641e3630 con 0x7f1f640c9650 2024-01-17T23:01:03.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.635+0000 7f1f63200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.635+0000 7f1f62800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f640c8970 0x7f1f640cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.635+0000 7f1f63200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60438/0 (socket says 172.21.15.67:60438) 2024-01-17T23:01:03.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.635+0000 7f1f63200640 1 -- 172.21.15.67:0/1323554719 learned_addr learned my addr 172.21.15.67:0/1323554719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.639+0000 7f1f63200640 1 -- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f640c9650 msgr2=0x7f1f640c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.639+0000 7f1f63200640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f640c9650 0x7f1f640c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.639+0000 7f1f63200640 1 -- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f640c8970 msgr2=0x7f1f640cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.639+0000 7f1f63200640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f640c8970 0x7f1f640cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.639+0000 7f1f63200640 1 -- 172.21.15.67:0/1323554719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009420 con 0x7f1f64151a90 2024-01-17T23:01:03.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.643+0000 7f1f63200640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00caa0 tx=0x7f1f5c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.647+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00ac00 con 0x7f1f64151a90 2024-01-17T23:01:03.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.647+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00ad60 con 0x7f1f64151a90 2024-01-17T23:01:03.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.647+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c012620 con 0x7f1f64151a90 2024-01-17T23:01:03.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.647+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f640c5c50 con 0x7f1f64151a90 2024-01-17T23:01:03.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.647+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f640c1160 con 0x7f1f64151a90 2024-01-17T23:01:03.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.651+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f640c1680 con 0x7f1f64151a90 2024-01-17T23:01:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.663+0000 7f6fc4e00640 1 Processor -- start 2024-01-17T23:01:03.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.663+0000 7f6fc4e00640 1 -- start start 2024-01-17T23:01:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fc4e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6fc00c79c0 0x7f6fc0061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fc4e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00c9890 con 0x7f6fc01539a0 2024-01-17T23:01:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fc4e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc0159bf0 con 0x7f6fc0061640 2024-01-17T23:01:03.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fc4e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc006d570 con 0x7f6fc00c79c0 2024-01-17T23:01:03.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fbe800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6fc0061640 0x7f6fc015d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:50070/0 (socket says 172.21.15.67:50070) 2024-01-17T23:01:03.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.667+0000 7f6fbe800640 1 -- 172.21.15.67:0/1215265157 learned_addr learned my addr 172.21.15.67:0/1215265157 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:03.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-17T23:01:03.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.699+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f09e000fa40 con 0x7f09d00047d0 2024-01-17T23:01:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.699+0000 7f09e6000640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 0x7f09c8068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.699+0000 7f09ed400640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 0x7f09c8068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.699+0000 7f09ed400640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 0x7f09c8068d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09f006ed50 tx=0x7f09d80011a0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.707+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09e00045f0 con 0x7f09d00047d0 2024-01-17T23:01:03.722 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-17T23:01:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 Processor -- start 2024-01-17T23:01:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 -- start start 2024-01-17T23:01:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd384153a80 0x7fd3840c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38406ba50 0x7fd384159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd38415a310 0x7fd3840718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38406b5c0 con 0x7fd38415a310 2024-01-17T23:01:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd384159940 con 0x7fd384153a80 2024-01-17T23:01:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.759+0000 7fd389e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384153e60 con 0x7fd38406ba50 2024-01-17T23:01:03.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.763+0000 7fd382a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd384153a80 0x7fd3840c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.763+0000 7fd382a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd384153a80 0x7fd3840c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58398/0 (socket says 172.21.15.67:58398) 2024-01-17T23:01:03.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.763+0000 7fd382a00640 1 -- 172.21.15.67:0/1560710206 learned_addr learned my addr 172.21.15.67:0/1560710206 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.767+0000 7fd382a00640 1 -- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38406ba50 msgr2=0x7fd384159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.767+0000 7fd382a00640 1 --2- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38406ba50 0x7fd384159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.767+0000 7fd382a00640 1 -- 172.21.15.67:0/1560710206 >> v2:172.21.15.67:3300/0 conn(0x7fd38415a310 msgr2=0x7fd3840718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.767+0000 7fd382a00640 1 --2- 172.21.15.67:0/1560710206 >> v2:172.21.15.67:3300/0 conn(0x7fd38415a310 0x7fd3840718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.767+0000 7fd382a00640 1 -- 172.21.15.67:0/1560710206 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38406aa40 con 0x7fd384153a80 2024-01-17T23:01:03.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.775+0000 7fd382a00640 1 --2- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840c66e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3840cc700 tx=0x7fd37401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7e96c593bee3a46 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.788 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd381600640 1 -- 172.21.15.67:0/1560710206 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740ab600 con 0x7fd384153a80 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd381600640 1 -- 172.21.15.67:0/1560710206 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3740a7050 con 0x7fd384153a80 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd381600640 1 -- 172.21.15.67:0/1560710206 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740ab980 con 0x7fd384153a80 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 -- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 msgr2=0x7fd3840c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 --2- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840c66e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd3840cc700 tx=0x7fd37401c4e0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 -- 172.21.15.67:0/1560710206 shutdown_connections 2024-01-17T23:01:03.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 --2- 172.21.15.67:0/1560710206 >> v2:172.21.15.67:3300/0 conn(0x7fd38415a310 0x7fd3840718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 --2- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38406ba50 0x7fd384159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 --2- 172.21.15.67:0/1560710206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840c66e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 -- 172.21.15.67:0/1560710206 >> 172.21.15.67:0/1560710206 conn(0x7fd38406fba0 msgr2=0x7fd3840cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 -- 172.21.15.67:0/1560710206 shutdown_connections 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.783+0000 7fd389e00640 1 -- 172.21.15.67:0/1560710206 wait complete. 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f09e0051f60 con 0x7f09d00047d0 2024-01-17T23:01:03.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 Processor -- start 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 -- start start 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38406ba50 0x7fd3841405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38415a310 0x7fd3840c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841f6330 con 0x7fd38406ba50 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841f6520 con 0x7fd384153a80 2024-01-17T23:01:03.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.787+0000 7fd389e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841f6800 con 0x7fd38415a310 2024-01-17T23:01:03.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.791+0000 7fd382000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.791+0000 7fd382000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58406/0 (socket says 172.21.15.67:58406) 2024-01-17T23:01:03.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.791+0000 7fd382000640 1 -- 172.21.15.67:0/3224776252 learned_addr learned my addr 172.21.15.67:0/3224776252 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.803+0000 7fd383400640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38415a310 0x7fd3840c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.807+0000 7fd382000640 1 -- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38415a310 msgr2=0x7fd3840c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.807+0000 7fd382000640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38415a310 0x7fd3840c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.807+0000 7fd382000640 1 -- 172.21.15.67:0/3224776252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38406ba50 msgr2=0x7fd3841405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.807+0000 7fd382000640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38406ba50 0x7fd3841405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.807+0000 7fd382000640 1 -- 172.21.15.67:0/3224776252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740094d0 con 0x7fd384153a80 2024-01-17T23:01:03.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.815+0000 7fd382000640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b480 tx=0x7fd36c00b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.815+0000 7f7884a00640 1 Processor -- start 2024-01-17T23:01:03.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.815+0000 7f7884a00640 1 -- start start 2024-01-17T23:01:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7884a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f787c153bb0 0x7f787c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7884a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7884a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c15db50 con 0x7f787c0c2a00 2024-01-17T23:01:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7884a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c15ccf0 con 0x7f787c153bb0 2024-01-17T23:01:03.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7884a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c15cf40 con 0x7f787c06f1f0 2024-01-17T23:01:03.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.819+0000 7f7881600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.823+0000 7f7881600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55906/0 (socket says 172.21.15.67:55906) 2024-01-17T23:01:03.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.823+0000 7f7881600640 1 -- 172.21.15.67:0/2956628901 learned_addr learned my addr 172.21.15.67:0/2956628901 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c010870 con 0x7fd384153a80 2024-01-17T23:01:03.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0109f0 con 0x7fd384153a80 2024-01-17T23:01:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c010da0 con 0x7fd384153a80 2024-01-17T23:01:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3841f6ae0 con 0x7fd384153a80 2024-01-17T23:01:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3841f70a0 con 0x7fd384153a80 2024-01-17T23:01:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7f7881600640 1 -- 172.21.15.67:0/2956628901 >> v2:172.21.15.67:3300/0 conn(0x7f787c153bb0 msgr2=0x7f787c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7f7881600640 1 --2- 172.21.15.67:0/2956628901 >> v2:172.21.15.67:3300/0 conn(0x7f787c153bb0 0x7f787c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7f7881600640 1 -- 172.21.15.67:0/2956628901 >> v1:172.21.15.137:6789/0 conn(0x7f787c0c2a00 legacy=0x7f787c159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3840746a0 con 0x7fd384153a80 2024-01-17T23:01:03.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.827+0000 7f7881600640 1 -- 172.21.15.67:0/2956628901 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c15d220 con 0x7f787c06f1f0 2024-01-17T23:01:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.835+0000 7f7881600640 1 --2- 172.21.15.67:0/2956628901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7864009870 tx=0x7f786401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16cc3a4698db44ea server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.843+0000 7f7880c00640 1 -- 172.21.15.67:0/2956628901 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640a89b0 con 0x7f787c06f1f0 2024-01-17T23:01:03.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.843+0000 7f7880c00640 1 -- 172.21.15.67:0/2956628901 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78640a8b10 con 0x7f787c06f1f0 2024-01-17T23:01:03.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.843+0000 7f7880c00640 1 -- 172.21.15.67:0/2956628901 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640a8ea0 con 0x7f787c06f1f0 2024-01-17T23:01:03.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.843+0000 7f7884a00640 1 -- 172.21.15.67:0/2956628901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 msgr2=0x7f787c0c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.843+0000 7f7884a00640 1 --2- 172.21.15.67:0/2956628901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7864009870 tx=0x7f786401ecf0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 -- 172.21.15.67:0/2956628901 shutdown_connections 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 --2- 172.21.15.67:0/2956628901 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c06f1f0 0x7f787c0c24c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 --2- 172.21.15.67:0/2956628901 >> v2:172.21.15.67:3300/0 conn(0x7f787c153bb0 0x7f787c06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 -- 172.21.15.67:0/2956628901 >> 172.21.15.67:0/2956628901 conn(0x7f787c06fc50 msgr2=0x7f787c070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 -- 172.21.15.67:0/2956628901 shutdown_connections 2024-01-17T23:01:03.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 -- 172.21.15.67:0/2956628901 wait complete. 2024-01-17T23:01:03.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 Processor -- start 2024-01-17T23:01:03.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.847+0000 7f7884a00640 1 -- start start 2024-01-17T23:01:03.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c06f1f0 0x7f787c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787c0c2a00 0x7f787c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c15c4f0 con 0x7f787c06f1f0 2024-01-17T23:01:03.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0cbda0 con 0x7f787c0c2a00 2024-01-17T23:01:03.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7884a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c0c17f0 con 0x7f787c153bb0 2024-01-17T23:01:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7882a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7882a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55910/0 (socket says 172.21.15.67:55910) 2024-01-17T23:01:03.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.851+0000 7f7882a00640 1 -- 172.21.15.67:0/658009233 learned_addr learned my addr 172.21.15.67:0/658009233 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:03.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.863+0000 7f7882a00640 1 -- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787c0c2a00 msgr2=0x7f787c14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.863+0000 7f7882a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787c0c2a00 0x7f787c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.863+0000 7f7882a00640 1 -- 172.21.15.67:0/658009233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c06f1f0 msgr2=0x7f787c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.863+0000 7f7882a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c06f1f0 0x7f787c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:03.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.863+0000 7f7882a00640 1 -- 172.21.15.67:0/658009233 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640094d0 con 0x7f787c153bb0 2024-01-17T23:01:03.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.867+0000 7f7882a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f787400b970 tx=0x7f787400be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400cb40 con 0x7f787c153bb0 2024-01-17T23:01:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787400cca0 con 0x7f787c153bb0 2024-01-17T23:01:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c15b150 con 0x7f787c153bb0 2024-01-17T23:01:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1f3430 con 0x7f787c153bb0 2024-01-17T23:01:03.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874014680 con 0x7f787c153bb0 2024-01-17T23:01:03.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.879+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c067c90 con 0x7f787c153bb0 2024-01-17T23:01:03.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.907+0000 7fd596600640 1 Processor -- start 2024-01-17T23:01:03.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.907+0000 7fd596600640 1 -- start start 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd5901539a0 0x7fd5900ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5900c79c0 0x7fd590061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd59015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59006d570 con 0x7fd5900c79c0 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900c9890 con 0x7fd5901539a0 2024-01-17T23:01:03.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.911+0000 7fd596600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590159bf0 con 0x7fd590061640 2024-01-17T23:01:03.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.931+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1f5c007070 con 0x7f1f64151a90 2024-01-17T23:01:03.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.931+0000 7f1f5aa00640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 0x7f1f3c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.935+0000 7f1f62800640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 0x7f1f3c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.935+0000 7f1f62800640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 0x7f1f3c068d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f54001770 tx=0x7f1f54009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:03.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 Processor -- start 2024-01-17T23:01:03.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 -- start start 2024-01-17T23:01:03.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 0x7fc5c0061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:03.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c00c7d10 con 0x7fc5c0061640 2024-01-17T23:01:03.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c01576d0 con 0x7fc5c01517f0 2024-01-17T23:01:03.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.939+0000 7fc5c7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0157970 con 0x7fc5c015b620 2024-01-17T23:01:03.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.947+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f5c055250 con 0x7f1f64151a90 2024-01-17T23:01:03.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.947+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1f5c051590 con 0x7f1f64151a90 2024-01-17T23:01:03.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.983+0000 7f6fbd400640 1 --2- 172.21.15.67:0/1215265157 >> v2:172.21.15.67:3300/0 conn(0x7f6fc00c79c0 0x7f6fc0061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:03.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.991+0000 7f6fbd400640 1 -- 172.21.15.67:0/1215265157 >> v1:172.21.15.137:6789/0 conn(0x7f6fc0061640 legacy=0x7f6fc015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:03.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.991+0000 7f6fbd400640 1 -- 172.21.15.67:0/1215265157 >> v1:172.21.15.67:6789/0 conn(0x7f6fc01539a0 legacy=0x7f6fc00ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:03.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:03.991+0000 7f6fbd400640 1 -- 172.21.15.67:0/1215265157 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0159eb0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.027+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09f00746a0 con 0x7f09d00047d0 2024-01-17T23:01:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.043+0000 7fc5c5400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc5c0061640 0x7fc5c00c8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41524/0 (socket says 172.21.15.67:41524) 2024-01-17T23:01:04.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.043+0000 7fc5c5400640 1 -- 172.21.15.67:0/1815045824 learned_addr learned my addr 172.21.15.67:0/1815045824 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:04.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.047+0000 7fd58ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5900c79c0 0x7fd590061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.051+0000 7fd58ea00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd5900c79c0 0x7fd590061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60508/0 (socket says 172.21.15.67:60508) 2024-01-17T23:01:04.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.051+0000 7fd58ea00640 1 -- 172.21.15.67:0/255087280 learned_addr learned my addr 172.21.15.67:0/255087280 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.055+0000 7f6fbd400640 1 --2- 172.21.15.67:0/1215265157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc0061100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0159de0 tx=0x7f6fa801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2921052fcbc7d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.062 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-17T23:01:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.059+0000 7fd58ea00640 1 -- 172.21.15.67:0/255087280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 msgr2=0x7fd59015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.059+0000 7fd58ea00640 1 --2- 172.21.15.67:0/255087280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd59015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.059+0000 7fd58ea00640 1 -- 172.21.15.67:0/255087280 >> v2:172.21.15.137:3300/0 conn(0x7fd5901539a0 msgr2=0x7fd5900ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.059+0000 7fd58ea00640 1 --2- 172.21.15.67:0/255087280 >> v2:172.21.15.137:3300/0 conn(0x7fd5901539a0 0x7fd5900ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.059+0000 7fd58ea00640 1 -- 172.21.15.67:0/255087280 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590159eb0 con 0x7fd5900c79c0 2024-01-17T23:01:04.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.063+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819194894 0 0) 0x7fc5c00c7d10 con 0x7fc5c0061640 2024-01-17T23:01:04.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.063+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a0003530 con 0x7fc5c0061640 2024-01-17T23:01:04.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fbca00640 1 -- 172.21.15.67:0/1215265157 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80ac410 con 0x7f6fc00c79c0 2024-01-17T23:01:04.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fbca00640 1 -- 172.21.15.67:0/1215265157 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80ac570 con 0x7f6fc00c79c0 2024-01-17T23:01:04.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fbca00640 1 -- 172.21.15.67:0/1215265157 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80ac900 con 0x7f6fc00c79c0 2024-01-17T23:01:04.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1215265157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 msgr2=0x7f6fc0061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1215265157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc0061100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0159de0 tx=0x7f6fa801c3b0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1215265157 shutdown_connections 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1215265157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc0061100 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1215265157 >> 172.21.15.67:0/1215265157 conn(0x7f6fc006ad40 msgr2=0x7f6fc006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1215265157 shutdown_connections 2024-01-17T23:01:04.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.067+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1215265157 wait complete. 2024-01-17T23:01:04.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 Processor -- start 2024-01-17T23:01:04.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 -- start start 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fc0061640 0x7f6fc00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fc01539a0 0x7f6fc01f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc014df80 con 0x7f6fc00c79c0 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc014dce0 con 0x7f6fc01539a0 2024-01-17T23:01:04.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7f6fc4e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc014f2a0 con 0x7f6fc0061640 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992744756 0 0) 0x7fc5a0003530 con 0x7fc5c0061640 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 msgr2=0x7fc5c0061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 0x7fc5c0061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 >> v1:172.21.15.137:6789/0 conn(0x7fc5c01517f0 legacy=0x7fc5c00ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0157c50 con 0x7fc5c0061640 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fc5b8001a00 con 0x7fc5c0061640 2024-01-17T23:01:04.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 >> v1:172.21.15.67:6789/0 conn(0x7fc5c0061640 legacy=0x7fc5c00c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a00039b0 0x7fc5a0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00047d0 0x7fc5a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 0x7fc5a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0157970 con 0x7fc5a00039b0 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00054f0 con 0x7fc5a00047d0 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.071+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a000bed0 con 0x7fc5c015b620 2024-01-17T23:01:04.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.075+0000 7fd58ea00640 1 --2- 172.21.15.67:0/255087280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5900c79c0 0x7fd590061100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd590061cf0 tx=0x7fd57801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c963953e2c2b3cfc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7f6fbd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7f6fbd400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60512/0 (socket says 172.21.15.67:60512) 2024-01-17T23:01:04.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7f6fbd400640 1 -- 172.21.15.67:0/1518130799 learned_addr learned my addr 172.21.15.67:0/1518130799 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a00039b0 0x7fc5a0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7fd58e000640 1 -- 172.21.15.67:0/255087280 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780aa620 con 0x7fd5900c79c0 2024-01-17T23:01:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7fd58e000640 1 -- 172.21.15.67:0/255087280 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5780aa780 con 0x7fd5900c79c0 2024-01-17T23:01:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.083+0000 7fd58e000640 1 -- 172.21.15.67:0/255087280 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780aab10 con 0x7fd5900c79c0 2024-01-17T23:01:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- 172.21.15.67:0/255087280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5900c79c0 msgr2=0x7fd590061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 --2- 172.21.15.67:0/255087280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5900c79c0 0x7fd590061100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd590061cf0 tx=0x7fd57801c500 comp rx=0 tx=0).stop 2024-01-17T23:01:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- 172.21.15.67:0/255087280 shutdown_connections 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 --2- 172.21.15.67:0/255087280 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd59015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 --2- 172.21.15.67:0/255087280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5900c79c0 0x7fd590061100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 --2- 172.21.15.67:0/255087280 >> v2:172.21.15.137:3300/0 conn(0x7fd5901539a0 0x7fd5900ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- 172.21.15.67:0/255087280 >> 172.21.15.67:0/255087280 conn(0x7fd59006ad40 msgr2=0x7fd59006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- 172.21.15.67:0/255087280 shutdown_connections 2024-01-17T23:01:04.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- 172.21.15.67:0/255087280 wait complete. 2024-01-17T23:01:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 Processor -- start 2024-01-17T23:01:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.087+0000 7fd596600640 1 -- start start 2024-01-17T23:01:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7f6fbd400640 1 -- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fc0061640 msgr2=0x7f6fc00cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7f6fbd400640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fc0061640 0x7f6fc00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7f6fbd400640 1 -- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fc01539a0 msgr2=0x7f6fc01f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7f6fbd400640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fc01539a0 0x7f6fc01f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7f6fbd400640 1 -- 172.21.15.67:0/1518130799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa8009420 con 0x7f6fc00c79c0 2024-01-17T23:01:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd5900c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5900c79c0 0x7fd5901f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59014bc00 con 0x7fd5901539a0 2024-01-17T23:01:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c5dc0 con 0x7fd5900c79c0 2024-01-17T23:01:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.091+0000 7fd596600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c6b50 con 0x7fd590061640 2024-01-17T23:01:04.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.095+0000 7fc5c4a00640 1 -- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 msgr2=0x7fc5a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.095+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c015b620 0x7fc5a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.095+0000 7fc5c4a00640 1 -- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00047d0 msgr2=0x7fc5a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.095+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00047d0 0x7fc5a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.095+0000 7fc5c4a00640 1 -- 172.21.15.67:0/1815045824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0003530 con 0x7fc5a00039b0 2024-01-17T23:01:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.099+0000 7fd58fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.099+0000 7fd58fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60530/0 (socket says 172.21.15.67:60530) 2024-01-17T23:01:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.099+0000 7fd58fe00640 1 -- 172.21.15.67:0/1747579567 learned_addr learned my addr 172.21.15.67:0/1747579567 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.099+0000 7f6fbd400640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8018fc0 tx=0x7f6fa8019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.099+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a00039b0 0x7fc5a0003db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0001650 tx=0x7fc5b001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29115da4c1f0ec79 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.107+0000 7fd58fe00640 1 -- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 msgr2=0x7fd5900c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.107+0000 7fd58fe00640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd5900c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.107+0000 7fd58fe00640 1 -- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5900c79c0 msgr2=0x7fd5901f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.107+0000 7fd58fe00640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5900c79c0 0x7fd5901f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.107+0000 7fd58fe00640 1 -- 172.21.15.67:0/1747579567 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780094d0 con 0x7fd5901539a0 2024-01-17T23:01:04.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.115+0000 7fd58fe00640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b970 tx=0x7fd58800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80acea0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa80b5610 con 0x7f6fc00c79c0 2024-01-17T23:01:04.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa80b59c0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc01599c0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc014efc0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0005270 con 0x7fc5a00039b0 2024-01-17T23:01:04.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00a7070 con 0x7fc5a00039b0 2024-01-17T23:01:04.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5bf400640 1 -- 172.21.15.67:0/1815045824 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0003620 con 0x7fc5a00039b0 2024-01-17T23:01:04.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc006b620 con 0x7f6fc00c79c0 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 -- 172.21.15.67:0/1815045824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a00039b0 msgr2=0x7fc5a0003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 --2- 172.21.15.67:0/1815045824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a00039b0 0x7fc5a0003db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0001650 tx=0x7fc5b001c2e0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c5400640 1 -- 172.21.15.67:0/1815045824 reap_dead start 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 -- 172.21.15.67:0/1815045824 shutdown_connections 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 -- 172.21.15.67:0/1815045824 >> 172.21.15.67:0/1815045824 conn(0x7fc5c006ad40 msgr2=0x7fc5c006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 -- 172.21.15.67:0/1815045824 shutdown_connections 2024-01-17T23:01:04.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.119+0000 7fc5c7400640 1 -- 172.21.15.67:0/1815045824 wait complete. 2024-01-17T23:01:04.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 Processor -- start 2024-01-17T23:01:04.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 -- start start 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5c0158710 0x7fc5c006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c00c7460 0x7fc5c015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0159610 con 0x7fc5c0158710 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c01fabe0 con 0x7fc5a00039b0 2024-01-17T23:01:04.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.123+0000 7fc5c7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c0159e30 con 0x7fc5c00c7460 2024-01-17T23:01:04.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.135+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f640c1680 con 0x7f1f64151a90 2024-01-17T23:01:04.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.179+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7874003980 con 0x7f787c153bb0 2024-01-17T23:01:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd36c023480 con 0x7fd384153a80 2024-01-17T23:01:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7f787a000640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 0x7f7854068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7f7882000640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 0x7f7854068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7fd37b400640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 0x7fd35c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7fd382a00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 0x7fd35c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7f7882000640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 0x7f7854068d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786c009730 tx=0x7f786c006ca0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.183+0000 7fd382a00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 0x7fd35c068d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3740ad000 tx=0x7fd374004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.191+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd36c055cc0 con 0x7fd384153a80 2024-01-17T23:01:04.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.195+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7874055850 con 0x7f787c153bb0 2024-01-17T23:01:04.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.219+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd36c051900 con 0x7fd384153a80 2024-01-17T23:01:04.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.223+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7874051490 con 0x7f787c153bb0 2024-01-17T23:01:04.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 Processor -- start 2024-01-17T23:01:04.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 -- start start 2024-01-17T23:01:04.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16880c79c0 0x7f1688061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1688061640 0x7f168815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880c9890 con 0x7f16881539a0 2024-01-17T23:01:04.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168806d570 con 0x7f1688061640 2024-01-17T23:01:04.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.227+0000 7f168e000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1688159bf0 con 0x7f16880c79c0 2024-01-17T23:01:04.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.235+0000 7fc5c4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.235+0000 7fc5c4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58462/0 (socket says 172.21.15.67:58462) 2024-01-17T23:01:04.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.235+0000 7fc5c4a00640 1 -- 172.21.15.67:0/3931339484 learned_addr learned my addr 172.21.15.67:0/3931339484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7fc5c4a00640 1 -- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c00c7460 msgr2=0x7fc5c015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c00c7460 0x7fc5c015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7fc5c4a00640 1 -- 172.21.15.67:0/3931339484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5c0158710 msgr2=0x7fc5c006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5c0158710 0x7fc5c006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7fc5c4a00640 1 -- 172.21.15.67:0/3931339484 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c01fa680 con 0x7fc5a00039b0 2024-01-17T23:01:04.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.247+0000 7f1686a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16880c79c0 0x7f1688061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.251+0000 7fc5c4a00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000c10 tx=0x7fc5a0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.259+0000 7f1686a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16880c79c0 0x7f1688061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:58476/0 (socket says 172.21.15.67:58476) 2024-01-17T23:01:04.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.259+0000 7f1686a00640 1 -- 172.21.15.67:0/3975953804 learned_addr learned my addr 172.21.15.67:0/3975953804 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00b3070 con 0x7fc5a00039b0 2024-01-17T23:01:04.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b0003700 con 0x7fc5a00039b0 2024-01-17T23:01:04.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0003a70 con 0x7fc5a00039b0 2024-01-17T23:01:04.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c0159820 con 0x7fc5a00039b0 2024-01-17T23:01:04.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c0159ac0 con 0x7fc5a00039b0 2024-01-17T23:01:04.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.263+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c006b620 con 0x7fc5a00039b0 2024-01-17T23:01:04.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.275+0000 7f1686a00640 1 -- 172.21.15.67:0/3975953804 >> v2:172.21.15.67:3300/0 conn(0x7f1688061640 msgr2=0x7f168815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.275+0000 7f1686a00640 1 --2- 172.21.15.67:0/3975953804 >> v2:172.21.15.67:3300/0 conn(0x7f1688061640 0x7f168815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.275+0000 7f1686a00640 1 -- 172.21.15.67:0/3975953804 >> v1:172.21.15.67:6789/0 conn(0x7f16881539a0 legacy=0x7f16880ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:04.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.275+0000 7f1686a00640 1 -- 172.21.15.67:0/3975953804 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688159eb0 con 0x7f16880c79c0 2024-01-17T23:01:04.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.323+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc5b00a9020 con 0x7fc5a00039b0 2024-01-17T23:01:04.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.327+0000 7fc5bcc00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 0x7fc598068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.327+0000 7fc5bfe00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 0x7fc598068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.327+0000 7fc5bfe00640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 0x7fc598068d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0158b10 tx=0x7fc5a8006d20 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.331+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc5b00ee990 con 0x7fc5a00039b0 2024-01-17T23:01:04.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.335+0000 7f1686a00640 1 --2- 172.21.15.67:0/3975953804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16880c79c0 0x7f1688061100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16880c8150 tx=0x7f167001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27e97efe05b8640 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09e6000640 1 -- 172.21.15.67:0/3723066770 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09e0023020 con 0x7f09d00047d0 2024-01-17T23:01:04.352 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:04.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 msgr2=0x7f09c8068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 0x7f09c8068d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09f006ed50 tx=0x7f09d80011a0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 msgr2=0x7f09f01f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f09e0011900 tx=0x7f09e0011dc0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 shutdown_connections 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f09c80668c0 0x7f09c8068d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09f00cb260 0x7f09f0156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09f01f33e0 0x7f09f01efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 --2- 172.21.15.67:0/3723066770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f09d00047d0 0x7f09f01f0890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.347+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 >> 172.21.15.67:0/3723066770 conn(0x7f09f0072670 msgr2=0x7f09f00c2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.351+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 shutdown_connections 2024-01-17T23:01:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.351+0000 7f09f4c00640 1 -- 172.21.15.67:0/3723066770 wait complete. 2024-01-17T23:01:04.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.0 2024-01-17T23:01:04.384 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.403+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd38406b7c0 con 0x7fd384153a80 2024-01-17T23:01:04.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.407+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f787c0c9640 con 0x7f787c153bb0 2024-01-17T23:01:04.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.415+0000 7f787a000640 1 -- 172.21.15.67:0/658009233 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7874019020 con 0x7f787c153bb0 2024-01-17T23:01:04.422 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 msgr2=0x7f7854068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 0x7f7854068d50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786c009730 tx=0x7f786c006ca0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 msgr2=0x7f787c0c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f787400b970 tx=0x7f787400be30 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 shutdown_connections 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7854066890 0x7f7854068d50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f787c153bb0 0x7f787c0c9f10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f787c0c2a00 0x7f787c14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 --2- 172.21.15.67:0/658009233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f787c06f1f0 0x7f787c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 >> 172.21.15.67:0/658009233 conn(0x7f787c06fc50 msgr2=0x7f787c0cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 shutdown_connections 2024-01-17T23:01:04.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f7884a00640 1 -- 172.21.15.67:0/658009233 wait complete. 2024-01-17T23:01:04.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6fa80b3040 con 0x7f6fc00c79c0 2024-01-17T23:01:04.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f6fb6000640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 0x7f6f98068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.419+0000 7f6fbde00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 0x7f6f98068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.423+0000 7f6fbde00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 0x7f6f98068d50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009650 tx=0x7f6fb0006bb0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.439+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fa80eff80 con 0x7f6fc00c79c0 2024-01-17T23:01:04.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.439+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6fa80ebbc0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800cb40 con 0x7fd5901539a0 2024-01-17T23:01:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800ccc0 con 0x7fd5901539a0 2024-01-17T23:01:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588014680 con 0x7fd5901539a0 2024-01-17T23:01:04.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900b2470 con 0x7fd5901539a0 2024-01-17T23:01:04.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900c4790 con 0x7fd5901539a0 2024-01-17T23:01:04.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.5 2024-01-17T23:01:04.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.443+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59006b620 con 0x7fd5901539a0 2024-01-17T23:01:04.452 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.455+0000 7f1f5aa00640 1 -- 172.21.15.67:0/1323554719 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f640c1680 con 0x7f1f64151a90 2024-01-17T23:01:04.462 INFO:teuthology.orchestra.run.smithi067.stdout:64424509458 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.455+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 msgr2=0x7f1f3c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 0x7f1f3c068d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f54001770 tx=0x7f1f54009040 comp rx=0 tx=0).stop 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 msgr2=0x7f1f64158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00caa0 tx=0x7f1f5c00cf60 comp rx=0 tx=0).stop 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 shutdown_connections 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f3c0668c0 0x7f1f3c068d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f64151a90 0x7f1f64158760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1f640c9650 0x7f1f640c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 --2- 172.21.15.67:0/1323554719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f640c8970 0x7f1f640cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 >> 172.21.15.67:0/1323554719 conn(0x7f1f6406fc50 msgr2=0x7f1f641552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 shutdown_connections 2024-01-17T23:01:04.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.459+0000 7f1f69400640 1 -- 172.21.15.67:0/1323554719 wait complete. 2024-01-17T23:01:04.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509458 for osd.3 2024-01-17T23:01:04.486 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.607+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6fc0159810 con 0x7f6fc00c79c0 2024-01-17T23:01:04.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.715+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc5b00ee060 con 0x7fc5a00039b0 2024-01-17T23:01:04.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.719+0000 7fd37b400640 1 -- 172.21.15.67:0/3224776252 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd36c01e090 con 0x7fd384153a80 2024-01-17T23:01:04.727 INFO:teuthology.orchestra.run.smithi067.stdout:60129542164 2024-01-17T23:01:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f1686000640 1 -- 172.21.15.67:0/3975953804 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700a7070 con 0x7f16880c79c0 2024-01-17T23:01:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f1686000640 1 -- 172.21.15.67:0/3975953804 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16700ab430 con 0x7f16880c79c0 2024-01-17T23:01:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f1686000640 1 -- 172.21.15.67:0/3975953804 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700ab7c0 con 0x7f16880c79c0 2024-01-17T23:01:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- 172.21.15.67:0/3975953804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16880c79c0 msgr2=0x7f1688061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 --2- 172.21.15.67:0/3975953804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16880c79c0 0x7f1688061100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16880c8150 tx=0x7f167001c430 comp rx=0 tx=0).stop 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- 172.21.15.67:0/3975953804 shutdown_connections 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 --2- 172.21.15.67:0/3975953804 >> v2:172.21.15.67:3300/0 conn(0x7f1688061640 0x7f168815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 --2- 172.21.15.67:0/3975953804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16880c79c0 0x7f1688061100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- 172.21.15.67:0/3975953804 >> 172.21.15.67:0/3975953804 conn(0x7f168806ad40 msgr2=0x7f168806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- 172.21.15.67:0/3975953804 shutdown_connections 2024-01-17T23:01:04.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- 172.21.15.67:0/3975953804 wait complete. 2024-01-17T23:01:04.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 msgr2=0x7fd35c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 0x7fd35c068d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3740ad000 tx=0x7fd374004740 comp rx=0 tx=0).stop 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 msgr2=0x7fd3840caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b480 tx=0x7fd36c00b940 comp rx=0 tx=0).stop 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 Processor -- start 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 shutdown_connections 2024-01-17T23:01:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd35c0668c0 0x7fd35c068d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd38415a310 0x7fd3840c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd384153a80 0x7fd3840caca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 --2- 172.21.15.67:0/3224776252 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd38406ba50 0x7fd3841405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 >> 172.21.15.67:0/3224776252 conn(0x7fd38406fba0 msgr2=0x7fd384150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7f168e000640 1 -- start start 2024-01-17T23:01:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 shutdown_connections 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.723+0000 7fd389e00640 1 -- 172.21.15.67:0/3224776252 wait complete. 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1688061640 0x7f16881ec140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16881539a0 0x7f1688150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688151230 con 0x7f1688061640 2024-01-17T23:01:04.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16881eb6f0 con 0x7f16881539a0 2024-01-17T23:01:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f168e000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16881f2e80 con 0x7f16880c79c0 2024-01-17T23:01:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f1686a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f1686a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55974/0 (socket says 172.21.15.67:55974) 2024-01-17T23:01:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.727+0000 7f1686a00640 1 -- 172.21.15.67:0/3945296878 learned_addr learned my addr 172.21.15.67:0/3945296878 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:04.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fd58801d3b0 con 0x7fd5901539a0 2024-01-17T23:01:04.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7f1686a00640 1 -- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16881539a0 msgr2=0x7f1688150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7f1686a00640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16881539a0 0x7f1688150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7f1686a00640 1 -- 172.21.15.67:0/3945296878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1688061640 msgr2=0x7f16881ec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7f1686a00640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1688061640 0x7f16881ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7f1686a00640 1 -- 172.21.15.67:0/3945296878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700094d0 con 0x7f16880c79c0 2024-01-17T23:01:04.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7fd587400640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 0x7fd568068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7fd58f400640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 0x7fd568068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.739+0000 7fd58f400640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 0x7fd568068d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd580009690 tx=0x7fd580006c00 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.743+0000 7f1686a00640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f167001aae0 tx=0x7f16700191d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542164 for osd.4 2024-01-17T23:01:04.752 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.751+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd58800ce30 con 0x7fd5901539a0 2024-01-17T23:01:04.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.751+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fd5880551e0 con 0x7fd5901539a0 2024-01-17T23:01:04.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700b4830 con 0x7f16880c79c0 2024-01-17T23:01:04.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16700b49b0 con 0x7f16880c79c0 2024-01-17T23:01:04.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1688158410 con 0x7f16880c79c0 2024-01-17T23:01:04.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16700b4d60 con 0x7f16880c79c0 2024-01-17T23:01:04.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16881589d0 con 0x7f16880c79c0 2024-01-17T23:01:04.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.755+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168806b620 con 0x7f16880c79c0 2024-01-17T23:01:04.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fb6000640 1 -- 172.21.15.67:0/1518130799 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fa80ef1e0 con 0x7f6fc00c79c0 2024-01-17T23:01:04.776 INFO:teuthology.orchestra.run.smithi067.stdout:64424509457 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 msgr2=0x7f6f98068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 0x7f6f98068d50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009650 tx=0x7f6fb0006bb0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 msgr2=0x7f6fc00caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8018fc0 tx=0x7f6fa8019150 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 shutdown_connections 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f98066890 0x7f6f98068d50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6fc01539a0 0x7f6fc01f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6fc00c79c0 0x7f6fc00caec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 --2- 172.21.15.67:0/1518130799 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6fc0061640 0x7f6fc00cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 >> 172.21.15.67:0/1518130799 conn(0x7f6fc006ad40 msgr2=0x7f6fc006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 shutdown_connections 2024-01-17T23:01:04.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.771+0000 7f6fc4e00640 1 -- 172.21.15.67:0/1518130799 wait complete. 2024-01-17T23:01:04.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509457 got 64424509457 for osd.7 2024-01-17T23:01:04.801 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.803+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f16700c7430 con 0x7f16880c79c0 2024-01-17T23:01:04.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.807+0000 7f167f400640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 0x7f1660068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:04.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.807+0000 7f1687400640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 0x7f1660068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:04.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.807+0000 7f1687400640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 0x7f1660068d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1678009650 tx=0x7f1678006bb0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:04.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.891+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5c00746a0 con 0x7fc5a00039b0 2024-01-17T23:01:04.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.899+0000 7fc5bcc00640 1 -- 172.21.15.67:0/3931339484 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5b00bc030 con 0x7fc5a00039b0 2024-01-17T23:01:04.906 INFO:teuthology.orchestra.run.smithi067.stdout:64424509461 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 msgr2=0x7fc598068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 0x7fc598068d50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0158b10 tx=0x7fc5a8006d20 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 msgr2=0x7fc5c015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000c10 tx=0x7fc5a0005800 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 shutdown_connections 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc598066890 0x7fc598068d50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc5c00c7460 0x7fc5c015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5c0158710 0x7fc5c006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 --2- 172.21.15.67:0/3931339484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a00039b0 0x7fc5c015a2c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 >> 172.21.15.67:0/3931339484 conn(0x7fc5c006ad40 msgr2=0x7fc5c014f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 shutdown_connections 2024-01-17T23:01:04.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.903+0000 7fc5c7400640 1 -- 172.21.15.67:0/3931339484 wait complete. 2024-01-17T23:01:04.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509461 for osd.1 2024-01-17T23:01:04.930 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:04.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.927+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5900746a0 con 0x7fd5901539a0 2024-01-17T23:01:04.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd587400640 1 -- 172.21.15.67:0/1747579567 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd588019020 con 0x7fd5901539a0 2024-01-17T23:01:04.940 INFO:teuthology.orchestra.run.smithi067.stdout:60129542163 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 msgr2=0x7fd568068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 0x7fd568068d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd580009690 tx=0x7fd580006c00 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 msgr2=0x7fd5901f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b970 tx=0x7fd58800be30 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 shutdown_connections 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fd568066890 0x7fd568068d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd5901539a0 0x7fd5901f5d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5900c79c0 0x7fd5901f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 --2- 172.21.15.67:0/1747579567 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fd590061640 0x7fd5900c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 >> 172.21.15.67:0/1747579567 conn(0x7fd59006ad40 msgr2=0x7fd59014cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:04.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 shutdown_connections 2024-01-17T23:01:04.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:04.935+0000 7fd596600640 1 -- 172.21.15.67:0/1747579567 wait complete. 2024-01-17T23:01:04.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542163 for osd.2 2024-01-17T23:01:04.963 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:05.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.107+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16700effb0 con 0x7f16880c79c0 2024-01-17T23:01:05.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.147+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f16700ebbf0 con 0x7f16880c79c0 2024-01-17T23:01:05.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:05.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:05.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.307+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16880746a0 con 0x7f16880c79c0 2024-01-17T23:01:05.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.375+0000 7f167f400640 1 -- 172.21.15.67:0/3945296878 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16700b9090 con 0x7f16880c79c0 2024-01-17T23:01:05.383 INFO:teuthology.orchestra.run.smithi067.stdout:64424509459 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 msgr2=0x7f1660068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 0x7f1660068d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1678009650 tx=0x7f1678006bb0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 msgr2=0x7f16881505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f167001aae0 tx=0x7f16700191d0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 shutdown_connections 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1660066890 0x7f1660068d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16881539a0 0x7f1688150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f16880c79c0 0x7f16881505f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 --2- 172.21.15.67:0/3945296878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1688061640 0x7f16881ec140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 >> 172.21.15.67:0/3945296878 conn(0x7f168806ad40 msgr2=0x7f168806b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:05.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 shutdown_connections 2024-01-17T23:01:05.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.379+0000 7f168e000640 1 -- 172.21.15.67:0/3945296878 wait complete. 2024-01-17T23:01:05.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509458 got 64424509459 for osd.6 2024-01-17T23:01:05.408 DEBUG:teuthology.parallel:result is None 2024-01-17T23:01:05.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-17T23:01:05.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T23:01:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 Processor -- start 2024-01-17T23:01:05.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 -- start start 2024-01-17T23:01:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2f6c0c8970 0x7f2f6c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c0c7910 con 0x7f2f6c0c9650 2024-01-17T23:01:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c15b5d0 con 0x7f2f6c0c8970 2024-01-17T23:01:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f74200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c9340 con 0x7f2f6c151a90 2024-01-17T23:01:05.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f71800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f71800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55982/0 (socket says 172.21.15.67:55982) 2024-01-17T23:01:05.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.547+0000 7f2f71800640 1 -- 172.21.15.67:0/3653860451 learned_addr learned my addr 172.21.15.67:0/3653860451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:05.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.551+0000 7f2f72200640 1 --2- 172.21.15.67:0/3653860451 >> v2:172.21.15.137:3300/0 conn(0x7f2f6c0c8970 0x7f2f6c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.555+0000 7f2f71800640 1 -- 172.21.15.67:0/3653860451 >> v2:172.21.15.137:3300/0 conn(0x7f2f6c0c8970 msgr2=0x7f2f6c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:05.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.555+0000 7f2f71800640 1 --2- 172.21.15.67:0/3653860451 >> v2:172.21.15.137:3300/0 conn(0x7f2f6c0c8970 0x7f2f6c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.555+0000 7f2f71800640 1 -- 172.21.15.67:0/3653860451 >> v1:172.21.15.137:6789/0 conn(0x7f2f6c0c9650 legacy=0x7f2f6c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.555+0000 7f2f71800640 1 -- 172.21.15.67:0/3653860451 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c158530 con 0x7f2f6c151a90 2024-01-17T23:01:05.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.559+0000 7f2f71800640 1 --2- 172.21.15.67:0/3653860451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009870 tx=0x7f2f5c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8912d264c11c96b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:05.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.567+0000 7f2f6be00640 1 -- 172.21.15.67:0/3653860451 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0a8a30 con 0x7f2f6c151a90 2024-01-17T23:01:05.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.567+0000 7f2f6be00640 1 -- 172.21.15.67:0/3653860451 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0a8b90 con 0x7f2f6c151a90 2024-01-17T23:01:05.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.567+0000 7f2f6be00640 1 -- 172.21.15.67:0/3653860451 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0b0440 con 0x7f2f6c151a90 2024-01-17T23:01:05.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- 172.21.15.67:0/3653860451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 msgr2=0x7f2f6c157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- 172.21.15.67:0/3653860451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009870 tx=0x7f2f5c01ed30 comp rx=0 tx=0).stop 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- 172.21.15.67:0/3653860451 shutdown_connections 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- 172.21.15.67:0/3653860451 >> v2:172.21.15.137:3300/0 conn(0x7f2f6c0c8970 0x7f2f6c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- 172.21.15.67:0/3653860451 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c151a90 0x7f2f6c157ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- 172.21.15.67:0/3653860451 >> 172.21.15.67:0/3653860451 conn(0x7f2f6c06fc50 msgr2=0x7f2f6c070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- 172.21.15.67:0/3653860451 shutdown_connections 2024-01-17T23:01:05.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- 172.21.15.67:0/3653860451 wait complete. 2024-01-17T23:01:05.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 Processor -- start 2024-01-17T23:01:05.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- start start 2024-01-17T23:01:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c0c8970 0x7f2f6c142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f6c0c9650 0x7f2f6c1e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c143210 con 0x7f2f6c151a90 2024-01-17T23:01:05.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0caf90 con 0x7f2f6c0c9650 2024-01-17T23:01:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.571+0000 7f2f74200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c1e0700 con 0x7f2f6c0c8970 2024-01-17T23:01:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.575+0000 7f2f72200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.575+0000 7f2f72200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60564/0 (socket says 172.21.15.67:60564) 2024-01-17T23:01:05.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.575+0000 7f2f72200640 1 -- 172.21.15.67:0/3239292457 learned_addr learned my addr 172.21.15.67:0/3239292457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:05.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.575+0000 7f2f70e00640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f6c0c9650 0x7f2f6c1e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.575+0000 7f2f71800640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c0c8970 0x7f2f6c142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 -- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c0c8970 msgr2=0x7f2f6c142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c0c8970 0x7f2f6c142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 -- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f6c0c9650 msgr2=0x7f2f6c1e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f6c0c9650 0x7f2f6c1e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:05.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 -- 172.21.15.67:0/3239292457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0094d0 con 0x7f2f6c151a90 2024-01-17T23:01:05.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.579+0000 7f2f72200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400efc0 tx=0x7f2f6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:05.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64009ba0 con 0x7f2f6c151a90 2024-01-17T23:01:05.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c1e55e0 con 0x7f2f6c151a90 2024-01-17T23:01:05.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c1e0c30 con 0x7f2f6c151a90 2024-01-17T23:01:05.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400f040 con 0x7f2f6c151a90 2024-01-17T23:01:05.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64014680 con 0x7f2f6c151a90 2024-01-17T23:01:05.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.583+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c0052a0 con 0x7f2f6c151a90 2024-01-17T23:01:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.603+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2f640147e0 con 0x7f2f6c151a90 2024-01-17T23:01:05.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.607+0000 7f2f69600640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 0x7f2f44068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:05.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.607+0000 7f2f71800640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 0x7f2f44068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:05.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.607+0000 7f2f71800640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 0x7f2f44068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0b2000 tx=0x7f2f5c0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:05.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.607+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f64056530 con 0x7f2f6c151a90 2024-01-17T23:01:05.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:05.855+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2f64052870 con 0x7f2f6c151a90 2024-01-17T23:01:06.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.031+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f3c000bd0 con 0x7f2f44066840 2024-01-17T23:01:06.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.055+0000 7f2f69600640 1 -- 172.21.15.67:0/3239292457 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368727 (secure 0 0 0) 0x7f2f3c000bd0 con 0x7f2f44066840 2024-01-17T23:01:06.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:06.069 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-17T23:01:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.059+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 msgr2=0x7f2f44068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.059+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 0x7f2f44068d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0b2000 tx=0x7f2f5c0aa070 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 msgr2=0x7f2f6c0c1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400efc0 tx=0x7f2f6400c490 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 shutdown_connections 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2f44066840 0x7f2f44068d00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f6c151a90 0x7f2f6c0c1030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f6c0c9650 0x7f2f6c1e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 --2- 172.21.15.67:0/3239292457 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2f6c0c8970 0x7f2f6c142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 >> 172.21.15.67:0/3239292457 conn(0x7f2f6c06fc50 msgr2=0x7f2f6c070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 shutdown_connections 2024-01-17T23:01:06.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.063+0000 7f2f74200640 1 -- 172.21.15.67:0/3239292457 wait complete. 2024-01-17T23:01:06.089 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-01-17T23:01:05.939435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218816,"kb_used_data":2688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2752512,"data_stored":2203486,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005766"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248181+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-17T23:00:57.248181+0000","last_peered":"2024-01-17T23:00:57.248181+0000","last_clean":"2024-01-17T23:00:57.248181+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-17T23:00:57.248181+0000","last_undegraded":"2024-01-17T23:00:57.248181+0000","last_fullsized":"2024-01-17T23:00:57.248181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077894+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.077894+0000","last_peered":"2024-01-17T23:00:33.077894+0000","last_clean":"2024-01-17T23:00:33.077894+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-17T23:00:33.077894+0000","last_undegraded":"2024-01-17T23:00:33.077894+0000","last_fullsized":"2024-01-17T23:00:33.077894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075877+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-17T23:00:33.075877+0000","last_peered":"2024-01-17T23:00:33.075877+0000","last_clean":"2024-01-17T23:00:33.075877+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-17T23:00:33.075877+0000","last_undegraded":"2024-01-17T23:00:33.075877+0000","last_fullsized":"2024-01-17T23:00:33.075877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.195982+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-17T23:00:34.195982+0000","last_peered":"2024-01-17T23:00:34.195982+0000","last_clean":"2024-01-17T23:00:34.195982+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-17T23:00:34.195982+0000","last_undegraded":"2024-01-17T23:00:34.195982+0000","last_fullsized":"2024-01-17T23:00:34.195982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079362+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-17T23:00:33.079362+0000","last_peered":"2024-01-17T23:00:33.079362+0000","last_clean":"2024-01-17T23:00:33.079362+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-17T23:00:33.079362+0000","last_undegraded":"2024-01-17T23:00:33.079362+0000","last_fullsized":"2024-01-17T23:00:33.079362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093022+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-17T23:00:33.093022+0000","last_peered":"2024-01-17T23:00:33.093022+0000","last_clean":"2024-01-17T23:00:33.093022+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-17T23:00:33.093022+0000","last_undegraded":"2024-01-17T23:00:33.093022+0000","last_fullsized":"2024-01-17T23:00:33.093022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.131311+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-17T23:00:57.131311+0000","last_peered":"2024-01-17T23:00:57.131311+0000","last_clean":"2024-01-17T23:00:57.131311+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-17T23:00:57.131311+0000","last_undegraded":"2024-01-17T23:00:57.131311+0000","last_fullsized":"2024-01-17T23:00:57.131311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080814+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-17T23:00:33.080814+0000","last_peered":"2024-01-17T23:00:33.080814+0000","last_clean":"2024-01-17T23:00:33.080814+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-17T23:00:33.080814+0000","last_undegraded":"2024-01-17T23:00:33.080814+0000","last_fullsized":"2024-01-17T23:00:33.080814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093362+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-17T23:00:33.093362+0000","last_peered":"2024-01-17T23:00:33.093362+0000","last_clean":"2024-01-17T23:00:33.093362+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-17T23:00:33.093362+0000","last_undegraded":"2024-01-17T23:00:33.093362+0000","last_fullsized":"2024-01-17T23:00:33.093362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089926+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-17T23:00:33.089926+0000","last_peered":"2024-01-17T23:00:33.089926+0000","last_clean":"2024-01-17T23:00:33.089926+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-17T23:00:33.089926+0000","last_undegraded":"2024-01-17T23:00:33.089926+0000","last_fullsized":"2024-01-17T23:00:33.089926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080653+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-17T23:00:33.080653+0000","last_peered":"2024-01-17T23:00:33.080653+0000","last_clean":"2024-01-17T23:00:33.080653+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-17T23:00:33.080653+0000","last_undegraded":"2024-01-17T23:00:33.080653+0000","last_fullsized":"2024-01-17T23:00:33.080653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092397+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-17T23:00:33.092397+0000","last_peered":"2024-01-17T23:00:33.092397+0000","last_clean":"2024-01-17T23:00:33.092397+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-17T23:00:33.092397+0000","last_undegraded":"2024-01-17T23:00:33.092397+0000","last_fullsized":"2024-01-17T23:00:33.092397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082880+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-17T23:00:33.082880+0000","last_peered":"2024-01-17T23:00:33.082880+0000","last_clean":"2024-01-17T23:00:33.082880+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-17T23:00:33.082880+0000","last_undegraded":"2024-01-17T23:00:33.082880+0000","last_fullsized":"2024-01-17T23:00:33.082880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843181+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-17T23:00:54.843181+0000","last_peered":"2024-01-17T23:00:54.843181+0000","last_clean":"2024-01-17T23:00:54.843181+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-17T23:00:54.843181+0000","last_undegraded":"2024-01-17T23:00:54.843181+0000","last_fullsized":"2024-01-17T23:00:54.843181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095174+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-17T23:00:33.095174+0000","last_peered":"2024-01-17T23:00:33.095174+0000","last_clean":"2024-01-17T23:00:33.095174+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-17T23:00:33.095174+0000","last_undegraded":"2024-01-17T23:00:33.095174+0000","last_fullsized":"2024-01-17T23:00:33.095174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076603+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-17T23:00:33.076603+0000","last_peered":"2024-01-17T23:00:33.076603+0000","last_clean":"2024-01-17T23:00:33.076603+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-17T23:00:33.076603+0000","last_undegraded":"2024-01-17T23:00:33.076603+0000","last_fullsized":"2024-01-17T23:00:33.076603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.114735+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-17T23:00:34.114735+0000","last_peered":"2024-01-17T23:00:34.114735+0000","last_clean":"2024-01-17T23:00:34.114735+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-17T23:00:34.114735+0000","last_undegraded":"2024-01-17T23:00:34.114735+0000","last_fullsized":"2024-01-17T23:00:34.114735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093356+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-17T23:00:33.093356+0000","last_peered":"2024-01-17T23:00:33.093356+0000","last_clean":"2024-01-17T23:00:33.093356+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-17T23:00:33.093356+0000","last_undegraded":"2024-01-17T23:00:33.093356+0000","last_fullsized":"2024-01-17T23:00:33.093356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075816+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-17T23:00:33.075816+0000","last_peered":"2024-01-17T23:00:33.075816+0000","last_clean":"2024-01-17T23:00:33.075816+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-17T23:00:33.075816+0000","last_undegraded":"2024-01-17T23:00:33.075816+0000","last_fullsized":"2024-01-17T23:00:33.075816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843510+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-17T23:00:54.843510+0000","last_peered":"2024-01-17T23:00:54.843510+0000","last_clean":"2024-01-17T23:00:54.843510+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-17T23:00:54.843510+0000","last_undegraded":"2024-01-17T23:00:54.843510+0000","last_fullsized":"2024-01-17T23:00:54.843510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077169+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-17T23:00:33.077169+0000","last_peered":"2024-01-17T23:00:33.077169+0000","last_clean":"2024-01-17T23:00:33.077169+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-17T23:00:33.077169+0000","last_undegraded":"2024-01-17T23:00:33.077169+0000","last_fullsized":"2024-01-17T23:00:33.077169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092641+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-17T23:00:33.092641+0000","last_peered":"2024-01-17T23:00:33.092641+0000","last_clean":"2024-01-17T23:00:33.092641+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-17T23:00:33.092641+0000","last_undegraded":"2024-01-17T23:00:33.092641+0000","last_fullsized":"2024-01-17T23:00:33.092641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843369+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-17T23:00:54.843369+0000","last_peered":"2024-01-17T23:00:54.843369+0000","last_clean":"2024-01-17T23:00:54.843369+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-17T23:00:54.843369+0000","last_undegraded":"2024-01-17T23:00:54.843369+0000","last_fullsized":"2024-01-17T23:00:54.843369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095681+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-17T23:00:33.095681+0000","last_peered":"2024-01-17T23:00:33.095681+0000","last_clean":"2024-01-17T23:00:33.095681+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-17T23:00:33.095681+0000","last_undegraded":"2024-01-17T23:00:33.095681+0000","last_fullsized":"2024-01-17T23:00:33.095681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079343+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-17T23:00:33.079343+0000","last_peered":"2024-01-17T23:00:33.079343+0000","last_clean":"2024-01-17T23:00:33.079343+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-17T23:00:33.079343+0000","last_undegraded":"2024-01-17T23:00:33.079343+0000","last_fullsized":"2024-01-17T23:00:33.079343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858140+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-17T23:00:54.858140+0000","last_peered":"2024-01-17T23:00:54.858140+0000","last_clean":"2024-01-17T23:00:54.858140+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-17T23:00:54.858140+0000","last_undegraded":"2024-01-17T23:00:54.858140+0000","last_fullsized":"2024-01-17T23:00:54.858140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092000+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-17T23:00:33.092000+0000","last_peered":"2024-01-17T23:00:33.092000+0000","last_clean":"2024-01-17T23:00:33.092000+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-17T23:00:33.092000+0000","last_undegraded":"2024-01-17T23:00:33.092000+0000","last_fullsized":"2024-01-17T23:00:33.092000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076680+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-17T23:00:33.076680+0000","last_peered":"2024-01-17T23:00:33.076680+0000","last_clean":"2024-01-17T23:00:33.076680+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-17T23:00:33.076680+0000","last_undegraded":"2024-01-17T23:00:33.076680+0000","last_fullsized":"2024-01-17T23:00:33.076680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.212080+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-17T23:00:57.212080+0000","last_peered":"2024-01-17T23:00:57.212080+0000","last_clean":"2024-01-17T23:00:57.212080+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-17T23:00:57.212080+0000","last_undegraded":"2024-01-17T23:00:57.212080+0000","last_fullsized":"2024-01-17T23:00:57.212080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075915+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-17T23:00:33.075915+0000","last_peered":"2024-01-17T23:00:33.075915+0000","last_clean":"2024-01-17T23:00:33.075915+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-17T23:00:33.075915+0000","last_undegraded":"2024-01-17T23:00:33.075915+0000","last_fullsized":"2024-01-17T23:00:33.075915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079329+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-17T23:00:33.079329+0000","last_peered":"2024-01-17T23:00:33.079329+0000","last_clean":"2024-01-17T23:00:33.079329+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-17T23:00:33.079329+0000","last_undegraded":"2024-01-17T23:00:33.079329+0000","last_fullsized":"2024-01-17T23:00:33.079329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:35.281250+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-17T23:00:35.281250+0000","last_peered":"2024-01-17T23:00:35.281250+0000","last_clean":"2024-01-17T23:00:35.281250+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-17T23:00:35.281250+0000","last_undegraded":"2024-01-17T23:00:35.281250+0000","last_fullsized":"2024-01-17T23:00:35.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078545+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-17T23:00:33.078545+0000","last_peered":"2024-01-17T23:00:33.078545+0000","last_clean":"2024-01-17T23:00:33.078545+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-17T23:00:33.078545+0000","last_undegraded":"2024-01-17T23:00:33.078545+0000","last_fullsized":"2024-01-17T23:00:33.078545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080738+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-17T23:00:33.080738+0000","last_peered":"2024-01-17T23:00:33.080738+0000","last_clean":"2024-01-17T23:00:33.080738+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-17T23:00:33.080738+0000","last_undegraded":"2024-01-17T23:00:33.080738+0000","last_fullsized":"2024-01-17T23:00:33.080738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079407+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-17T23:00:33.079407+0000","last_peered":"2024-01-17T23:00:33.079407+0000","last_clean":"2024-01-17T23:00:33.079407+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-17T23:00:33.079407+0000","last_undegraded":"2024-01-17T23:00:33.079407+0000","last_fullsized":"2024-01-17T23:00:33.079407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080349+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-17T23:00:33.080349+0000","last_peered":"2024-01-17T23:00:33.080349+0000","last_clean":"2024-01-17T23:00:33.080349+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-17T23:00:33.080349+0000","last_undegraded":"2024-01-17T23:00:33.080349+0000","last_fullsized":"2024-01-17T23:00:33.080349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-17T23:00:33.093635+0000","last_peered":"2024-01-17T23:00:33.093635+0000","last_clean":"2024-01-17T23:00:33.093635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-17T23:00:33.093635+0000","last_undegraded":"2024-01-17T23:00:33.093635+0000","last_fullsized":"2024-01-17T23:00:33.093635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.121860+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-17T23:00:34.121860+0000","last_peered":"2024-01-17T23:00:34.121860+0000","last_clean":"2024-01-17T23:00:34.121860+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-17T23:00:34.121860+0000","last_undegraded":"2024-01-17T23:00:34.121860+0000","last_fullsized":"2024-01-17T23:00:34.121860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076437+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-17T23:00:33.076437+0000","last_peered":"2024-01-17T23:00:33.076437+0000","last_clean":"2024-01-17T23:00:33.076437+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-17T23:00:33.076437+0000","last_undegraded":"2024-01-17T23:00:33.076437+0000","last_fullsized":"2024-01-17T23:00:33.076437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.243579+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-17T23:00:57.243579+0000","last_peered":"2024-01-17T23:00:57.243579+0000","last_clean":"2024-01-17T23:00:57.243579+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:57.243579+0000","last_undegraded":"2024-01-17T23:00:57.243579+0000","last_fullsized":"2024-01-17T23:00:57.243579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.129939+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-17T23:00:57.129939+0000","last_peered":"2024-01-17T23:00:57.129939+0000","last_clean":"2024-01-17T23:00:57.129939+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-17T23:00:57.129939+0000","last_undegraded":"2024-01-17T23:00:57.129939+0000","last_fullsized":"2024-01-17T23:00:57.129939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079933+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-17T23:00:33.079933+0000","last_peered":"2024-01-17T23:00:33.079933+0000","last_clean":"2024-01-17T23:00:33.079933+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-17T23:00:33.079933+0000","last_undegraded":"2024-01-17T23:00:33.079933+0000","last_fullsized":"2024-01-17T23:00:33.079933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076809+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-17T23:00:33.076809+0000","last_peered":"2024-01-17T23:00:33.076809+0000","last_clean":"2024-01-17T23:00:33.076809+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-17T23:00:33.076809+0000","last_undegraded":"2024-01-17T23:00:33.076809+0000","last_fullsized":"2024-01-17T23:00:33.076809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.653004+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-17T23:00:54.653004+0000","last_peered":"2024-01-17T23:00:54.653004+0000","last_clean":"2024-01-17T23:00:54.653004+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-17T23:00:54.653004+0000","last_undegraded":"2024-01-17T23:00:54.653004+0000","last_fullsized":"2024-01-17T23:00:54.653004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089167+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-17T23:00:33.089167+0000","last_peered":"2024-01-17T23:00:33.089167+0000","last_clean":"2024-01-17T23:00:33.089167+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-17T23:00:33.089167+0000","last_undegraded":"2024-01-17T23:00:33.089167+0000","last_fullsized":"2024-01-17T23:00:33.089167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085186+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-17T23:00:33.085186+0000","last_peered":"2024-01-17T23:00:33.085186+0000","last_clean":"2024-01-17T23:00:33.085186+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-17T23:00:33.085186+0000","last_undegraded":"2024-01-17T23:00:33.085186+0000","last_fullsized":"2024-01-17T23:00:33.085186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091113+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-17T23:00:33.091113+0000","last_peered":"2024-01-17T23:00:33.091113+0000","last_clean":"2024-01-17T23:00:33.091113+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-17T23:00:33.091113+0000","last_undegraded":"2024-01-17T23:00:33.091113+0000","last_fullsized":"2024-01-17T23:00:33.091113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.245839+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-17T23:00:57.245839+0000","last_peered":"2024-01-17T23:00:57.245839+0000","last_clean":"2024-01-17T23:00:57.245839+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-17T23:00:57.245839+0000","last_undegraded":"2024-01-17T23:00:57.245839+0000","last_fullsized":"2024-01-17T23:00:57.245839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082790+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-17T23:00:33.082790+0000","last_peered":"2024-01-17T23:00:33.082790+0000","last_clean":"2024-01-17T23:00:33.082790+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-17T23:00:33.082790+0000","last_undegraded":"2024-01-17T23:00:33.082790+0000","last_fullsized":"2024-01-17T23:00:33.082790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081012+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-17T23:00:33.081012+0000","last_peered":"2024-01-17T23:00:33.081012+0000","last_clean":"2024-01-17T23:00:33.081012+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-17T23:00:33.081012+0000","last_undegraded":"2024-01-17T23:00:33.081012+0000","last_fullsized":"2024-01-17T23:00:33.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076923+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-17T23:00:33.076923+0000","last_peered":"2024-01-17T23:00:33.076923+0000","last_clean":"2024-01-17T23:00:33.076923+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-17T23:00:33.076923+0000","last_undegraded":"2024-01-17T23:00:33.076923+0000","last_fullsized":"2024-01-17T23:00:33.076923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078627+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-17T23:00:33.078627+0000","last_peered":"2024-01-17T23:00:33.078627+0000","last_clean":"2024-01-17T23:00:33.078627+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-17T23:00:33.078627+0000","last_undegraded":"2024-01-17T23:00:33.078627+0000","last_fullsized":"2024-01-17T23:00:33.078627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091728+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-17T23:00:33.091728+0000","last_peered":"2024-01-17T23:00:33.091728+0000","last_clean":"2024-01-17T23:00:33.091728+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-17T23:00:33.091728+0000","last_undegraded":"2024-01-17T23:00:33.091728+0000","last_fullsized":"2024-01-17T23:00:33.091728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073276+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-17T23:00:33.073276+0000","last_peered":"2024-01-17T23:00:33.073276+0000","last_clean":"2024-01-17T23:00:33.073276+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:33.073276+0000","last_undegraded":"2024-01-17T23:00:33.073276+0000","last_fullsized":"2024-01-17T23:00:33.073276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079044+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-17T23:00:33.079044+0000","last_peered":"2024-01-17T23:00:33.079044+0000","last_clean":"2024-01-17T23:00:33.079044+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-17T23:00:33.079044+0000","last_undegraded":"2024-01-17T23:00:33.079044+0000","last_fullsized":"2024-01-17T23:00:33.079044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.090852+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-17T23:00:33.090852+0000","last_peered":"2024-01-17T23:00:33.090852+0000","last_clean":"2024-01-17T23:00:33.090852+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-17T23:00:33.090852+0000","last_undegraded":"2024-01-17T23:00:33.090852+0000","last_fullsized":"2024-01-17T23:00:33.090852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.113024+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-17T23:00:34.113024+0000","last_peered":"2024-01-17T23:00:34.113024+0000","last_clean":"2024-01-17T23:00:34.113024+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-17T23:00:34.113024+0000","last_undegraded":"2024-01-17T23:00:34.113024+0000","last_fullsized":"2024-01-17T23:00:34.113024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091573+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-17T23:00:33.091573+0000","last_peered":"2024-01-17T23:00:33.091573+0000","last_clean":"2024-01-17T23:00:33.091573+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-17T23:00:33.091573+0000","last_undegraded":"2024-01-17T23:00:33.091573+0000","last_fullsized":"2024-01-17T23:00:33.091573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088626+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-17T23:00:33.088626+0000","last_peered":"2024-01-17T23:00:33.088626+0000","last_clean":"2024-01-17T23:00:33.088626+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-17T23:00:33.088626+0000","last_undegraded":"2024-01-17T23:00:33.088626+0000","last_fullsized":"2024-01-17T23:00:33.088626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.245323+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-17T23:00:57.245323+0000","last_peered":"2024-01-17T23:00:57.245323+0000","last_clean":"2024-01-17T23:00:57.245323+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-17T23:00:57.245323+0000","last_undegraded":"2024-01-17T23:00:57.245323+0000","last_fullsized":"2024-01-17T23:00:57.245323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079212+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-17T23:00:33.079212+0000","last_peered":"2024-01-17T23:00:33.079212+0000","last_clean":"2024-01-17T23:00:33.079212+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-17T23:00:33.079212+0000","last_undegraded":"2024-01-17T23:00:33.079212+0000","last_fullsized":"2024-01-17T23:00:33.079212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083426+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-17T23:00:33.083426+0000","last_peered":"2024-01-17T23:00:33.083426+0000","last_clean":"2024-01-17T23:00:33.083426+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-17T23:00:33.083426+0000","last_undegraded":"2024-01-17T23:00:33.083426+0000","last_fullsized":"2024-01-17T23:00:33.083426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.247330+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-17T23:00:57.247330+0000","last_peered":"2024-01-17T23:00:57.247330+0000","last_clean":"2024-01-17T23:00:57.247330+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-17T23:00:57.247330+0000","last_undegraded":"2024-01-17T23:00:57.247330+0000","last_fullsized":"2024-01-17T23:00:57.247330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076521+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-17T23:00:33.076521+0000","last_peered":"2024-01-17T23:00:33.076521+0000","last_clean":"2024-01-17T23:00:33.076521+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-17T23:00:33.076521+0000","last_undegraded":"2024-01-17T23:00:33.076521+0000","last_fullsized":"2024-01-17T23:00:33.076521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089619+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-17T23:00:33.089619+0000","last_peered":"2024-01-17T23:00:33.089619+0000","last_clean":"2024-01-17T23:00:33.089619+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-17T23:00:33.089619+0000","last_undegraded":"2024-01-17T23:00:33.089619+0000","last_fullsized":"2024-01-17T23:00:33.089619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.652905+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-17T23:00:54.652905+0000","last_peered":"2024-01-17T23:00:54.652905+0000","last_clean":"2024-01-17T23:00:54.652905+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-17T23:00:54.652905+0000","last_undegraded":"2024-01-17T23:00:54.652905+0000","last_fullsized":"2024-01-17T23:00:54.652905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075820+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-17T23:00:33.075820+0000","last_peered":"2024-01-17T23:00:33.075820+0000","last_clean":"2024-01-17T23:00:33.075820+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-17T23:00:33.075820+0000","last_undegraded":"2024-01-17T23:00:33.075820+0000","last_fullsized":"2024-01-17T23:00:33.075820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078004+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-17T23:00:33.078004+0000","last_peered":"2024-01-17T23:00:33.078004+0000","last_clean":"2024-01-17T23:00:33.078004+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-17T23:00:33.078004+0000","last_undegraded":"2024-01-17T23:00:33.078004+0000","last_fullsized":"2024-01-17T23:00:33.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248035+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-17T23:00:57.248035+0000","last_peered":"2024-01-17T23:00:57.248035+0000","last_clean":"2024-01-17T23:00:57.248035+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-17T23:00:57.248035+0000","last_undegraded":"2024-01-17T23:00:57.248035+0000","last_fullsized":"2024-01-17T23:00:57.248035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080561+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-17T23:00:33.080561+0000","last_peered":"2024-01-17T23:00:33.080561+0000","last_clean":"2024-01-17T23:00:33.080561+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-17T23:00:33.080561+0000","last_undegraded":"2024-01-17T23:00:33.080561+0000","last_fullsized":"2024-01-17T23:00:33.080561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089862+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-17T23:00:33.089862+0000","last_peered":"2024-01-17T23:00:33.089862+0000","last_clean":"2024-01-17T23:00:33.089862+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-17T23:00:33.089862+0000","last_undegraded":"2024-01-17T23:00:33.089862+0000","last_fullsized":"2024-01-17T23:00:33.089862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.857814+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-17T23:00:54.857814+0000","last_peered":"2024-01-17T23:00:54.857814+0000","last_clean":"2024-01-17T23:00:54.857814+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-17T23:00:54.857814+0000","last_undegraded":"2024-01-17T23:00:54.857814+0000","last_fullsized":"2024-01-17T23:00:54.857814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.690081+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-17T23:00:34.690081+0000","last_peered":"2024-01-17T23:00:34.690081+0000","last_clean":"2024-01-17T23:00:34.690081+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-17T23:00:34.690081+0000","last_undegraded":"2024-01-17T23:00:34.690081+0000","last_fullsized":"2024-01-17T23:00:34.690081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095175+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-17T23:00:33.095175+0000","last_peered":"2024-01-17T23:00:33.095175+0000","last_clean":"2024-01-17T23:00:33.095175+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-17T23:00:33.095175+0000","last_undegraded":"2024-01-17T23:00:33.095175+0000","last_fullsized":"2024-01-17T23:00:33.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.115140+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-17T23:00:34.115140+0000","last_peered":"2024-01-17T23:00:34.115140+0000","last_clean":"2024-01-17T23:00:34.115140+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-17T23:00:34.115140+0000","last_undegraded":"2024-01-17T23:00:34.115140+0000","last_fullsized":"2024-01-17T23:00:34.115140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093112+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-17T23:00:33.093112+0000","last_peered":"2024-01-17T23:00:33.093112+0000","last_clean":"2024-01-17T23:00:33.093112+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-17T23:00:33.093112+0000","last_undegraded":"2024-01-17T23:00:33.093112+0000","last_fullsized":"2024-01-17T23:00:33.093112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079491+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-17T23:00:33.079491+0000","last_peered":"2024-01-17T23:00:33.079491+0000","last_clean":"2024-01-17T23:00:33.079491+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-17T23:00:33.079491+0000","last_undegraded":"2024-01-17T23:00:33.079491+0000","last_fullsized":"2024-01-17T23:00:33.079491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.651949+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-17T23:00:54.651949+0000","last_peered":"2024-01-17T23:00:54.651949+0000","last_clean":"2024-01-17T23:00:54.651949+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-17T23:00:54.651949+0000","last_undegraded":"2024-01-17T23:00:54.651949+0000","last_fullsized":"2024-01-17T23:00:54.651949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075647+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-17T23:00:33.075647+0000","last_peered":"2024-01-17T23:00:33.075647+0000","last_clean":"2024-01-17T23:00:33.075647+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-17T23:00:33.075647+0000","last_undegraded":"2024-01-17T23:00:33.075647+0000","last_fullsized":"2024-01-17T23:00:33.075647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080583+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-17T23:00:33.080583+0000","last_peered":"2024-01-17T23:00:33.080583+0000","last_clean":"2024-01-17T23:00:33.080583+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-17T23:00:33.080583+0000","last_undegraded":"2024-01-17T23:00:33.080583+0000","last_fullsized":"2024-01-17T23:00:33.080583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858838+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-17T23:00:54.858838+0000","last_peered":"2024-01-17T23:00:54.858838+0000","last_clean":"2024-01-17T23:00:54.858838+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-17T23:00:54.858838+0000","last_undegraded":"2024-01-17T23:00:54.858838+0000","last_fullsized":"2024-01-17T23:00:54.858838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076683+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-17T23:00:33.076683+0000","last_peered":"2024-01-17T23:00:33.076683+0000","last_clean":"2024-01-17T23:00:33.076683+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-17T23:00:33.076683+0000","last_undegraded":"2024-01-17T23:00:33.076683+0000","last_fullsized":"2024-01-17T23:00:33.076683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079127+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-17T23:00:33.079127+0000","last_peered":"2024-01-17T23:00:33.079127+0000","last_clean":"2024-01-17T23:00:33.079127+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-17T23:00:33.079127+0000","last_undegraded":"2024-01-17T23:00:33.079127+0000","last_fullsized":"2024-01-17T23:00:33.079127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080106+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-17T23:00:33.080106+0000","last_peered":"2024-01-17T23:00:33.080106+0000","last_clean":"2024-01-17T23:00:33.080106+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-17T23:00:33.080106+0000","last_undegraded":"2024-01-17T23:00:33.080106+0000","last_fullsized":"2024-01-17T23:00:33.080106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.120056+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-17T23:00:34.120056+0000","last_peered":"2024-01-17T23:00:34.120056+0000","last_clean":"2024-01-17T23:00:34.120056+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-17T23:00:34.120056+0000","last_undegraded":"2024-01-17T23:00:34.120056+0000","last_fullsized":"2024-01-17T23:00:34.120056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086481+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-17T23:00:33.086481+0000","last_peered":"2024-01-17T23:00:33.086481+0000","last_clean":"2024-01-17T23:00:33.086481+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-17T23:00:33.086481+0000","last_undegraded":"2024-01-17T23:00:33.086481+0000","last_fullsized":"2024-01-17T23:00:33.086481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075738+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-17T23:00:33.075738+0000","last_peered":"2024-01-17T23:00:33.075738+0000","last_clean":"2024-01-17T23:00:33.075738+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-17T23:00:33.075738+0000","last_undegraded":"2024-01-17T23:00:33.075738+0000","last_fullsized":"2024-01-17T23:00:33.075738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.130349+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-17T23:00:57.130349+0000","last_peered":"2024-01-17T23:00:57.130349+0000","last_clean":"2024-01-17T23:00:57.130349+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-17T23:00:57.130349+0000","last_undegraded":"2024-01-17T23:00:57.130349+0000","last_fullsized":"2024-01-17T23:00:57.130349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.244172+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-17T23:00:57.244172+0000","last_peered":"2024-01-17T23:00:57.244172+0000","last_clean":"2024-01-17T23:00:57.244172+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-17T23:00:57.244172+0000","last_undegraded":"2024-01-17T23:00:57.244172+0000","last_fullsized":"2024-01-17T23:00:57.244172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078709+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-17T23:00:33.078709+0000","last_peered":"2024-01-17T23:00:33.078709+0000","last_clean":"2024-01-17T23:00:33.078709+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-17T23:00:33.078709+0000","last_undegraded":"2024-01-17T23:00:33.078709+0000","last_fullsized":"2024-01-17T23:00:33.078709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461070+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-17T23:00:34.461070+0000","last_peered":"2024-01-17T23:00:34.461070+0000","last_clean":"2024-01-17T23:00:34.461070+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-17T23:00:34.461070+0000","last_undegraded":"2024-01-17T23:00:34.461070+0000","last_fullsized":"2024-01-17T23:00:34.461070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.657236+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-17T23:00:54.657236+0000","last_peered":"2024-01-17T23:00:54.657236+0000","last_clean":"2024-01-17T23:00:54.657236+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-17T23:00:54.657236+0000","last_undegraded":"2024-01-17T23:00:54.657236+0000","last_fullsized":"2024-01-17T23:00:54.657236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093476+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-17T23:00:33.093476+0000","last_peered":"2024-01-17T23:00:33.093476+0000","last_clean":"2024-01-17T23:00:33.093476+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-17T23:00:33.093476+0000","last_undegraded":"2024-01-17T23:00:33.093476+0000","last_fullsized":"2024-01-17T23:00:33.093476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076015+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-17T23:00:33.076015+0000","last_peered":"2024-01-17T23:00:33.076015+0000","last_clean":"2024-01-17T23:00:33.076015+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-17T23:00:33.076015+0000","last_undegraded":"2024-01-17T23:00:33.076015+0000","last_fullsized":"2024-01-17T23:00:33.076015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083061+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-17T23:00:33.083061+0000","last_peered":"2024-01-17T23:00:33.083061+0000","last_clean":"2024-01-17T23:00:33.083061+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-17T23:00:33.083061+0000","last_undegraded":"2024-01-17T23:00:33.083061+0000","last_fullsized":"2024-01-17T23:00:33.083061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072920+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-17T23:00:33.072920+0000","last_peered":"2024-01-17T23:00:33.072920+0000","last_clean":"2024-01-17T23:00:33.072920+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-17T23:00:33.072920+0000","last_undegraded":"2024-01-17T23:00:33.072920+0000","last_fullsized":"2024-01-17T23:00:33.072920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083196+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-17T23:00:33.083196+0000","last_peered":"2024-01-17T23:00:33.083196+0000","last_clean":"2024-01-17T23:00:33.083196+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-17T23:00:33.083196+0000","last_undegraded":"2024-01-17T23:00:33.083196+0000","last_fullsized":"2024-01-17T23:00:33.083196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078650+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-17T23:00:33.078650+0000","last_peered":"2024-01-17T23:00:33.078650+0000","last_clean":"2024-01-17T23:00:33.078650+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-17T23:00:33.078650+0000","last_undegraded":"2024-01-17T23:00:33.078650+0000","last_fullsized":"2024-01-17T23:00:33.078650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.119356+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-17T23:00:34.119356+0000","last_peered":"2024-01-17T23:00:34.119356+0000","last_clean":"2024-01-17T23:00:34.119356+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-17T23:00:34.119356+0000","last_undegraded":"2024-01-17T23:00:34.119356+0000","last_fullsized":"2024-01-17T23:00:34.119356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076708+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-17T23:00:33.076708+0000","last_peered":"2024-01-17T23:00:33.076708+0000","last_clean":"2024-01-17T23:00:33.076708+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-17T23:00:33.076708+0000","last_undegraded":"2024-01-17T23:00:33.076708+0000","last_fullsized":"2024-01-17T23:00:33.076708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087751+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-17T23:00:33.087751+0000","last_peered":"2024-01-17T23:00:33.087751+0000","last_clean":"2024-01-17T23:00:33.087751+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-17T23:00:33.087751+0000","last_undegraded":"2024-01-17T23:00:33.087751+0000","last_fullsized":"2024-01-17T23:00:33.087751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076601+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-17T23:00:33.076601+0000","last_peered":"2024-01-17T23:00:33.076601+0000","last_clean":"2024-01-17T23:00:33.076601+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-17T23:00:33.076601+0000","last_undegraded":"2024-01-17T23:00:33.076601+0000","last_fullsized":"2024-01-17T23:00:33.076601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.198264+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-17T23:00:34.198264+0000","last_peered":"2024-01-17T23:00:34.198264+0000","last_clean":"2024-01-17T23:00:34.198264+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-17T23:00:34.198264+0000","last_undegraded":"2024-01-17T23:00:34.198264+0000","last_fullsized":"2024-01-17T23:00:34.198264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077231+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-17T23:00:33.077231+0000","last_peered":"2024-01-17T23:00:33.077231+0000","last_clean":"2024-01-17T23:00:33.077231+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-17T23:00:33.077231+0000","last_undegraded":"2024-01-17T23:00:33.077231+0000","last_fullsized":"2024-01-17T23:00:33.077231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082984+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-17T23:00:33.082984+0000","last_peered":"2024-01-17T23:00:33.082984+0000","last_clean":"2024-01-17T23:00:33.082984+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-17T23:00:33.082984+0000","last_undegraded":"2024-01-17T23:00:33.082984+0000","last_fullsized":"2024-01-17T23:00:33.082984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078535+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-17T23:00:33.078535+0000","last_peered":"2024-01-17T23:00:33.078535+0000","last_clean":"2024-01-17T23:00:33.078535+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-17T23:00:33.078535+0000","last_undegraded":"2024-01-17T23:00:33.078535+0000","last_fullsized":"2024-01-17T23:00:33.078535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085492+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-17T23:00:33.085492+0000","last_peered":"2024-01-17T23:00:33.085492+0000","last_clean":"2024-01-17T23:00:33.085492+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-17T23:00:33.085492+0000","last_undegraded":"2024-01-17T23:00:33.085492+0000","last_fullsized":"2024-01-17T23:00:33.085492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091752+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-17T23:00:33.091752+0000","last_peered":"2024-01-17T23:00:33.091752+0000","last_clean":"2024-01-17T23:00:33.091752+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-17T23:00:33.091752+0000","last_undegraded":"2024-01-17T23:00:33.091752+0000","last_fullsized":"2024-01-17T23:00:33.091752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073164+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-17T23:00:33.073164+0000","last_peered":"2024-01-17T23:00:33.073164+0000","last_clean":"2024-01-17T23:00:33.073164+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-17T23:00:33.073164+0000","last_undegraded":"2024-01-17T23:00:33.073164+0000","last_fullsized":"2024-01-17T23:00:33.073164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082519+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-17T23:00:33.082519+0000","last_peered":"2024-01-17T23:00:33.082519+0000","last_clean":"2024-01-17T23:00:33.082519+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-17T23:00:33.082519+0000","last_undegraded":"2024-01-17T23:00:33.082519+0000","last_fullsized":"2024-01-17T23:00:33.082519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079246+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-17T23:00:33.079246+0000","last_peered":"2024-01-17T23:00:33.079246+0000","last_clean":"2024-01-17T23:00:33.079246+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-17T23:00:33.079246+0000","last_undegraded":"2024-01-17T23:00:33.079246+0000","last_fullsized":"2024-01-17T23:00:33.079246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080180+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-17T23:00:33.080180+0000","last_peered":"2024-01-17T23:00:33.080180+0000","last_clean":"2024-01-17T23:00:33.080180+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-17T23:00:33.080180+0000","last_undegraded":"2024-01-17T23:00:33.080180+0000","last_fullsized":"2024-01-17T23:00:33.080180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077927+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-17T23:00:33.077927+0000","last_peered":"2024-01-17T23:00:33.077927+0000","last_clean":"2024-01-17T23:00:33.077927+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-17T23:00:33.077927+0000","last_undegraded":"2024-01-17T23:00:33.077927+0000","last_fullsized":"2024-01-17T23:00:33.077927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076524+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.076524+0000","last_peered":"2024-01-17T23:00:33.076524+0000","last_clean":"2024-01-17T23:00:33.076524+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-17T23:00:33.076524+0000","last_undegraded":"2024-01-17T23:00:33.076524+0000","last_fullsized":"2024-01-17T23:00:33.076524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093770+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-17T23:00:33.093770+0000","last_peered":"2024-01-17T23:00:33.093770+0000","last_clean":"2024-01-17T23:00:33.093770+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-17T23:00:33.093770+0000","last_undegraded":"2024-01-17T23:00:33.093770+0000","last_fullsized":"2024-01-17T23:00:33.093770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086205+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-17T23:00:33.086205+0000","last_peered":"2024-01-17T23:00:33.086205+0000","last_clean":"2024-01-17T23:00:33.086205+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-17T23:00:33.086205+0000","last_undegraded":"2024-01-17T23:00:33.086205+0000","last_fullsized":"2024-01-17T23:00:33.086205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087532+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-17T23:00:33.087532+0000","last_peered":"2024-01-17T23:00:33.087532+0000","last_clean":"2024-01-17T23:00:33.087532+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-17T23:00:33.087532+0000","last_undegraded":"2024-01-17T23:00:33.087532+0000","last_fullsized":"2024-01-17T23:00:33.087532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091518+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-17T23:00:33.091518+0000","last_peered":"2024-01-17T23:00:33.091518+0000","last_clean":"2024-01-17T23:00:33.091518+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-17T23:00:33.091518+0000","last_undegraded":"2024-01-17T23:00:33.091518+0000","last_fullsized":"2024-01-17T23:00:33.091518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075564+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-17T23:00:33.075564+0000","last_peered":"2024-01-17T23:00:33.075564+0000","last_clean":"2024-01-17T23:00:33.075564+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-17T23:00:33.075564+0000","last_undegraded":"2024-01-17T23:00:33.075564+0000","last_fullsized":"2024-01-17T23:00:33.075564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.459766+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-17T23:00:34.459766+0000","last_peered":"2024-01-17T23:00:34.459766+0000","last_clean":"2024-01-17T23:00:34.459766+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-17T23:00:34.459766+0000","last_undegraded":"2024-01-17T23:00:34.459766+0000","last_fullsized":"2024-01-17T23:00:34.459766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086625+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-17T23:00:33.086625+0000","last_peered":"2024-01-17T23:00:33.086625+0000","last_clean":"2024-01-17T23:00:33.086625+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-17T23:00:33.086625+0000","last_undegraded":"2024-01-17T23:00:33.086625+0000","last_fullsized":"2024-01-17T23:00:33.086625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080592+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-17T23:00:33.080592+0000","last_peered":"2024-01-17T23:00:33.080592+0000","last_clean":"2024-01-17T23:00:33.080592+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-17T23:00:33.080592+0000","last_undegraded":"2024-01-17T23:00:33.080592+0000","last_fullsized":"2024-01-17T23:00:33.080592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078960+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-17T23:00:33.078960+0000","last_peered":"2024-01-17T23:00:33.078960+0000","last_clean":"2024-01-17T23:00:33.078960+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-17T23:00:33.078960+0000","last_undegraded":"2024-01-17T23:00:33.078960+0000","last_fullsized":"2024-01-17T23:00:33.078960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078129+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-17T23:00:33.078129+0000","last_peered":"2024-01-17T23:00:33.078129+0000","last_clean":"2024-01-17T23:00:33.078129+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-17T23:00:33.078129+0000","last_undegraded":"2024-01-17T23:00:33.078129+0000","last_fullsized":"2024-01-17T23:00:33.078129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091203+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-17T23:00:33.091203+0000","last_peered":"2024-01-17T23:00:33.091203+0000","last_clean":"2024-01-17T23:00:33.091203+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-17T23:00:33.091203+0000","last_undegraded":"2024-01-17T23:00:33.091203+0000","last_fullsized":"2024-01-17T23:00:33.091203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":717665,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.90000000000000002}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.0529999999999999}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.026}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.137},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2150000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.292},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.95799999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":130500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.0900000000000001}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.181},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.224}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.327},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.01}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.296},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.401}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.4510000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":127359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.879},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.747}]},{"osd":1,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.016},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.202},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.238}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.82399999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84099999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.876},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.71599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":126925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":1.083},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":4.5309999999999997}]},{"osd":2,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":4.7690000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.6630000000000003,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":3.581}]},{"osd":3,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.4690000000000003,"5min":5.4690000000000003,"15min":5.4690000000000003},"last":5.1219999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":4.6890000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":3.4849999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":4.4480000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":4.6399999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":3.5489999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":4.4859999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":4.3920000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":4.7329999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":717009,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.628}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.442}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.875},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":126695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.72799999999999998}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.879}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.92000000000000004}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.98899999999999999}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.069},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":126799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.499}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T23:01:06.094 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-17T23:01:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.263+0000 7f0ca8c00640 1 Processor -- start 2024-01-17T23:01:06.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.263+0000 7f0ca8c00640 1 -- start start 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca41539a0 0x7f0ca40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ca40c79c0 0x7f0ca4061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ca4061640 0x7f0ca415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca406d570 con 0x7f0ca4061640 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40c9890 con 0x7f0ca40c79c0 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca8c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4159bf0 con 0x7f0ca41539a0 2024-01-17T23:01:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca2800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ca4061640 0x7f0ca415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:06.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca2800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0ca4061640 0x7f0ca415d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60566/0 (socket says 172.21.15.67:60566) 2024-01-17T23:01:06.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca2800640 1 -- 172.21.15.67:0/2973799229 learned_addr learned my addr 172.21.15.67:0/2973799229 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:06.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.267+0000 7f0ca1400640 1 --2- 172.21.15.67:0/2973799229 >> v2:172.21.15.137:3300/0 conn(0x7f0ca40c79c0 0x7f0ca4061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:06.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.271+0000 7f0ca2800640 1 -- 172.21.15.67:0/2973799229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca41539a0 msgr2=0x7f0ca40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:06.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.271+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2973799229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca41539a0 0x7f0ca40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.271+0000 7f0ca2800640 1 -- 172.21.15.67:0/2973799229 >> v2:172.21.15.137:3300/0 conn(0x7f0ca40c79c0 msgr2=0x7f0ca4061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:06.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.271+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2973799229 >> v2:172.21.15.137:3300/0 conn(0x7f0ca40c79c0 0x7f0ca4061100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.271+0000 7f0ca2800640 1 -- 172.21.15.67:0/2973799229 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4159eb0 con 0x7f0ca4061640 2024-01-17T23:01:06.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.279+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2973799229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca4061640 0x7f0ca415d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406fca0 tx=0x7f0c9c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d413aedd602f4e8e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca0a00640 1 -- 172.21.15.67:0/2973799229 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0a5850 con 0x7f0ca4061640 2024-01-17T23:01:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca0a00640 1 -- 172.21.15.67:0/2973799229 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0a59b0 con 0x7f0ca4061640 2024-01-17T23:01:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca0a00640 1 -- 172.21.15.67:0/2973799229 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0a5d40 con 0x7f0ca4061640 2024-01-17T23:01:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2973799229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca4061640 msgr2=0x7f0ca415d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2973799229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca4061640 0x7f0ca415d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ca406fca0 tx=0x7f0c9c01c9d0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2973799229 shutdown_connections 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2973799229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca4061640 0x7f0ca415d3f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2973799229 >> v2:172.21.15.137:3300/0 conn(0x7f0ca40c79c0 0x7f0ca4061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2973799229 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca41539a0 0x7f0ca40ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2973799229 >> 172.21.15.67:0/2973799229 conn(0x7f0ca406ad40 msgr2=0x7f0ca406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2973799229 shutdown_connections 2024-01-17T23:01:06.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.335+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2973799229 wait complete. 2024-01-17T23:01:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 Processor -- start 2024-01-17T23:01:06.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 -- start start 2024-01-17T23:01:06.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca4061640 0x7f0ca41f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca40c79c0 0x7f0ca414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca41f66f0 con 0x7f0ca41539a0 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415ab10 con 0x7f0ca4061640 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca8c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca415b370 con 0x7f0ca40c79c0 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:06.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60572/0 (socket says 172.21.15.67:60572) 2024-01-17T23:01:06.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.339+0000 7f0ca2800640 1 -- 172.21.15.67:0/2802617425 learned_addr learned my addr 172.21.15.67:0/2802617425 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.343+0000 7f0ca2800640 1 -- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca40c79c0 msgr2=0x7f0ca414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.343+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca40c79c0 0x7f0ca414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.343+0000 7f0ca2800640 1 -- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca4061640 msgr2=0x7f0ca41f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.343+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca4061640 0x7f0ca41f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.343+0000 7f0ca2800640 1 -- 172.21.15.67:0/2802617425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009b30 con 0x7f0ca41539a0 2024-01-17T23:01:06.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.347+0000 7f0ca2800640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c01b080 tx=0x7f0c9c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:06.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0b8880 con 0x7f0ca41539a0 2024-01-17T23:01:06.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0b8a00 con 0x7f0ca41539a0 2024-01-17T23:01:06.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0b8db0 con 0x7f0ca41539a0 2024-01-17T23:01:06.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca415adb0 con 0x7f0ca41539a0 2024-01-17T23:01:06.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca41f2370 con 0x7f0ca41539a0 2024-01-17T23:01:06.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.351+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca406b620 con 0x7f0ca41539a0 2024-01-17T23:01:06.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.371+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0c9c0c3460 con 0x7f0ca41539a0 2024-01-17T23:01:06.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.371+0000 7f0c9a000640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 0x7f0c7c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:06.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.371+0000 7f0ca1e00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 0x7f0c7c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:06.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.375+0000 7f0ca1e00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 0x7f0c7c068d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009690 tx=0x7f0c94006c00 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:06.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.619+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c9c0f1790 con 0x7f0ca41539a0 2024-01-17T23:01:06.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.619+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f0c9c0ed3d0 con 0x7f0ca41539a0 2024-01-17T23:01:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.775+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ca415a750 con 0x7f0c7c066890 2024-01-17T23:01:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.807+0000 7f0c9a000640 1 -- 172.21.15.67:0/2802617425 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368727 (secure 0 0 0) 0x7f0c9400b3d0 con 0x7f0c7c066890 2024-01-17T23:01:06.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-17T23:01:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 msgr2=0x7f0c7c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 0x7f0c7c068d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009690 tx=0x7f0c94006c00 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 msgr2=0x7f0ca4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c01b080 tx=0x7f0c9c019770 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 shutdown_connections 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0c7c066890 0x7f0c7c068d50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ca41539a0 0x7f0ca4151c50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0ca40c79c0 0x7f0ca414c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 --2- 172.21.15.67:0/2802617425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ca4061640 0x7f0ca41f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 >> 172.21.15.67:0/2802617425 conn(0x7f0ca406ad40 msgr2=0x7f0ca4158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 shutdown_connections 2024-01-17T23:01:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:06.811+0000 7f0ca8c00640 1 -- 172.21.15.67:0/2802617425 wait complete. 2024-01-17T23:01:06.842 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-01-17T23:01:05.939435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218816,"kb_used_data":2688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2752512,"data_stored":2203486,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005766"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248181+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-17T23:00:57.248181+0000","last_peered":"2024-01-17T23:00:57.248181+0000","last_clean":"2024-01-17T23:00:57.248181+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-17T23:00:57.248181+0000","last_undegraded":"2024-01-17T23:00:57.248181+0000","last_fullsized":"2024-01-17T23:00:57.248181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077894+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.077894+0000","last_peered":"2024-01-17T23:00:33.077894+0000","last_clean":"2024-01-17T23:00:33.077894+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-17T23:00:33.077894+0000","last_undegraded":"2024-01-17T23:00:33.077894+0000","last_fullsized":"2024-01-17T23:00:33.077894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075877+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-17T23:00:33.075877+0000","last_peered":"2024-01-17T23:00:33.075877+0000","last_clean":"2024-01-17T23:00:33.075877+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-17T23:00:33.075877+0000","last_undegraded":"2024-01-17T23:00:33.075877+0000","last_fullsized":"2024-01-17T23:00:33.075877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.195982+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-17T23:00:34.195982+0000","last_peered":"2024-01-17T23:00:34.195982+0000","last_clean":"2024-01-17T23:00:34.195982+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-17T23:00:34.195982+0000","last_undegraded":"2024-01-17T23:00:34.195982+0000","last_fullsized":"2024-01-17T23:00:34.195982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079362+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-17T23:00:33.079362+0000","last_peered":"2024-01-17T23:00:33.079362+0000","last_clean":"2024-01-17T23:00:33.079362+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-17T23:00:33.079362+0000","last_undegraded":"2024-01-17T23:00:33.079362+0000","last_fullsized":"2024-01-17T23:00:33.079362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093022+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-17T23:00:33.093022+0000","last_peered":"2024-01-17T23:00:33.093022+0000","last_clean":"2024-01-17T23:00:33.093022+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-17T23:00:33.093022+0000","last_undegraded":"2024-01-17T23:00:33.093022+0000","last_fullsized":"2024-01-17T23:00:33.093022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.131311+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-17T23:00:57.131311+0000","last_peered":"2024-01-17T23:00:57.131311+0000","last_clean":"2024-01-17T23:00:57.131311+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-17T23:00:57.131311+0000","last_undegraded":"2024-01-17T23:00:57.131311+0000","last_fullsized":"2024-01-17T23:00:57.131311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080814+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-17T23:00:33.080814+0000","last_peered":"2024-01-17T23:00:33.080814+0000","last_clean":"2024-01-17T23:00:33.080814+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-17T23:00:33.080814+0000","last_undegraded":"2024-01-17T23:00:33.080814+0000","last_fullsized":"2024-01-17T23:00:33.080814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093362+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-17T23:00:33.093362+0000","last_peered":"2024-01-17T23:00:33.093362+0000","last_clean":"2024-01-17T23:00:33.093362+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-17T23:00:33.093362+0000","last_undegraded":"2024-01-17T23:00:33.093362+0000","last_fullsized":"2024-01-17T23:00:33.093362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089926+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-17T23:00:33.089926+0000","last_peered":"2024-01-17T23:00:33.089926+0000","last_clean":"2024-01-17T23:00:33.089926+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-17T23:00:33.089926+0000","last_undegraded":"2024-01-17T23:00:33.089926+0000","last_fullsized":"2024-01-17T23:00:33.089926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080653+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-17T23:00:33.080653+0000","last_peered":"2024-01-17T23:00:33.080653+0000","last_clean":"2024-01-17T23:00:33.080653+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-17T23:00:33.080653+0000","last_undegraded":"2024-01-17T23:00:33.080653+0000","last_fullsized":"2024-01-17T23:00:33.080653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092397+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-17T23:00:33.092397+0000","last_peered":"2024-01-17T23:00:33.092397+0000","last_clean":"2024-01-17T23:00:33.092397+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-17T23:00:33.092397+0000","last_undegraded":"2024-01-17T23:00:33.092397+0000","last_fullsized":"2024-01-17T23:00:33.092397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082880+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-17T23:00:33.082880+0000","last_peered":"2024-01-17T23:00:33.082880+0000","last_clean":"2024-01-17T23:00:33.082880+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-17T23:00:33.082880+0000","last_undegraded":"2024-01-17T23:00:33.082880+0000","last_fullsized":"2024-01-17T23:00:33.082880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843181+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-17T23:00:54.843181+0000","last_peered":"2024-01-17T23:00:54.843181+0000","last_clean":"2024-01-17T23:00:54.843181+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-17T23:00:54.843181+0000","last_undegraded":"2024-01-17T23:00:54.843181+0000","last_fullsized":"2024-01-17T23:00:54.843181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095174+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-17T23:00:33.095174+0000","last_peered":"2024-01-17T23:00:33.095174+0000","last_clean":"2024-01-17T23:00:33.095174+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-17T23:00:33.095174+0000","last_undegraded":"2024-01-17T23:00:33.095174+0000","last_fullsized":"2024-01-17T23:00:33.095174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076603+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-17T23:00:33.076603+0000","last_peered":"2024-01-17T23:00:33.076603+0000","last_clean":"2024-01-17T23:00:33.076603+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-17T23:00:33.076603+0000","last_undegraded":"2024-01-17T23:00:33.076603+0000","last_fullsized":"2024-01-17T23:00:33.076603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.114735+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-17T23:00:34.114735+0000","last_peered":"2024-01-17T23:00:34.114735+0000","last_clean":"2024-01-17T23:00:34.114735+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-17T23:00:34.114735+0000","last_undegraded":"2024-01-17T23:00:34.114735+0000","last_fullsized":"2024-01-17T23:00:34.114735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093356+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-17T23:00:33.093356+0000","last_peered":"2024-01-17T23:00:33.093356+0000","last_clean":"2024-01-17T23:00:33.093356+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-17T23:00:33.093356+0000","last_undegraded":"2024-01-17T23:00:33.093356+0000","last_fullsized":"2024-01-17T23:00:33.093356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075816+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-17T23:00:33.075816+0000","last_peered":"2024-01-17T23:00:33.075816+0000","last_clean":"2024-01-17T23:00:33.075816+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-17T23:00:33.075816+0000","last_undegraded":"2024-01-17T23:00:33.075816+0000","last_fullsized":"2024-01-17T23:00:33.075816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843510+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-17T23:00:54.843510+0000","last_peered":"2024-01-17T23:00:54.843510+0000","last_clean":"2024-01-17T23:00:54.843510+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-17T23:00:54.843510+0000","last_undegraded":"2024-01-17T23:00:54.843510+0000","last_fullsized":"2024-01-17T23:00:54.843510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077169+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-17T23:00:33.077169+0000","last_peered":"2024-01-17T23:00:33.077169+0000","last_clean":"2024-01-17T23:00:33.077169+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-17T23:00:33.077169+0000","last_undegraded":"2024-01-17T23:00:33.077169+0000","last_fullsized":"2024-01-17T23:00:33.077169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092641+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-17T23:00:33.092641+0000","last_peered":"2024-01-17T23:00:33.092641+0000","last_clean":"2024-01-17T23:00:33.092641+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-17T23:00:33.092641+0000","last_undegraded":"2024-01-17T23:00:33.092641+0000","last_fullsized":"2024-01-17T23:00:33.092641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.843369+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-17T23:00:54.843369+0000","last_peered":"2024-01-17T23:00:54.843369+0000","last_clean":"2024-01-17T23:00:54.843369+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-17T23:00:54.843369+0000","last_undegraded":"2024-01-17T23:00:54.843369+0000","last_fullsized":"2024-01-17T23:00:54.843369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095681+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-17T23:00:33.095681+0000","last_peered":"2024-01-17T23:00:33.095681+0000","last_clean":"2024-01-17T23:00:33.095681+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-17T23:00:33.095681+0000","last_undegraded":"2024-01-17T23:00:33.095681+0000","last_fullsized":"2024-01-17T23:00:33.095681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079343+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-17T23:00:33.079343+0000","last_peered":"2024-01-17T23:00:33.079343+0000","last_clean":"2024-01-17T23:00:33.079343+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-17T23:00:33.079343+0000","last_undegraded":"2024-01-17T23:00:33.079343+0000","last_fullsized":"2024-01-17T23:00:33.079343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858140+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-17T23:00:54.858140+0000","last_peered":"2024-01-17T23:00:54.858140+0000","last_clean":"2024-01-17T23:00:54.858140+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-17T23:00:54.858140+0000","last_undegraded":"2024-01-17T23:00:54.858140+0000","last_fullsized":"2024-01-17T23:00:54.858140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.092000+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-17T23:00:33.092000+0000","last_peered":"2024-01-17T23:00:33.092000+0000","last_clean":"2024-01-17T23:00:33.092000+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-17T23:00:33.092000+0000","last_undegraded":"2024-01-17T23:00:33.092000+0000","last_fullsized":"2024-01-17T23:00:33.092000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076680+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-17T23:00:33.076680+0000","last_peered":"2024-01-17T23:00:33.076680+0000","last_clean":"2024-01-17T23:00:33.076680+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-17T23:00:33.076680+0000","last_undegraded":"2024-01-17T23:00:33.076680+0000","last_fullsized":"2024-01-17T23:00:33.076680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.212080+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-17T23:00:57.212080+0000","last_peered":"2024-01-17T23:00:57.212080+0000","last_clean":"2024-01-17T23:00:57.212080+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-17T23:00:57.212080+0000","last_undegraded":"2024-01-17T23:00:57.212080+0000","last_fullsized":"2024-01-17T23:00:57.212080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075915+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-17T23:00:33.075915+0000","last_peered":"2024-01-17T23:00:33.075915+0000","last_clean":"2024-01-17T23:00:33.075915+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-17T23:00:33.075915+0000","last_undegraded":"2024-01-17T23:00:33.075915+0000","last_fullsized":"2024-01-17T23:00:33.075915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079329+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-17T23:00:33.079329+0000","last_peered":"2024-01-17T23:00:33.079329+0000","last_clean":"2024-01-17T23:00:33.079329+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-17T23:00:33.079329+0000","last_undegraded":"2024-01-17T23:00:33.079329+0000","last_fullsized":"2024-01-17T23:00:33.079329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:35.281250+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-17T23:00:35.281250+0000","last_peered":"2024-01-17T23:00:35.281250+0000","last_clean":"2024-01-17T23:00:35.281250+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-17T23:00:35.281250+0000","last_undegraded":"2024-01-17T23:00:35.281250+0000","last_fullsized":"2024-01-17T23:00:35.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078545+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-17T23:00:33.078545+0000","last_peered":"2024-01-17T23:00:33.078545+0000","last_clean":"2024-01-17T23:00:33.078545+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-17T23:00:33.078545+0000","last_undegraded":"2024-01-17T23:00:33.078545+0000","last_fullsized":"2024-01-17T23:00:33.078545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080738+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-17T23:00:33.080738+0000","last_peered":"2024-01-17T23:00:33.080738+0000","last_clean":"2024-01-17T23:00:33.080738+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-17T23:00:33.080738+0000","last_undegraded":"2024-01-17T23:00:33.080738+0000","last_fullsized":"2024-01-17T23:00:33.080738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079407+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-17T23:00:33.079407+0000","last_peered":"2024-01-17T23:00:33.079407+0000","last_clean":"2024-01-17T23:00:33.079407+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-17T23:00:33.079407+0000","last_undegraded":"2024-01-17T23:00:33.079407+0000","last_fullsized":"2024-01-17T23:00:33.079407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080349+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-17T23:00:33.080349+0000","last_peered":"2024-01-17T23:00:33.080349+0000","last_clean":"2024-01-17T23:00:33.080349+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-17T23:00:33.080349+0000","last_undegraded":"2024-01-17T23:00:33.080349+0000","last_fullsized":"2024-01-17T23:00:33.080349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-17T23:00:33.093635+0000","last_peered":"2024-01-17T23:00:33.093635+0000","last_clean":"2024-01-17T23:00:33.093635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-17T23:00:33.093635+0000","last_undegraded":"2024-01-17T23:00:33.093635+0000","last_fullsized":"2024-01-17T23:00:33.093635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.121860+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-17T23:00:34.121860+0000","last_peered":"2024-01-17T23:00:34.121860+0000","last_clean":"2024-01-17T23:00:34.121860+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-17T23:00:34.121860+0000","last_undegraded":"2024-01-17T23:00:34.121860+0000","last_fullsized":"2024-01-17T23:00:34.121860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076437+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-17T23:00:33.076437+0000","last_peered":"2024-01-17T23:00:33.076437+0000","last_clean":"2024-01-17T23:00:33.076437+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-17T23:00:33.076437+0000","last_undegraded":"2024-01-17T23:00:33.076437+0000","last_fullsized":"2024-01-17T23:00:33.076437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.243579+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-17T23:00:57.243579+0000","last_peered":"2024-01-17T23:00:57.243579+0000","last_clean":"2024-01-17T23:00:57.243579+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:57.243579+0000","last_undegraded":"2024-01-17T23:00:57.243579+0000","last_fullsized":"2024-01-17T23:00:57.243579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076642+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-17T23:00:33.076642+0000","last_peered":"2024-01-17T23:00:33.076642+0000","last_clean":"2024-01-17T23:00:33.076642+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-17T23:00:33.076642+0000","last_undegraded":"2024-01-17T23:00:33.076642+0000","last_fullsized":"2024-01-17T23:00:33.076642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.129939+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-17T23:00:57.129939+0000","last_peered":"2024-01-17T23:00:57.129939+0000","last_clean":"2024-01-17T23:00:57.129939+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-17T23:00:57.129939+0000","last_undegraded":"2024-01-17T23:00:57.129939+0000","last_fullsized":"2024-01-17T23:00:57.129939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079933+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-17T23:00:33.079933+0000","last_peered":"2024-01-17T23:00:33.079933+0000","last_clean":"2024-01-17T23:00:33.079933+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-17T23:00:33.079933+0000","last_undegraded":"2024-01-17T23:00:33.079933+0000","last_fullsized":"2024-01-17T23:00:33.079933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076809+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-17T23:00:33.076809+0000","last_peered":"2024-01-17T23:00:33.076809+0000","last_clean":"2024-01-17T23:00:33.076809+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-17T23:00:33.076809+0000","last_undegraded":"2024-01-17T23:00:33.076809+0000","last_fullsized":"2024-01-17T23:00:33.076809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.653004+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-17T23:00:54.653004+0000","last_peered":"2024-01-17T23:00:54.653004+0000","last_clean":"2024-01-17T23:00:54.653004+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-17T23:00:54.653004+0000","last_undegraded":"2024-01-17T23:00:54.653004+0000","last_fullsized":"2024-01-17T23:00:54.653004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089167+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-17T23:00:33.089167+0000","last_peered":"2024-01-17T23:00:33.089167+0000","last_clean":"2024-01-17T23:00:33.089167+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-17T23:00:33.089167+0000","last_undegraded":"2024-01-17T23:00:33.089167+0000","last_fullsized":"2024-01-17T23:00:33.089167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085186+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-17T23:00:33.085186+0000","last_peered":"2024-01-17T23:00:33.085186+0000","last_clean":"2024-01-17T23:00:33.085186+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-17T23:00:33.085186+0000","last_undegraded":"2024-01-17T23:00:33.085186+0000","last_fullsized":"2024-01-17T23:00:33.085186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091113+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-17T23:00:33.091113+0000","last_peered":"2024-01-17T23:00:33.091113+0000","last_clean":"2024-01-17T23:00:33.091113+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-17T23:00:33.091113+0000","last_undegraded":"2024-01-17T23:00:33.091113+0000","last_fullsized":"2024-01-17T23:00:33.091113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.245839+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-17T23:00:57.245839+0000","last_peered":"2024-01-17T23:00:57.245839+0000","last_clean":"2024-01-17T23:00:57.245839+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-17T23:00:57.245839+0000","last_undegraded":"2024-01-17T23:00:57.245839+0000","last_fullsized":"2024-01-17T23:00:57.245839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082790+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-17T23:00:33.082790+0000","last_peered":"2024-01-17T23:00:33.082790+0000","last_clean":"2024-01-17T23:00:33.082790+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-17T23:00:33.082790+0000","last_undegraded":"2024-01-17T23:00:33.082790+0000","last_fullsized":"2024-01-17T23:00:33.082790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.081012+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-17T23:00:33.081012+0000","last_peered":"2024-01-17T23:00:33.081012+0000","last_clean":"2024-01-17T23:00:33.081012+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-17T23:00:33.081012+0000","last_undegraded":"2024-01-17T23:00:33.081012+0000","last_fullsized":"2024-01-17T23:00:33.081012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076923+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-17T23:00:33.076923+0000","last_peered":"2024-01-17T23:00:33.076923+0000","last_clean":"2024-01-17T23:00:33.076923+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-17T23:00:33.076923+0000","last_undegraded":"2024-01-17T23:00:33.076923+0000","last_fullsized":"2024-01-17T23:00:33.076923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078627+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-17T23:00:33.078627+0000","last_peered":"2024-01-17T23:00:33.078627+0000","last_clean":"2024-01-17T23:00:33.078627+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-17T23:00:33.078627+0000","last_undegraded":"2024-01-17T23:00:33.078627+0000","last_fullsized":"2024-01-17T23:00:33.078627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091728+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-17T23:00:33.091728+0000","last_peered":"2024-01-17T23:00:33.091728+0000","last_clean":"2024-01-17T23:00:33.091728+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-17T23:00:33.091728+0000","last_undegraded":"2024-01-17T23:00:33.091728+0000","last_fullsized":"2024-01-17T23:00:33.091728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073276+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-17T23:00:33.073276+0000","last_peered":"2024-01-17T23:00:33.073276+0000","last_clean":"2024-01-17T23:00:33.073276+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-17T23:00:33.073276+0000","last_undegraded":"2024-01-17T23:00:33.073276+0000","last_fullsized":"2024-01-17T23:00:33.073276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079044+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-17T23:00:33.079044+0000","last_peered":"2024-01-17T23:00:33.079044+0000","last_clean":"2024-01-17T23:00:33.079044+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-17T23:00:33.079044+0000","last_undegraded":"2024-01-17T23:00:33.079044+0000","last_fullsized":"2024-01-17T23:00:33.079044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.090852+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-17T23:00:33.090852+0000","last_peered":"2024-01-17T23:00:33.090852+0000","last_clean":"2024-01-17T23:00:33.090852+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-17T23:00:33.090852+0000","last_undegraded":"2024-01-17T23:00:33.090852+0000","last_fullsized":"2024-01-17T23:00:33.090852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.113024+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-17T23:00:34.113024+0000","last_peered":"2024-01-17T23:00:34.113024+0000","last_clean":"2024-01-17T23:00:34.113024+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-17T23:00:34.113024+0000","last_undegraded":"2024-01-17T23:00:34.113024+0000","last_fullsized":"2024-01-17T23:00:34.113024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091573+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-17T23:00:33.091573+0000","last_peered":"2024-01-17T23:00:33.091573+0000","last_clean":"2024-01-17T23:00:33.091573+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-17T23:00:33.091573+0000","last_undegraded":"2024-01-17T23:00:33.091573+0000","last_fullsized":"2024-01-17T23:00:33.091573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.088626+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-17T23:00:33.088626+0000","last_peered":"2024-01-17T23:00:33.088626+0000","last_clean":"2024-01-17T23:00:33.088626+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-17T23:00:33.088626+0000","last_undegraded":"2024-01-17T23:00:33.088626+0000","last_fullsized":"2024-01-17T23:00:33.088626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.245323+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-17T23:00:57.245323+0000","last_peered":"2024-01-17T23:00:57.245323+0000","last_clean":"2024-01-17T23:00:57.245323+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-17T23:00:57.245323+0000","last_undegraded":"2024-01-17T23:00:57.245323+0000","last_fullsized":"2024-01-17T23:00:57.245323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079212+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-17T23:00:33.079212+0000","last_peered":"2024-01-17T23:00:33.079212+0000","last_clean":"2024-01-17T23:00:33.079212+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-17T23:00:33.079212+0000","last_undegraded":"2024-01-17T23:00:33.079212+0000","last_fullsized":"2024-01-17T23:00:33.079212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083426+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-17T23:00:33.083426+0000","last_peered":"2024-01-17T23:00:33.083426+0000","last_clean":"2024-01-17T23:00:33.083426+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-17T23:00:33.083426+0000","last_undegraded":"2024-01-17T23:00:33.083426+0000","last_fullsized":"2024-01-17T23:00:33.083426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.247330+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-17T23:00:57.247330+0000","last_peered":"2024-01-17T23:00:57.247330+0000","last_clean":"2024-01-17T23:00:57.247330+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-17T23:00:57.247330+0000","last_undegraded":"2024-01-17T23:00:57.247330+0000","last_fullsized":"2024-01-17T23:00:57.247330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076521+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-17T23:00:33.076521+0000","last_peered":"2024-01-17T23:00:33.076521+0000","last_clean":"2024-01-17T23:00:33.076521+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-17T23:00:33.076521+0000","last_undegraded":"2024-01-17T23:00:33.076521+0000","last_fullsized":"2024-01-17T23:00:33.076521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089619+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-17T23:00:33.089619+0000","last_peered":"2024-01-17T23:00:33.089619+0000","last_clean":"2024-01-17T23:00:33.089619+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-17T23:00:33.089619+0000","last_undegraded":"2024-01-17T23:00:33.089619+0000","last_fullsized":"2024-01-17T23:00:33.089619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.652905+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-17T23:00:54.652905+0000","last_peered":"2024-01-17T23:00:54.652905+0000","last_clean":"2024-01-17T23:00:54.652905+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-17T23:00:54.652905+0000","last_undegraded":"2024-01-17T23:00:54.652905+0000","last_fullsized":"2024-01-17T23:00:54.652905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075820+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-17T23:00:33.075820+0000","last_peered":"2024-01-17T23:00:33.075820+0000","last_clean":"2024-01-17T23:00:33.075820+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-17T23:00:33.075820+0000","last_undegraded":"2024-01-17T23:00:33.075820+0000","last_fullsized":"2024-01-17T23:00:33.075820+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078004+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-17T23:00:33.078004+0000","last_peered":"2024-01-17T23:00:33.078004+0000","last_clean":"2024-01-17T23:00:33.078004+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-17T23:00:33.078004+0000","last_undegraded":"2024-01-17T23:00:33.078004+0000","last_fullsized":"2024-01-17T23:00:33.078004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.248035+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-17T23:00:57.248035+0000","last_peered":"2024-01-17T23:00:57.248035+0000","last_clean":"2024-01-17T23:00:57.248035+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-17T23:00:57.248035+0000","last_undegraded":"2024-01-17T23:00:57.248035+0000","last_fullsized":"2024-01-17T23:00:57.248035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080561+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-17T23:00:33.080561+0000","last_peered":"2024-01-17T23:00:33.080561+0000","last_clean":"2024-01-17T23:00:33.080561+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-17T23:00:33.080561+0000","last_undegraded":"2024-01-17T23:00:33.080561+0000","last_fullsized":"2024-01-17T23:00:33.080561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.089862+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-17T23:00:33.089862+0000","last_peered":"2024-01-17T23:00:33.089862+0000","last_clean":"2024-01-17T23:00:33.089862+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-17T23:00:33.089862+0000","last_undegraded":"2024-01-17T23:00:33.089862+0000","last_fullsized":"2024-01-17T23:00:33.089862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.857814+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-17T23:00:54.857814+0000","last_peered":"2024-01-17T23:00:54.857814+0000","last_clean":"2024-01-17T23:00:54.857814+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-17T23:00:54.857814+0000","last_undegraded":"2024-01-17T23:00:54.857814+0000","last_fullsized":"2024-01-17T23:00:54.857814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.690081+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-17T23:00:34.690081+0000","last_peered":"2024-01-17T23:00:34.690081+0000","last_clean":"2024-01-17T23:00:34.690081+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-17T23:00:34.690081+0000","last_undegraded":"2024-01-17T23:00:34.690081+0000","last_fullsized":"2024-01-17T23:00:34.690081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.095175+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-17T23:00:33.095175+0000","last_peered":"2024-01-17T23:00:33.095175+0000","last_clean":"2024-01-17T23:00:33.095175+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-17T23:00:33.095175+0000","last_undegraded":"2024-01-17T23:00:33.095175+0000","last_fullsized":"2024-01-17T23:00:33.095175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.115140+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-17T23:00:34.115140+0000","last_peered":"2024-01-17T23:00:34.115140+0000","last_clean":"2024-01-17T23:00:34.115140+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-17T23:00:34.115140+0000","last_undegraded":"2024-01-17T23:00:34.115140+0000","last_fullsized":"2024-01-17T23:00:34.115140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093112+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-17T23:00:33.093112+0000","last_peered":"2024-01-17T23:00:33.093112+0000","last_clean":"2024-01-17T23:00:33.093112+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-17T23:00:33.093112+0000","last_undegraded":"2024-01-17T23:00:33.093112+0000","last_fullsized":"2024-01-17T23:00:33.093112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079491+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-17T23:00:33.079491+0000","last_peered":"2024-01-17T23:00:33.079491+0000","last_clean":"2024-01-17T23:00:33.079491+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-17T23:00:33.079491+0000","last_undegraded":"2024-01-17T23:00:33.079491+0000","last_fullsized":"2024-01-17T23:00:33.079491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.651949+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-17T23:00:54.651949+0000","last_peered":"2024-01-17T23:00:54.651949+0000","last_clean":"2024-01-17T23:00:54.651949+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-17T23:00:54.651949+0000","last_undegraded":"2024-01-17T23:00:54.651949+0000","last_fullsized":"2024-01-17T23:00:54.651949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075647+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-17T23:00:33.075647+0000","last_peered":"2024-01-17T23:00:33.075647+0000","last_clean":"2024-01-17T23:00:33.075647+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-17T23:00:33.075647+0000","last_undegraded":"2024-01-17T23:00:33.075647+0000","last_fullsized":"2024-01-17T23:00:33.075647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080583+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-17T23:00:33.080583+0000","last_peered":"2024-01-17T23:00:33.080583+0000","last_clean":"2024-01-17T23:00:33.080583+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-17T23:00:33.080583+0000","last_undegraded":"2024-01-17T23:00:33.080583+0000","last_fullsized":"2024-01-17T23:00:33.080583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.858838+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-17T23:00:54.858838+0000","last_peered":"2024-01-17T23:00:54.858838+0000","last_clean":"2024-01-17T23:00:54.858838+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-17T23:00:54.858838+0000","last_undegraded":"2024-01-17T23:00:54.858838+0000","last_fullsized":"2024-01-17T23:00:54.858838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076683+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-17T23:00:33.076683+0000","last_peered":"2024-01-17T23:00:33.076683+0000","last_clean":"2024-01-17T23:00:33.076683+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-17T23:00:33.076683+0000","last_undegraded":"2024-01-17T23:00:33.076683+0000","last_fullsized":"2024-01-17T23:00:33.076683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079127+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-17T23:00:33.079127+0000","last_peered":"2024-01-17T23:00:33.079127+0000","last_clean":"2024-01-17T23:00:33.079127+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-17T23:00:33.079127+0000","last_undegraded":"2024-01-17T23:00:33.079127+0000","last_fullsized":"2024-01-17T23:00:33.079127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080106+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-17T23:00:33.080106+0000","last_peered":"2024-01-17T23:00:33.080106+0000","last_clean":"2024-01-17T23:00:33.080106+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-17T23:00:33.080106+0000","last_undegraded":"2024-01-17T23:00:33.080106+0000","last_fullsized":"2024-01-17T23:00:33.080106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.120056+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-17T23:00:34.120056+0000","last_peered":"2024-01-17T23:00:34.120056+0000","last_clean":"2024-01-17T23:00:34.120056+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-17T23:00:34.120056+0000","last_undegraded":"2024-01-17T23:00:34.120056+0000","last_fullsized":"2024-01-17T23:00:34.120056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086481+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-17T23:00:33.086481+0000","last_peered":"2024-01-17T23:00:33.086481+0000","last_clean":"2024-01-17T23:00:33.086481+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-17T23:00:33.086481+0000","last_undegraded":"2024-01-17T23:00:33.086481+0000","last_fullsized":"2024-01-17T23:00:33.086481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075738+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-17T23:00:33.075738+0000","last_peered":"2024-01-17T23:00:33.075738+0000","last_clean":"2024-01-17T23:00:33.075738+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-17T23:00:33.075738+0000","last_undegraded":"2024-01-17T23:00:33.075738+0000","last_fullsized":"2024-01-17T23:00:33.075738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.130349+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-17T23:00:57.130349+0000","last_peered":"2024-01-17T23:00:57.130349+0000","last_clean":"2024-01-17T23:00:57.130349+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-17T23:00:57.130349+0000","last_undegraded":"2024-01-17T23:00:57.130349+0000","last_fullsized":"2024-01-17T23:00:57.130349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:57.244172+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-17T23:00:57.244172+0000","last_peered":"2024-01-17T23:00:57.244172+0000","last_clean":"2024-01-17T23:00:57.244172+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-17T23:00:57.244172+0000","last_undegraded":"2024-01-17T23:00:57.244172+0000","last_fullsized":"2024-01-17T23:00:57.244172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078709+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-17T23:00:33.078709+0000","last_peered":"2024-01-17T23:00:33.078709+0000","last_clean":"2024-01-17T23:00:33.078709+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-17T23:00:33.078709+0000","last_undegraded":"2024-01-17T23:00:33.078709+0000","last_fullsized":"2024-01-17T23:00:33.078709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461070+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-17T23:00:34.461070+0000","last_peered":"2024-01-17T23:00:34.461070+0000","last_clean":"2024-01-17T23:00:34.461070+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-17T23:00:34.461070+0000","last_undegraded":"2024-01-17T23:00:34.461070+0000","last_fullsized":"2024-01-17T23:00:34.461070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:54.657236+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-17T23:00:54.657236+0000","last_peered":"2024-01-17T23:00:54.657236+0000","last_clean":"2024-01-17T23:00:54.657236+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-17T23:00:54.657236+0000","last_undegraded":"2024-01-17T23:00:54.657236+0000","last_fullsized":"2024-01-17T23:00:54.657236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093476+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-17T23:00:33.093476+0000","last_peered":"2024-01-17T23:00:33.093476+0000","last_clean":"2024-01-17T23:00:33.093476+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-17T23:00:33.093476+0000","last_undegraded":"2024-01-17T23:00:33.093476+0000","last_fullsized":"2024-01-17T23:00:33.093476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076015+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-17T23:00:33.076015+0000","last_peered":"2024-01-17T23:00:33.076015+0000","last_clean":"2024-01-17T23:00:33.076015+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-17T23:00:33.076015+0000","last_undegraded":"2024-01-17T23:00:33.076015+0000","last_fullsized":"2024-01-17T23:00:33.076015+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083061+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-17T23:00:33.083061+0000","last_peered":"2024-01-17T23:00:33.083061+0000","last_clean":"2024-01-17T23:00:33.083061+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-17T23:00:33.083061+0000","last_undegraded":"2024-01-17T23:00:33.083061+0000","last_fullsized":"2024-01-17T23:00:33.083061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.072920+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-17T23:00:33.072920+0000","last_peered":"2024-01-17T23:00:33.072920+0000","last_clean":"2024-01-17T23:00:33.072920+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-17T23:00:33.072920+0000","last_undegraded":"2024-01-17T23:00:33.072920+0000","last_fullsized":"2024-01-17T23:00:33.072920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.083196+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-17T23:00:33.083196+0000","last_peered":"2024-01-17T23:00:33.083196+0000","last_clean":"2024-01-17T23:00:33.083196+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-17T23:00:33.083196+0000","last_undegraded":"2024-01-17T23:00:33.083196+0000","last_fullsized":"2024-01-17T23:00:33.083196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078650+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-17T23:00:33.078650+0000","last_peered":"2024-01-17T23:00:33.078650+0000","last_clean":"2024-01-17T23:00:33.078650+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-17T23:00:33.078650+0000","last_undegraded":"2024-01-17T23:00:33.078650+0000","last_fullsized":"2024-01-17T23:00:33.078650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.119356+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-17T23:00:34.119356+0000","last_peered":"2024-01-17T23:00:34.119356+0000","last_clean":"2024-01-17T23:00:34.119356+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-17T23:00:34.119356+0000","last_undegraded":"2024-01-17T23:00:34.119356+0000","last_fullsized":"2024-01-17T23:00:34.119356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076708+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-17T23:00:33.076708+0000","last_peered":"2024-01-17T23:00:33.076708+0000","last_clean":"2024-01-17T23:00:33.076708+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-17T23:00:33.076708+0000","last_undegraded":"2024-01-17T23:00:33.076708+0000","last_fullsized":"2024-01-17T23:00:33.076708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087751+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-17T23:00:33.087751+0000","last_peered":"2024-01-17T23:00:33.087751+0000","last_clean":"2024-01-17T23:00:33.087751+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-17T23:00:33.087751+0000","last_undegraded":"2024-01-17T23:00:33.087751+0000","last_fullsized":"2024-01-17T23:00:33.087751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076601+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-17T23:00:33.076601+0000","last_peered":"2024-01-17T23:00:33.076601+0000","last_clean":"2024-01-17T23:00:33.076601+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-17T23:00:33.076601+0000","last_undegraded":"2024-01-17T23:00:33.076601+0000","last_fullsized":"2024-01-17T23:00:33.076601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.198264+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-17T23:00:34.198264+0000","last_peered":"2024-01-17T23:00:34.198264+0000","last_clean":"2024-01-17T23:00:34.198264+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-17T23:00:34.198264+0000","last_undegraded":"2024-01-17T23:00:34.198264+0000","last_fullsized":"2024-01-17T23:00:34.198264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077231+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-17T23:00:33.077231+0000","last_peered":"2024-01-17T23:00:33.077231+0000","last_clean":"2024-01-17T23:00:33.077231+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-17T23:00:33.077231+0000","last_undegraded":"2024-01-17T23:00:33.077231+0000","last_fullsized":"2024-01-17T23:00:33.077231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082984+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-17T23:00:33.082984+0000","last_peered":"2024-01-17T23:00:33.082984+0000","last_clean":"2024-01-17T23:00:33.082984+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-17T23:00:33.082984+0000","last_undegraded":"2024-01-17T23:00:33.082984+0000","last_fullsized":"2024-01-17T23:00:33.082984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078535+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-17T23:00:33.078535+0000","last_peered":"2024-01-17T23:00:33.078535+0000","last_clean":"2024-01-17T23:00:33.078535+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-17T23:00:33.078535+0000","last_undegraded":"2024-01-17T23:00:33.078535+0000","last_fullsized":"2024-01-17T23:00:33.078535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.085492+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-17T23:00:33.085492+0000","last_peered":"2024-01-17T23:00:33.085492+0000","last_clean":"2024-01-17T23:00:33.085492+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-17T23:00:33.085492+0000","last_undegraded":"2024-01-17T23:00:33.085492+0000","last_fullsized":"2024-01-17T23:00:33.085492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091752+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-17T23:00:33.091752+0000","last_peered":"2024-01-17T23:00:33.091752+0000","last_clean":"2024-01-17T23:00:33.091752+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-17T23:00:33.091752+0000","last_undegraded":"2024-01-17T23:00:33.091752+0000","last_fullsized":"2024-01-17T23:00:33.091752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.073164+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-17T23:00:33.073164+0000","last_peered":"2024-01-17T23:00:33.073164+0000","last_clean":"2024-01-17T23:00:33.073164+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-17T23:00:33.073164+0000","last_undegraded":"2024-01-17T23:00:33.073164+0000","last_fullsized":"2024-01-17T23:00:33.073164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.082519+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-17T23:00:33.082519+0000","last_peered":"2024-01-17T23:00:33.082519+0000","last_clean":"2024-01-17T23:00:33.082519+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-17T23:00:33.082519+0000","last_undegraded":"2024-01-17T23:00:33.082519+0000","last_fullsized":"2024-01-17T23:00:33.082519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.079246+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-17T23:00:33.079246+0000","last_peered":"2024-01-17T23:00:33.079246+0000","last_clean":"2024-01-17T23:00:33.079246+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-17T23:00:33.079246+0000","last_undegraded":"2024-01-17T23:00:33.079246+0000","last_fullsized":"2024-01-17T23:00:33.079246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080180+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-17T23:00:33.080180+0000","last_peered":"2024-01-17T23:00:33.080180+0000","last_clean":"2024-01-17T23:00:33.080180+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-17T23:00:33.080180+0000","last_undegraded":"2024-01-17T23:00:33.080180+0000","last_fullsized":"2024-01-17T23:00:33.080180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.077927+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-17T23:00:33.077927+0000","last_peered":"2024-01-17T23:00:33.077927+0000","last_clean":"2024-01-17T23:00:33.077927+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-17T23:00:33.077927+0000","last_undegraded":"2024-01-17T23:00:33.077927+0000","last_fullsized":"2024-01-17T23:00:33.077927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.076524+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-17T23:00:33.076524+0000","last_peered":"2024-01-17T23:00:33.076524+0000","last_clean":"2024-01-17T23:00:33.076524+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-17T23:00:33.076524+0000","last_undegraded":"2024-01-17T23:00:33.076524+0000","last_fullsized":"2024-01-17T23:00:33.076524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.093770+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-17T23:00:33.093770+0000","last_peered":"2024-01-17T23:00:33.093770+0000","last_clean":"2024-01-17T23:00:33.093770+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-17T23:00:33.093770+0000","last_undegraded":"2024-01-17T23:00:33.093770+0000","last_fullsized":"2024-01-17T23:00:33.093770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086205+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-17T23:00:33.086205+0000","last_peered":"2024-01-17T23:00:33.086205+0000","last_clean":"2024-01-17T23:00:33.086205+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-17T23:00:33.086205+0000","last_undegraded":"2024-01-17T23:00:33.086205+0000","last_fullsized":"2024-01-17T23:00:33.086205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.087532+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-17T23:00:33.087532+0000","last_peered":"2024-01-17T23:00:33.087532+0000","last_clean":"2024-01-17T23:00:33.087532+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-17T23:00:33.087532+0000","last_undegraded":"2024-01-17T23:00:33.087532+0000","last_fullsized":"2024-01-17T23:00:33.087532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091518+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-17T23:00:33.091518+0000","last_peered":"2024-01-17T23:00:33.091518+0000","last_clean":"2024-01-17T23:00:33.091518+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-17T23:00:33.091518+0000","last_undegraded":"2024-01-17T23:00:33.091518+0000","last_fullsized":"2024-01-17T23:00:33.091518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.075564+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-17T23:00:33.075564+0000","last_peered":"2024-01-17T23:00:33.075564+0000","last_clean":"2024-01-17T23:00:33.075564+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-17T23:00:33.075564+0000","last_undegraded":"2024-01-17T23:00:33.075564+0000","last_fullsized":"2024-01-17T23:00:33.075564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.461746+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-17T23:00:34.461746+0000","last_peered":"2024-01-17T23:00:34.461746+0000","last_clean":"2024-01-17T23:00:34.461746+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-17T23:00:34.461746+0000","last_undegraded":"2024-01-17T23:00:34.461746+0000","last_fullsized":"2024-01-17T23:00:34.461746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-17T23:00:34.459766+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-17T23:00:34.459766+0000","last_peered":"2024-01-17T23:00:34.459766+0000","last_clean":"2024-01-17T23:00:34.459766+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-17T23:00:34.459766+0000","last_undegraded":"2024-01-17T23:00:34.459766+0000","last_fullsized":"2024-01-17T23:00:34.459766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.086625+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-17T23:00:33.086625+0000","last_peered":"2024-01-17T23:00:33.086625+0000","last_clean":"2024-01-17T23:00:33.086625+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-17T23:00:33.086625+0000","last_undegraded":"2024-01-17T23:00:33.086625+0000","last_fullsized":"2024-01-17T23:00:33.086625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.080592+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-17T23:00:33.080592+0000","last_peered":"2024-01-17T23:00:33.080592+0000","last_clean":"2024-01-17T23:00:33.080592+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-17T23:00:33.080592+0000","last_undegraded":"2024-01-17T23:00:33.080592+0000","last_fullsized":"2024-01-17T23:00:33.080592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078960+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-17T23:00:33.078960+0000","last_peered":"2024-01-17T23:00:33.078960+0000","last_clean":"2024-01-17T23:00:33.078960+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-17T23:00:33.078960+0000","last_undegraded":"2024-01-17T23:00:33.078960+0000","last_fullsized":"2024-01-17T23:00:33.078960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.078129+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-17T23:00:33.078129+0000","last_peered":"2024-01-17T23:00:33.078129+0000","last_clean":"2024-01-17T23:00:33.078129+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-17T23:00:33.078129+0000","last_undegraded":"2024-01-17T23:00:33.078129+0000","last_fullsized":"2024-01-17T23:00:33.078129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-01-17T23:00:33.091203+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-17T23:00:33.091203+0000","last_peered":"2024-01-17T23:00:33.091203+0000","last_clean":"2024-01-17T23:00:33.091203+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-17T23:00:33.091203+0000","last_undegraded":"2024-01-17T23:00:33.091203+0000","last_fullsized":"2024-01-17T23:00:33.091203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66584,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":717665,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.90000000000000002}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.0529999999999999}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85599999999999998}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.026}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.137},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2150000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.292},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.95799999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":130500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.0900000000000001}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.181},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.224}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.327},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.01}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.296},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.401}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.4510000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":127359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.879},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.747}]},{"osd":1,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.67600000000000005}]},{"osd":2,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":1.016},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Wed Jan 17 23:00:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.202},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.238}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.82399999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84099999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.876},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.71599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":126925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":5.923,"5min":5.923,"15min":5.923},"last":1.083},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":4.5309999999999997}]},{"osd":2,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":4.7690000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":5.6630000000000003,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":3.581}]},{"osd":3,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.4690000000000003,"5min":5.4690000000000003,"15min":5.4690000000000003},"last":5.1219999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":4.6890000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":3.4849999999999999}]},{"osd":5,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":4.4480000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":4.6399999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":3.5489999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":4.4859999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":4.3920000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":4.7329999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":717009,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.628}]},{"osd":2,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57099999999999995}]},{"osd":3,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.442}]},{"osd":4,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Wed Jan 17 23:00:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.875},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":126695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.72799999999999998}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.879}]},{"osd":2,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.92000000000000004}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":0.98899999999999999}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.069},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":126799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.31},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.499}]},{"osd":3,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Jan 17 23:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33292,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-17T23:01:06.847 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-17T23:01:06.848 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-17T23:01:06.848 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-17T23:01:06.848 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-17T23:01:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.015+0000 7f9c9c600640 1 Processor -- start 2024-01-17T23:01:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.015+0000 7f9c9c600640 1 -- start start 2024-01-17T23:01:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9c600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c94153780 0x7f9c94159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9c600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c9415d410 0x7f9c94070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9c600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c94159c40 con 0x7f9c940ca2f0 2024-01-17T23:01:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9c600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c94153b60 con 0x7f9c9415d410 2024-01-17T23:01:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9c600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c94159f20 con 0x7f9c94153780 2024-01-17T23:01:07.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9a600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c9415d410 0x7f9c94070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9a600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9c9415d410 0x7f9c94070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60588/0 (socket says 172.21.15.67:60588) 2024-01-17T23:01:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c9a600640 1 -- 172.21.15.67:0/459812396 learned_addr learned my addr 172.21.15.67:0/459812396 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:07.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.019+0000 7f9c99c00640 1 --2- 172.21.15.67:0/459812396 >> v2:172.21.15.137:3300/0 conn(0x7f9c94153780 0x7f9c94159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.023+0000 7f9c9a600640 1 -- 172.21.15.67:0/459812396 >> v2:172.21.15.137:3300/0 conn(0x7f9c94153780 msgr2=0x7f9c94159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.023+0000 7f9c9a600640 1 --2- 172.21.15.67:0/459812396 >> v2:172.21.15.137:3300/0 conn(0x7f9c94153780 0x7f9c94159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.023+0000 7f9c9a600640 1 -- 172.21.15.67:0/459812396 >> v1:172.21.15.67:6789/0 conn(0x7f9c940ca2f0 legacy=0x7f9c9406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.023+0000 7f9c9a600640 1 -- 172.21.15.67:0/459812396 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9415a200 con 0x7f9c9415d410 2024-01-17T23:01:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.027+0000 7f9c9a600640 1 --2- 172.21.15.67:0/459812396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9415d410 0x7f9c94070d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c9406fb30 tx=0x7f9c8c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1a2396abc54d8c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.031+0000 7f9c93e00640 1 -- 172.21.15.67:0/459812396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0af400 con 0x7f9c9415d410 2024-01-17T23:01:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.031+0000 7f9c93e00640 1 -- 172.21.15.67:0/459812396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0ab050 con 0x7f9c9415d410 2024-01-17T23:01:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.031+0000 7f9c93e00640 1 -- 172.21.15.67:0/459812396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0af780 con 0x7f9c9415d410 2024-01-17T23:01:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- 172.21.15.67:0/459812396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9415d410 msgr2=0x7f9c94070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- 172.21.15.67:0/459812396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9415d410 0x7f9c94070d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c9406fb30 tx=0x7f9c8c01f1c0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- 172.21.15.67:0/459812396 shutdown_connections 2024-01-17T23:01:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- 172.21.15.67:0/459812396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c9415d410 0x7f9c94070d20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- 172.21.15.67:0/459812396 >> v2:172.21.15.137:3300/0 conn(0x7f9c94153780 0x7f9c94159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- 172.21.15.67:0/459812396 >> 172.21.15.67:0/459812396 conn(0x7f9c94070390 msgr2=0x7f9c9406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- 172.21.15.67:0/459812396 shutdown_connections 2024-01-17T23:01:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- 172.21.15.67:0/459812396 wait complete. 2024-01-17T23:01:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 Processor -- start 2024-01-17T23:01:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- start start 2024-01-17T23:01:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94153780 0x7f9c9414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c9415d410 0x7f9c941efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940acc10 con 0x7f9c940ca2f0 2024-01-17T23:01:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941ef460 con 0x7f9c94153780 2024-01-17T23:01:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.035+0000 7f9c9c600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94159520 con 0x7f9c9415d410 2024-01-17T23:01:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.039+0000 7f9c99c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.039+0000 7f9c99c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60598/0 (socket says 172.21.15.67:60598) 2024-01-17T23:01:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.039+0000 7f9c99c00640 1 -- 172.21.15.67:0/4283830602 learned_addr learned my addr 172.21.15.67:0/4283830602 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.039+0000 7f9c99200640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94153780 0x7f9c9414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.039+0000 7f9c9a600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c9415d410 0x7f9c941efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 -- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c9415d410 msgr2=0x7f9c941efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c9415d410 0x7f9c941efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 -- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94153780 msgr2=0x7f9c9414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94153780 0x7f9c9414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 -- 172.21.15.67:0/4283830602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c009b30 con 0x7f9c940ca2f0 2024-01-17T23:01:07.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.047+0000 7f9c99c00640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e930 tx=0x7f9c8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:07.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.051+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84009690 con 0x7f9c940ca2f0 2024-01-17T23:01:07.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.051+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8400ca00 con 0x7f9c940ca2f0 2024-01-17T23:01:07.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.051+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400cd70 con 0x7f9c940ca2f0 2024-01-17T23:01:07.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.051+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c940ace20 con 0x7f9c940ca2f0 2024-01-17T23:01:07.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.055+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c941ef720 con 0x7f9c940ca2f0 2024-01-17T23:01:07.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.055+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940ad340 con 0x7f9c940ca2f0 2024-01-17T23:01:07.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.071+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f9c84013470 con 0x7f9c940ca2f0 2024-01-17T23:01:07.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.075+0000 7f9c91600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 0x7f9c6c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.075+0000 7f9c99200640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 0x7f9c6c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.075+0000 7f9c99200640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 0x7f9c6c068d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c940cafa0 tx=0x7f9c7c009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:07.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.075+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c84055b20 con 0x7f9c940ca2f0 2024-01-17T23:01:07.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.327+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f9c84051e60 con 0x7f9c940ca2f0 2024-01-17T23:01:07.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.519+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9c940746a0 con 0x7f9c940ca2f0 2024-01-17T23:01:07.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.523+0000 7f9c91600640 1 -- 172.21.15.67:0/4283830602 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9c84021080 con 0x7f9c940ca2f0 2024-01-17T23:01:07.531 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:07.531 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-17T23:01:07.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 msgr2=0x7f9c6c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 0x7f9c6c068d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c940cafa0 tx=0x7f9c7c009040 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 msgr2=0x7f9c940af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e930 tx=0x7f9c8400edf0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 shutdown_connections 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9c6c066890 0x7f9c6c068d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9c9415d410 0x7f9c941efc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94153780 0x7f9c9414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 --2- 172.21.15.67:0/4283830602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c940ca2f0 0x7f9c940af210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 >> 172.21.15.67:0/4283830602 conn(0x7f9c94070390 msgr2=0x7f9c94150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 shutdown_connections 2024-01-17T23:01:07.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.527+0000 7f9c9c600640 1 -- 172.21.15.67:0/4283830602 wait complete. 2024-01-17T23:01:07.553 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-17T23:01:07.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:01:07.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.687+0000 7f9ef7400640 1 Processor -- start 2024-01-17T23:01:07.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.687+0000 7f9ef7400640 1 -- start start 2024-01-17T23:01:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef7400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9ef015b620 0x7f9ef0061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef7400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00c7d10 con 0x7f9ef01517f0 2024-01-17T23:01:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef7400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef01576d0 con 0x7f9ef015b620 2024-01-17T23:01:07.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0157970 con 0x7f9ef0061640 2024-01-17T23:01:07.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef5400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:56028/0 (socket says 172.21.15.67:56028) 2024-01-17T23:01:07.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.691+0000 7f9ef5400640 1 -- 172.21.15.67:0/3683791437 learned_addr learned my addr 172.21.15.67:0/3683791437 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:07.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.695+0000 7f9eefe00640 1 --2- 172.21.15.67:0/3683791437 >> v2:172.21.15.137:3300/0 conn(0x7f9ef015b620 0x7f9ef0061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.699+0000 7f9ef5400640 1 -- 172.21.15.67:0/3683791437 >> v2:172.21.15.137:3300/0 conn(0x7f9ef015b620 msgr2=0x7f9ef0061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.699+0000 7f9ef5400640 1 --2- 172.21.15.67:0/3683791437 >> v2:172.21.15.137:3300/0 conn(0x7f9ef015b620 0x7f9ef0061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.699+0000 7f9ef5400640 1 -- 172.21.15.67:0/3683791437 >> v1:172.21.15.137:6789/0 conn(0x7f9ef01517f0 legacy=0x7f9ef00ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:07.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.699+0000 7f9ef5400640 1 -- 172.21.15.67:0/3683791437 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0157c50 con 0x7f9ef0061640 2024-01-17T23:01:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.791+0000 7f9ef5400640 1 --2- 172.21.15.67:0/3683791437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0061ca0 tx=0x7f9ee801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8331b5e9dc77641c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9eef400640 1 -- 172.21.15.67:0/3683791437 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80a5830 con 0x7f9ef0061640 2024-01-17T23:01:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9eef400640 1 -- 172.21.15.67:0/3683791437 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80a5990 con 0x7f9ef0061640 2024-01-17T23:01:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9eef400640 1 -- 172.21.15.67:0/3683791437 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80a5d20 con 0x7f9ef0061640 2024-01-17T23:01:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 -- 172.21.15.67:0/3683791437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 msgr2=0x7f9ef00c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 --2- 172.21.15.67:0/3683791437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0061ca0 tx=0x7f9ee801c990 comp rx=0 tx=0).stop 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 -- 172.21.15.67:0/3683791437 shutdown_connections 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 --2- 172.21.15.67:0/3683791437 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef0061640 0x7f9ef00c8a30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 --2- 172.21.15.67:0/3683791437 >> v2:172.21.15.137:3300/0 conn(0x7f9ef015b620 0x7f9ef0061100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 -- 172.21.15.67:0/3683791437 >> 172.21.15.67:0/3683791437 conn(0x7f9ef006ad40 msgr2=0x7f9ef006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 -- 172.21.15.67:0/3683791437 shutdown_connections 2024-01-17T23:01:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.803+0000 7f9ef7400640 1 -- 172.21.15.67:0/3683791437 wait complete. 2024-01-17T23:01:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 Processor -- start 2024-01-17T23:01:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 -- start start 2024-01-17T23:01:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef01517f0 0x7f9ef00cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ef015b620 0x7f9ef01f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01f1fa0 con 0x7f9ef0061640 2024-01-17T23:01:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00cb860 con 0x7f9ef015b620 2024-01-17T23:01:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef7400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01f21b0 con 0x7f9ef01517f0 2024-01-17T23:01:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef5400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ef015b620 0x7f9ef01f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60614/0 (socket says 172.21.15.67:60614) 2024-01-17T23:01:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.807+0000 7f9ef4a00640 1 -- 172.21.15.67:0/2978288128 learned_addr learned my addr 172.21.15.67:0/2978288128 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:07.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9eefe00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef01517f0 0x7f9ef00cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9ef4a00640 1 -- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef01517f0 msgr2=0x7f9ef00cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9ef4a00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef01517f0 0x7f9ef00cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9ef4a00640 1 -- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ef015b620 msgr2=0x7f9ef01f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9ef4a00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ef015b620 0x7f9ef01f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.811+0000 7f9ef4a00640 1 -- 172.21.15.67:0/2978288128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8009b30 con 0x7f9ef0061640 2024-01-17T23:01:07.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.815+0000 7f9ef4a00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c450 tx=0x7f9ee000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:07.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0012830 con 0x7f9ef0061640 2024-01-17T23:01:07.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00129b0 con 0x7f9ef0061640 2024-01-17T23:01:07.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef01f2490 con 0x7f9ef0061640 2024-01-17T23:01:07.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0012d60 con 0x7f9ef0061640 2024-01-17T23:01:07.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef01f2a50 con 0x7f9ef0061640 2024-01-17T23:01:07.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.819+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef006b620 con 0x7f9ef0061640 2024-01-17T23:01:07.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.839+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f9ee001c460 con 0x7f9ef0061640 2024-01-17T23:01:07.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.839+0000 7f9eecc00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 0x7f9ec8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:07.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.839+0000 7f9eefe00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 0x7f9ec8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:07.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:07.843+0000 7f9eefe00640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 0x7f9ec8068d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ef01f6610 tx=0x7f9ed8008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.087+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ee0055910 con 0x7f9ef0061640 2024-01-17T23:01:08.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.087+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f9ee0051c50 con 0x7f9ef0061640 2024-01-17T23:01:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.251+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ef00746a0 con 0x7f9ef0061640 2024-01-17T23:01:08.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.295+0000 7f9eecc00640 1 -- 172.21.15.67:0/2978288128 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f9ee0055270 con 0x7f9ef0061640 2024-01-17T23:01:08.302 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:08.303 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 msgr2=0x7f9ec8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 0x7f9ec8068d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ef01f6610 tx=0x7f9ed8008040 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 msgr2=0x7f9ef0161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c450 tx=0x7f9ee000c910 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 shutdown_connections 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f9ec8066890 0x7f9ec8068d50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ef015b620 0x7f9ef01f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9ef01517f0 0x7f9ef00cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 --2- 172.21.15.67:0/2978288128 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef0061640 0x7f9ef0161370 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 >> 172.21.15.67:0/2978288128 conn(0x7f9ef006ad40 msgr2=0x7f9ef0156540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 shutdown_connections 2024-01-17T23:01:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.299+0000 7f9ef7400640 1 -- 172.21.15.67:0/2978288128 wait complete. 2024-01-17T23:01:08.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T23:00:15.126108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T23:00:16.891955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T23:00:22.346907+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T23:01:08.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T23:01:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 Processor -- start 2024-01-17T23:01:08.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 -- start start 2024-01-17T23:01:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe184153780 0x7fe184159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1840ca2f0 0x7fe18406c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe18415d410 0x7fe184070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe184153b60 con 0x7fe184153780 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18406c710 con 0x7fe18415d410 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe18ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184159c40 con 0x7fe1840ca2f0 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe183e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe184153780 0x7fe184159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe183e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe184153780 0x7fe184159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60630/0 (socket says 172.21.15.67:60630) 2024-01-17T23:01:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.467+0000 7fe183e00640 1 -- 172.21.15.67:0/3105925819 learned_addr learned my addr 172.21.15.67:0/3105925819 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.471+0000 7fe183e00640 1 -- 172.21.15.67:0/3105925819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1840ca2f0 msgr2=0x7fe18406c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.471+0000 7fe183e00640 1 --2- 172.21.15.67:0/3105925819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1840ca2f0 0x7fe18406c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.471+0000 7fe183e00640 1 -- 172.21.15.67:0/3105925819 >> v2:172.21.15.137:3300/0 conn(0x7fe18415d410 msgr2=0x7fe184070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.471+0000 7fe183e00640 1 --2- 172.21.15.67:0/3105925819 >> v2:172.21.15.137:3300/0 conn(0x7fe18415d410 0x7fe184070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.471+0000 7fe183e00640 1 -- 172.21.15.67:0/3105925819 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184159f20 con 0x7fe184153780 2024-01-17T23:01:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.475+0000 7fe183e00640 1 --2- 172.21.15.67:0/3105925819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe184153780 0x7fe184159620 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1840aff80 tx=0x7fe17401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9b39e94784aed3 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe182a00640 1 -- 172.21.15.67:0/3105925819 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740a89b0 con 0x7fe184153780 2024-01-17T23:01:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe182a00640 1 -- 172.21.15.67:0/3105925819 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740a8b10 con 0x7fe184153780 2024-01-17T23:01:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe182a00640 1 -- 172.21.15.67:0/3105925819 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740a8ea0 con 0x7fe184153780 2024-01-17T23:01:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 -- 172.21.15.67:0/3105925819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe184153780 msgr2=0x7fe184159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 --2- 172.21.15.67:0/3105925819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe184153780 0x7fe184159620 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1840aff80 tx=0x7fe17401ecf0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 -- 172.21.15.67:0/3105925819 shutdown_connections 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 --2- 172.21.15.67:0/3105925819 >> v2:172.21.15.137:3300/0 conn(0x7fe18415d410 0x7fe184070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 --2- 172.21.15.67:0/3105925819 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1840ca2f0 0x7fe18406c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 --2- 172.21.15.67:0/3105925819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe184153780 0x7fe184159620 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 -- 172.21.15.67:0/3105925819 >> 172.21.15.67:0/3105925819 conn(0x7fe184070390 msgr2=0x7fe18406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:08.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 -- 172.21.15.67:0/3105925819 shutdown_connections 2024-01-17T23:01:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.479+0000 7fe18ae00640 1 -- 172.21.15.67:0/3105925819 wait complete. 2024-01-17T23:01:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 Processor -- start 2024-01-17T23:01:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 -- start start 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe184153780 0x7fe1841efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe18415d410 0x7fe1840cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184152e70 con 0x7fe1840ca2f0 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841ef6f0 con 0x7fe18415d410 2024-01-17T23:01:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe18ae00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841f3680 con 0x7fe184153780 2024-01-17T23:01:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe183e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe183e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60636/0 (socket says 172.21.15.67:60636) 2024-01-17T23:01:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.483+0000 7fe183e00640 1 -- 172.21.15.67:0/4059023695 learned_addr learned my addr 172.21.15.67:0/4059023695 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.487+0000 7fe183e00640 1 -- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe184153780 msgr2=0x7fe1841efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.487+0000 7fe183e00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe184153780 0x7fe1841efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.487+0000 7fe183e00640 1 -- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe18415d410 msgr2=0x7fe1840cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.487+0000 7fe183e00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe18415d410 0x7fe1840cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.487+0000 7fe183e00640 1 -- 172.21.15.67:0/4059023695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740094d0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.491+0000 7fe183e00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe17401c920 tx=0x7fe17401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:08.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740b0e20 con 0x7fe1840ca2f0 2024-01-17T23:01:08.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740ba440 con 0x7fe1840ca2f0 2024-01-17T23:01:08.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ba7f0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1841f2de0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1841f33a0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.495+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1840746a0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.515+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe1740ba950 con 0x7fe1840ca2f0 2024-01-17T23:01:08.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.515+0000 7fe17be00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 0x7fe15c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:08.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.515+0000 7fe183400640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 0x7fe15c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:08.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.519+0000 7fe183400640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 0x7fe15c068d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe184151e10 tx=0x7fe16c006ca0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:08.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.519+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1740f4280 con 0x7fe1840ca2f0 2024-01-17T23:01:08.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.767+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe1740efec0 con 0x7fe1840ca2f0 2024-01-17T23:01:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.935+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe184151b60 con 0x7fe1840ca2f0 2024-01-17T23:01:08.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.943+0000 7fe17be00640 1 -- 172.21.15.67:0/4059023695 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1740b5030 con 0x7fe1840ca2f0 2024-01-17T23:01:08.951 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T23:01:08.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 msgr2=0x7fe15c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 0x7fe15c068d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe184151e10 tx=0x7fe16c006ca0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 msgr2=0x7fe1841f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe17401c920 tx=0x7fe17401ba90 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 shutdown_connections 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe15c0668c0 0x7fe15c068d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe18415d410 0x7fe1840cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe184153780 0x7fe1841efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 --2- 172.21.15.67:0/4059023695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1840ca2f0 0x7fe1841f2750 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 >> 172.21.15.67:0/4059023695 conn(0x7fe184070390 msgr2=0x7fe184070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 shutdown_connections 2024-01-17T23:01:08.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:08.947+0000 7fe18ae00640 1 -- 172.21.15.67:0/4059023695 wait complete. 2024-01-17T23:01:08.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T23:01:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 Processor -- start 2024-01-17T23:01:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 -- start start 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406c8c0 0x7fa34406df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa34406cca0 0x7fa344153400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa34406d330 0x7fa344153940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34415a5e0 con 0x7fa34406d330 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34415cb70 con 0x7fa34406cca0 2024-01-17T23:01:09.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.115+0000 7fa34aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34415ce10 con 0x7fa34406c8c0 2024-01-17T23:01:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa34406d330 0x7fa344153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa34406d330 0x7fa344153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60650/0 (socket says 172.21.15.67:60650) 2024-01-17T23:01:09.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 -- 172.21.15.67:0/1006277613 learned_addr learned my addr 172.21.15.67:0/1006277613 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:09.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa343e00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406c8c0 0x7fa34406df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 -- 172.21.15.67:0/1006277613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406c8c0 msgr2=0x7fa34406df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:09.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406c8c0 0x7fa34406df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 -- 172.21.15.67:0/1006277613 >> v2:172.21.15.137:3300/0 conn(0x7fa34406cca0 msgr2=0x7fa344153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 --2- 172.21.15.67:0/1006277613 >> v2:172.21.15.137:3300/0 conn(0x7fa34406cca0 0x7fa344153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.119+0000 7fa348a00640 1 -- 172.21.15.67:0/1006277613 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34415d0f0 con 0x7fa34406d330 2024-01-17T23:01:09.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.127+0000 7fa348a00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa344153940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa344072ce0 tx=0x7fa33c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980dfe209d187e68 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa342a00640 1 -- 172.21.15.67:0/1006277613 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0a5850 con 0x7fa34406d330 2024-01-17T23:01:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa342a00640 1 -- 172.21.15.67:0/1006277613 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c0a59b0 con 0x7fa34406d330 2024-01-17T23:01:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa342a00640 1 -- 172.21.15.67:0/1006277613 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0a5d40 con 0x7fa34406d330 2024-01-17T23:01:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- 172.21.15.67:0/1006277613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 msgr2=0x7fa344153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa344153940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa344072ce0 tx=0x7fa33c01c9d0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- 172.21.15.67:0/1006277613 shutdown_connections 2024-01-17T23:01:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa344153940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 --2- 172.21.15.67:0/1006277613 >> v2:172.21.15.137:3300/0 conn(0x7fa34406cca0 0x7fa344153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 --2- 172.21.15.67:0/1006277613 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406c8c0 0x7fa34406df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- 172.21.15.67:0/1006277613 >> 172.21.15.67:0/1006277613 conn(0x7fa3440c7a90 msgr2=0x7fa3440c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- 172.21.15.67:0/1006277613 shutdown_connections 2024-01-17T23:01:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- 172.21.15.67:0/1006277613 wait complete. 2024-01-17T23:01:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 Processor -- start 2024-01-17T23:01:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.131+0000 7fa34aa00640 1 -- start start 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406c8c0 0x7fa3441f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406cca0 0x7fa344147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441f2080 con 0x7fa34406d330 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441f2600 con 0x7fa34406c8c0 2024-01-17T23:01:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa34aa00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441f2fd0 con 0x7fa34406cca0 2024-01-17T23:01:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa348a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa343e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406c8c0 0x7fa3441f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa348a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60666/0 (socket says 172.21.15.67:60666) 2024-01-17T23:01:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa348a00640 1 -- 172.21.15.67:0/976851719 learned_addr learned my addr 172.21.15.67:0/976851719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.135+0000 7fa343400640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406cca0 0x7fa344147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 -- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406cca0 msgr2=0x7fa344147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406cca0 0x7fa344147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 -- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406c8c0 msgr2=0x7fa3441f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406c8c0 0x7fa3441f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 -- 172.21.15.67:0/976851719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c009b30 con 0x7fa34406d330 2024-01-17T23:01:09.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.139+0000 7fa348a00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa33c01d270 tx=0x7fa33c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.143+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0bd070 con 0x7fa34406d330 2024-01-17T23:01:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.143+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c0b8680 con 0x7fa34406d330 2024-01-17T23:01:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.143+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0b8a70 con 0x7fa34406d330 2024-01-17T23:01:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.143+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34406e620 con 0x7fa34406d330 2024-01-17T23:01:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.143+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34414e8a0 con 0x7fa34406d330 2024-01-17T23:01:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.147+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3440746a0 con 0x7fa34406d330 2024-01-17T23:01:09.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.163+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa33c0b8bd0 con 0x7fa34406d330 2024-01-17T23:01:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.167+0000 7fa33be00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 0x7fa31c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.167+0000 7fa343e00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 0x7fa31c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.167+0000 7fa343e00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 0x7fa31c068d50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa334006aa0 tx=0x7fa334008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.167+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa33c0f0b50 con 0x7fa34406d330 2024-01-17T23:01:09.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.411+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa33c0ece90 con 0x7fa34406d330 2024-01-17T23:01:09.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.571+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3441f2740 con 0x7fa34406d330 2024-01-17T23:01:09.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.579+0000 7fa33be00640 1 -- 172.21.15.67:0/976851719 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa33c0f04b0 con 0x7fa34406d330 2024-01-17T23:01:09.586 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:01:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 msgr2=0x7fa31c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 0x7fa31c068d50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa334006aa0 tx=0x7fa334008040 comp rx=0 tx=0).stop 2024-01-17T23:01:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 msgr2=0x7fa34415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa33c01d270 tx=0x7fa33c019770 comp rx=0 tx=0).stop 2024-01-17T23:01:09.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 shutdown_connections 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa31c066890 0x7fa31c068d50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa34406d330 0x7fa34415ba80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa34406cca0 0x7fa344147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 --2- 172.21.15.67:0/976851719 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa34406c8c0 0x7fa3441f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 >> 172.21.15.67:0/976851719 conn(0x7fa3440c7a90 msgr2=0x7fa344157210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 shutdown_connections 2024-01-17T23:01:09.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.583+0000 7fa34aa00640 1 -- 172.21.15.67:0/976851719 wait complete. 2024-01-17T23:01:09.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T23:01:09.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 Processor -- start 2024-01-17T23:01:09.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 -- start start 2024-01-17T23:01:09.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec381516c0 0x7fec3806db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380c5cc0 con 0x7fec3806e090 2024-01-17T23:01:09.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec381575b0 con 0x7fec380c6e90 2024-01-17T23:01:09.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec3dc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec38158410 con 0x7fec381516c0 2024-01-17T23:01:09.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec36a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec381516c0 0x7fec3806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec36a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec381516c0 0x7fec3806db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60680/0 (socket says 172.21.15.67:60680) 2024-01-17T23:01:09.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.747+0000 7fec36a00640 1 -- 172.21.15.67:0/2334028626 learned_addr learned my addr 172.21.15.67:0/2334028626 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:09.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.751+0000 7fec36a00640 1 -- 172.21.15.67:0/2334028626 >> v1:172.21.15.137:6789/0 conn(0x7fec380c6e90 legacy=0x7fec380b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.751+0000 7fec36a00640 1 -- 172.21.15.67:0/2334028626 >> v1:172.21.15.67:6789/0 conn(0x7fec3806e090 legacy=0x7fec380c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.751+0000 7fec36a00640 1 -- 172.21.15.67:0/2334028626 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38157890 con 0x7fec381516c0 2024-01-17T23:01:09.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.755+0000 7fec36a00640 1 --2- 172.21.15.67:0/2334028626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec381516c0 0x7fec3806db50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efa9ca8529c35b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:09.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.759+0000 7fec35600640 1 -- 172.21.15.67:0/2334028626 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280a8a30 con 0x7fec381516c0 2024-01-17T23:01:09.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.759+0000 7fec35600640 1 -- 172.21.15.67:0/2334028626 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280a8b90 con 0x7fec381516c0 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.759+0000 7fec35600640 1 -- 172.21.15.67:0/2334028626 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280b0440 con 0x7fec381516c0 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- 172.21.15.67:0/2334028626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec381516c0 msgr2=0x7fec3806db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 --2- 172.21.15.67:0/2334028626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec381516c0 0x7fec3806db50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2801ed30 comp rx=0 tx=0).stop 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- 172.21.15.67:0/2334028626 shutdown_connections 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 --2- 172.21.15.67:0/2334028626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec381516c0 0x7fec3806db50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- 172.21.15.67:0/2334028626 >> 172.21.15.67:0/2334028626 conn(0x7fec380c7a90 msgr2=0x7fec380c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:09.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- 172.21.15.67:0/2334028626 shutdown_connections 2024-01-17T23:01:09.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- 172.21.15.67:0/2334028626 wait complete. 2024-01-17T23:01:09.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 Processor -- start 2024-01-17T23:01:09.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- start start 2024-01-17T23:01:09.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec380c6e90 0x7fec3814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec381516c0 0x7fec3806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:09.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec38146240 con 0x7fec3806e090 2024-01-17T23:01:09.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c1f20 con 0x7fec380c6e90 2024-01-17T23:01:09.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.763+0000 7fec3dc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec381ef1d0 con 0x7fec381516c0 2024-01-17T23:01:09.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.767+0000 7fec36a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.767+0000 7fec36a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60684/0 (socket says 172.21.15.67:60684) 2024-01-17T23:01:09.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.767+0000 7fec36a00640 1 -- 172.21.15.67:0/918111053 learned_addr learned my addr 172.21.15.67:0/918111053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:09.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.767+0000 7fec36000640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec380c6e90 0x7fec3814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.767+0000 7fec37400640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec381516c0 0x7fec3806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 -- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec381516c0 msgr2=0x7fec3806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec381516c0 0x7fec3806c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 -- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec380c6e90 msgr2=0x7fec3814d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec380c6e90 0x7fec3814d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:09.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 -- 172.21.15.67:0/918111053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280094d0 con 0x7fec3806e090 2024-01-17T23:01:09.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.771+0000 7fec36a00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec2801b940 tx=0x7fec2801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:09.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280be070 con 0x7fec3806e090 2024-01-17T23:01:09.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280b1b90 con 0x7fec3806e090 2024-01-17T23:01:09.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280b9440 con 0x7fec3806e090 2024-01-17T23:01:09.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec380c14b0 con 0x7fec3806e090 2024-01-17T23:01:09.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380c1960 con 0x7fec3806e090 2024-01-17T23:01:09.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:09.775+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380746a0 con 0x7fec3806e090 2024-01-17T23:01:10.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.031+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fec280b7070 con 0x7fec3806e090 2024-01-17T23:01:10.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.035+0000 7fec2ea00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 0x7fec10068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.035+0000 7fec36000640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 0x7fec10068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.035+0000 7fec36000640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 0x7fec10068d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec3806df10 tx=0x7fec20009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:10.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.047+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec280f2d20 con 0x7fec3806e090 2024-01-17T23:01:10.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.047+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fec280ef060 con 0x7fec3806e090 2024-01-17T23:01:10.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.207+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec3806d470 con 0x7fec3806e090 2024-01-17T23:01:10.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec2ea00640 1 -- 172.21.15.67:0/918111053 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec280b5030 con 0x7fec3806e090 2024-01-17T23:01:10.221 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 msgr2=0x7fec10068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 0x7fec10068d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec3806df10 tx=0x7fec20009040 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 msgr2=0x7fec38145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec2801b940 tx=0x7fec2801bad0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 shutdown_connections 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fec10066890 0x7fec10068d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fec381516c0 0x7fec3806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec380c6e90 0x7fec3814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 --2- 172.21.15.67:0/918111053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec3806e090 0x7fec38145d00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 >> 172.21.15.67:0/918111053 conn(0x7fec380c7a90 msgr2=0x7fec3814f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:10.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 shutdown_connections 2024-01-17T23:01:10.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.215+0000 7fec3dc00640 1 -- 172.21.15.67:0/918111053 wait complete. 2024-01-17T23:01:10.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T23:01:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.383+0000 7fedbc000640 1 Processor -- start 2024-01-17T23:01:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.383+0000 7fedbc000640 1 -- start start 2024-01-17T23:01:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedbc000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fedb4153970 0x7fedb406d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedbc000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fedb415ce20 0x7fedb415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedbc000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40c9900 con 0x7fedb406e650 2024-01-17T23:01:10.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedbc000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb406dd70 con 0x7fedb4153970 2024-01-17T23:01:10.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedbc000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb415d7f0 con 0x7fedb415ce20 2024-01-17T23:01:10.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedb9600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fedb4153970 0x7fedb406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedb8c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fedb406e650 0x7fedb40cbfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41536/0 (socket says 172.21.15.67:41536) 2024-01-17T23:01:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedb8c00640 1 -- 172.21.15.67:0/4188751217 learned_addr learned my addr 172.21.15.67:0/4188751217 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.387+0000 7fedba000640 1 --2- 172.21.15.67:0/4188751217 >> v2:172.21.15.137:3300/0 conn(0x7fedb415ce20 0x7fedb415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.391+0000 7fedb9600640 1 -- 172.21.15.67:0/4188751217 >> v2:172.21.15.137:3300/0 conn(0x7fedb415ce20 msgr2=0x7fedb415d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.391+0000 7fedb9600640 1 --2- 172.21.15.67:0/4188751217 >> v2:172.21.15.137:3300/0 conn(0x7fedb415ce20 0x7fedb415d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.391+0000 7fedb9600640 1 -- 172.21.15.67:0/4188751217 >> v1:172.21.15.67:6789/0 conn(0x7fedb406e650 legacy=0x7fedb40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.391+0000 7fedb9600640 1 -- 172.21.15.67:0/4188751217 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb406b5d0 con 0x7fedb4153970 2024-01-17T23:01:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.395+0000 7fedb9600640 1 --2- 172.21.15.67:0/4188751217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb406d830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedb406b090 tx=0x7feda401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7130a88c1e5218d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedb3e00640 1 -- 172.21.15.67:0/4188751217 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40ab600 con 0x7fedb4153970 2024-01-17T23:01:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedb3e00640 1 -- 172.21.15.67:0/4188751217 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda40a7050 con 0x7fedb4153970 2024-01-17T23:01:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedb3e00640 1 -- 172.21.15.67:0/4188751217 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40ab980 con 0x7fedb4153970 2024-01-17T23:01:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 -- 172.21.15.67:0/4188751217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 msgr2=0x7fedb406d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 --2- 172.21.15.67:0/4188751217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb406d830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedb406b090 tx=0x7feda401c340 comp rx=0 tx=0).stop 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 -- 172.21.15.67:0/4188751217 shutdown_connections 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 --2- 172.21.15.67:0/4188751217 >> v2:172.21.15.137:3300/0 conn(0x7fedb415ce20 0x7fedb415d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 --2- 172.21.15.67:0/4188751217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb406d830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 -- 172.21.15.67:0/4188751217 >> 172.21.15.67:0/4188751217 conn(0x7fedb406b7f0 msgr2=0x7fedb406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 -- 172.21.15.67:0/4188751217 shutdown_connections 2024-01-17T23:01:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.399+0000 7fedbc000640 1 -- 172.21.15.67:0/4188751217 wait complete. 2024-01-17T23:01:10.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 Processor -- start 2024-01-17T23:01:10.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 -- start start 2024-01-17T23:01:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedb406e650 0x7fedb40c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedb415ce20 0x7fedb41f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40cb2e0 con 0x7fedb4153970 2024-01-17T23:01:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41f52a0 con 0x7fedb415ce20 2024-01-17T23:01:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedbc000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40cb730 con 0x7fedb406e650 2024-01-17T23:01:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedb8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedb8c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60708/0 (socket says 172.21.15.67:60708) 2024-01-17T23:01:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedb8c00640 1 -- 172.21.15.67:0/3541858914 learned_addr learned my addr 172.21.15.67:0/3541858914 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedba000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedb415ce20 0x7fedb41f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.403+0000 7fedb9600640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedb406e650 0x7fedb40c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.407+0000 7fedb8c00640 1 -- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedb406e650 msgr2=0x7fedb40c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.407+0000 7fedb8c00640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedb406e650 0x7fedb40c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.407+0000 7fedb8c00640 1 -- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedb415ce20 msgr2=0x7fedb41f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.407+0000 7fedb8c00640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedb415ce20 0x7fedb41f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.407+0000 7fedb8c00640 1 -- 172.21.15.67:0/3541858914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4009420 con 0x7fedb4153970 2024-01-17T23:01:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.411+0000 7fedb8c00640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c420 tx=0x7fed9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c005cf0 con 0x7fedb4153970 2024-01-17T23:01:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c005e50 con 0x7fedb4153970 2024-01-17T23:01:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0072f0 con 0x7fedb4153970 2024-01-17T23:01:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40cba10 con 0x7fedb4153970 2024-01-17T23:01:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40cbfd0 con 0x7fedb4153970 2024-01-17T23:01:10.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.415+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40746a0 con 0x7fedb4153970 2024-01-17T23:01:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.435+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fed9c007450 con 0x7fedb4153970 2024-01-17T23:01:10.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.435+0000 7fedb1600640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 0x7fed8c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:10.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.435+0000 7fedb9600640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 0x7fed8c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:10.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.439+0000 7fedb9600640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 0x7fed8c068d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda40a6000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.683+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed9c013e70 con 0x7fedb4153970 2024-01-17T23:01:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.683+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fed9c050d70 con 0x7fedb4153970 2024-01-17T23:01:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.855+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fedb4070a00 con 0x7fedb4153970 2024-01-17T23:01:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.859+0000 7fedb1600640 1 -- 172.21.15.67:0/3541858914 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fed9c017070 con 0x7fedb4153970 2024-01-17T23:01:10.868 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 msgr2=0x7fed8c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 0x7fed8c068d50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda40a6000 comp rx=0 tx=0).stop 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 msgr2=0x7fedb40c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c420 tx=0x7fed9c00c8e0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 shutdown_connections 2024-01-17T23:01:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed8c066890 0x7fed8c068d50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedb415ce20 0x7fedb41f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fedb4153970 0x7fedb40c7dc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 --2- 172.21.15.67:0/3541858914 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fedb406e650 0x7fedb40c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 >> 172.21.15.67:0/3541858914 conn(0x7fedb406b7f0 msgr2=0x7fedb415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 shutdown_connections 2024-01-17T23:01:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:10.863+0000 7fedbc000640 1 -- 172.21.15.67:0/3541858914 wait complete. 2024-01-17T23:01:10.890 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:01:11.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 Processor -- start 2024-01-17T23:01:11.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 -- start start 2024-01-17T23:01:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a14157bc0 0x7f7a14158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a14158550 con 0x7f7a141517a0 2024-01-17T23:01:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1415b9c0 con 0x7f7a14157bc0 2024-01-17T23:01:11.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a1ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1415ae40 con 0x7f7a14072300 2024-01-17T23:01:11.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a13400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a13400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:46358/0 (socket says 172.21.15.67:46358) 2024-01-17T23:01:11.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a13400640 1 -- 172.21.15.67:0/1561537211 learned_addr learned my addr 172.21.15.67:0/1561537211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:11.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.027+0000 7f7a18c00640 1 --2- 172.21.15.67:0/1561537211 >> v2:172.21.15.137:3300/0 conn(0x7f7a14157bc0 0x7f7a14158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.039+0000 7f7a13400640 1 -- 172.21.15.67:0/1561537211 >> v2:172.21.15.137:3300/0 conn(0x7f7a14157bc0 msgr2=0x7f7a14158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.039+0000 7f7a13400640 1 --2- 172.21.15.67:0/1561537211 >> v2:172.21.15.137:3300/0 conn(0x7f7a14157bc0 0x7f7a14158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.039+0000 7f7a13400640 1 -- 172.21.15.67:0/1561537211 >> v1:172.21.15.137:6789/0 conn(0x7f7a141517a0 legacy=0x7f7a1406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.039+0000 7f7a13400640 1 -- 172.21.15.67:0/1561537211 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1415b120 con 0x7f7a14072300 2024-01-17T23:01:11.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.051+0000 7f7a13400640 1 --2- 172.21.15.67:0/1561537211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009870 tx=0x7f79fc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c6b6787ad2cd82 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a12a00640 1 -- 172.21.15.67:0/1561537211 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0a7070 con 0x7f7a14072300 2024-01-17T23:01:11.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a12a00640 1 -- 172.21.15.67:0/1561537211 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0ab430 con 0x7f7a14072300 2024-01-17T23:01:11.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a12a00640 1 -- 172.21.15.67:0/1561537211 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0ab7c0 con 0x7f7a14072300 2024-01-17T23:01:11.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1561537211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 msgr2=0x7f7a14072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1561537211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009870 tx=0x7f79fc01c540 comp rx=0 tx=0).stop 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1561537211 shutdown_connections 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1561537211 >> v2:172.21.15.137:3300/0 conn(0x7f7a14157bc0 0x7f7a14158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1561537211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a14072740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1561537211 >> 172.21.15.67:0/1561537211 conn(0x7f7a140cb070 msgr2=0x7f7a140cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1561537211 shutdown_connections 2024-01-17T23:01:11.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1561537211 wait complete. 2024-01-17T23:01:11.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 Processor -- start 2024-01-17T23:01:11.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- start start 2024-01-17T23:01:11.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a140c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a14157bc0 0x7f7a140c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141574f0 con 0x7f7a141517a0 2024-01-17T23:01:11.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14144f00 con 0x7f7a14157bc0 2024-01-17T23:01:11.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a1ac00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a140c0090 con 0x7f7a14072300 2024-01-17T23:01:11.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a13400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a13400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50782/0 (socket says 172.21.15.67:50782) 2024-01-17T23:01:11.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a13400640 1 -- 172.21.15.67:0/1206955094 learned_addr learned my addr 172.21.15.67:0/1206955094 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:11.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.063+0000 7f7a18c00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a14157bc0 0x7f7a140c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 -- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 msgr2=0x7f7a140c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a140c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 -- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a14157bc0 msgr2=0x7f7a140c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a14157bc0 0x7f7a140c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 -- 172.21.15.67:0/1206955094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0094d0 con 0x7f7a141517a0 2024-01-17T23:01:11.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a13400640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0ad040 tx=0x7f79fc0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0ba070 con 0x7f7a141517a0 2024-01-17T23:01:11.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0b4420 con 0x7f7a141517a0 2024-01-17T23:01:11.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a14159230 con 0x7f7a141517a0 2024-01-17T23:01:11.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.071+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0b47d0 con 0x7f7a141517a0 2024-01-17T23:01:11.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.075+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a141597f0 con 0x7f7a141517a0 2024-01-17T23:01:11.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.075+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a140746a0 con 0x7f7a141517a0 2024-01-17T23:01:11.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.335+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f79fc0b4930 con 0x7f7a141517a0 2024-01-17T23:01:11.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.335+0000 7f7a0be00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 0x7f79ec068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.335+0000 7f7a13e00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 0x7f79ec068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.335+0000 7f7a13e00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 0x7f79ec068d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a040079e0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.347+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79fc0ef6b0 con 0x7f7a141517a0 2024-01-17T23:01:11.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.347+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f79fc0eb2f0 con 0x7f7a141517a0 2024-01-17T23:01:11.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.543+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a140c9130 con 0x7f7a141517a0 2024-01-17T23:01:11.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.559+0000 7f7a0be00640 1 -- 172.21.15.67:0/1206955094 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6555 (secure 0 0 0) 0x7f79fc0ee910 con 0x7f7a141517a0 2024-01-17T23:01:11.564 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:11.564 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:57.312320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T23:01:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 msgr2=0x7f79ec068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 0x7f79ec068d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a040079e0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 msgr2=0x7f7a14071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0ad040 tx=0x7f79fc0192e0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 shutdown_connections 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79ec066890 0x7f79ec068d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a14157bc0 0x7f7a140c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a141517a0 0x7f7a14071430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 --2- 172.21.15.67:0/1206955094 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7a14072300 0x7f7a140c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 >> 172.21.15.67:0/1206955094 conn(0x7f7a140cb070 msgr2=0x7f7a14161450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 shutdown_connections 2024-01-17T23:01:11.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.563+0000 7f7a1ac00640 1 -- 172.21.15.67:0/1206955094 wait complete. 2024-01-17T23:01:11.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:01:11.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.723+0000 7f8179200640 1 Processor -- start 2024-01-17T23:01:11.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.723+0000 7f8179200640 1 -- start start 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f817406cf50 0x7f817415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f817406c840 0x7f81741568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f8174156e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81740720a0 con 0x7f817406c840 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8174072b80 con 0x7f817406cf50 2024-01-17T23:01:11.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8179200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8174157350 con 0x7f817406d330 2024-01-17T23:01:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f817406c840 0x7f81741568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f817406c840 0x7f81741568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50786/0 (socket says 172.21.15.67:50786) 2024-01-17T23:01:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 -- 172.21.15.67:0/2747285571 learned_addr learned my addr 172.21.15.67:0/2747285571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8172800640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f8174156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171e00640 1 --2- 172.21.15.67:0/2747285571 >> v2:172.21.15.137:3300/0 conn(0x7f817406cf50 0x7f817415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 -- 172.21.15.67:0/2747285571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 msgr2=0x7f8174156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:11.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f8174156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 -- 172.21.15.67:0/2747285571 >> v2:172.21.15.137:3300/0 conn(0x7f817406cf50 msgr2=0x7f817415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:11.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 --2- 172.21.15.67:0/2747285571 >> v2:172.21.15.137:3300/0 conn(0x7f817406cf50 0x7f817415ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.727+0000 7f8171400640 1 -- 172.21.15.67:0/2747285571 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740728a0 con 0x7f817406c840 2024-01-17T23:01:11.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.731+0000 7f8171400640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406c840 0x7f81741568d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8174072d50 tx=0x7f815c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540af4af6661e609 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.735+0000 7f8170a00640 1 -- 172.21.15.67:0/2747285571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0ab650 con 0x7f817406c840 2024-01-17T23:01:11.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.735+0000 7f8170a00640 1 -- 172.21.15.67:0/2747285571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0ab7b0 con 0x7f817406c840 2024-01-17T23:01:11.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.735+0000 7f8170a00640 1 -- 172.21.15.67:0/2747285571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0abb40 con 0x7f817406c840 2024-01-17T23:01:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- 172.21.15.67:0/2747285571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406c840 msgr2=0x7f81741568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406c840 0x7f81741568d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8174072d50 tx=0x7f815c01c4d0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- 172.21.15.67:0/2747285571 shutdown_connections 2024-01-17T23:01:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f8174156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- 172.21.15.67:0/2747285571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406c840 0x7f81741568d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- 172.21.15.67:0/2747285571 >> v2:172.21.15.137:3300/0 conn(0x7f817406cf50 0x7f817415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- 172.21.15.67:0/2747285571 >> 172.21.15.67:0/2747285571 conn(0x7f81740cb070 msgr2=0x7f81740cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- 172.21.15.67:0/2747285571 shutdown_connections 2024-01-17T23:01:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- 172.21.15.67:0/2747285571 wait complete. 2024-01-17T23:01:11.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 Processor -- start 2024-01-17T23:01:11.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- start start 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f817406c840 0x7f817414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f817414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174156340 con 0x7f817406cf50 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174156820 con 0x7f817406c840 2024-01-17T23:01:11.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.739+0000 7f8179200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8174155d30 con 0x7f817406d330 2024-01-17T23:01:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.743+0000 7f8171400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.743+0000 7f8171400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50796/0 (socket says 172.21.15.67:50796) 2024-01-17T23:01:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.743+0000 7f8171400640 1 -- 172.21.15.67:0/3180783233 learned_addr learned my addr 172.21.15.67:0/3180783233 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.743+0000 7f8172800640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f817414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.743+0000 7f8171e00640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f817406c840 0x7f817414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 -- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 msgr2=0x7f817414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f817414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 -- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f817406c840 msgr2=0x7f817414a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f817406c840 0x7f817414a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:11.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 -- 172.21.15.67:0/3180783233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0094d0 con 0x7f817406cf50 2024-01-17T23:01:11.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.747+0000 7f8171400640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f815c01cd70 tx=0x7f815c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0be5f0 con 0x7f817406cf50 2024-01-17T23:01:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0be770 con 0x7f817406cf50 2024-01-17T23:01:11.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c0beb20 con 0x7f817406cf50 2024-01-17T23:01:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81741f2e00 con 0x7f817406cf50 2024-01-17T23:01:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81741f30e0 con 0x7f817406cf50 2024-01-17T23:01:11.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.751+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81740746a0 con 0x7f817406cf50 2024-01-17T23:01:11.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.771+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f815c0b4600 con 0x7f817406cf50 2024-01-17T23:01:11.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.771+0000 7f816a000640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 0x7f814c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:11.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.775+0000 7f8171e00640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 0x7f814c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:11.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.775+0000 7f8171e00640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 0x7f814c068d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81640045f0 tx=0x7f8164008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:11.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:11.775+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f815c0f0630 con 0x7f817406cf50 2024-01-17T23:01:12.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.019+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f815c0ec970 con 0x7f817406cf50 2024-01-17T23:01:12.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.183+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81740c7560 con 0x7f817406cf50 2024-01-17T23:01:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f816a000640 1 -- 172.21.15.67:0/3180783233 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f815c0eff90 con 0x7f817406cf50 2024-01-17T23:01:12.228 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:12.229 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 msgr2=0x7f814c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 0x7f814c068d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81640045f0 tx=0x7f8164008040 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 msgr2=0x7f817414fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f815c01cd70 tx=0x7f815c01ad10 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 shutdown_connections 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f814c066890 0x7f814c068d50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f817406d330 0x7f817414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f817406cf50 0x7f817414fa60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 --2- 172.21.15.67:0/3180783233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f817406c840 0x7f817414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 >> 172.21.15.67:0/3180783233 conn(0x7f81740cb070 msgr2=0x7f81740c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 shutdown_connections 2024-01-17T23:01:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.227+0000 7f8179200640 1 -- 172.21.15.67:0/3180783233 wait complete. 2024-01-17T23:01:12.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T23:00:15.126108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T23:00:16.891955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T23:00:22.346907+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-17T23:01:12.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-17T23:01:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 Processor -- start 2024-01-17T23:01:12.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 -- start start 2024-01-17T23:01:12.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f56340c5dd0 0x7f56340c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:12.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340bffb0 con 0x7f56341506b0 2024-01-17T23:01:12.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340c6720 con 0x7f5634156300 2024-01-17T23:01:12.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5639e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5634150a90 con 0x7f56340c5dd0 2024-01-17T23:01:12.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5632000640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5634156300 0x7f563406d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:49536/0 (socket says 172.21.15.67:49536) 2024-01-17T23:01:12.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.395+0000 7f5632000640 1 -- 172.21.15.67:0/2705443974 learned_addr learned my addr 172.21.15.67:0/2705443974 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:12.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.443+0000 7f5633400640 1 --2- 172.21.15.67:0/2705443974 >> v2:172.21.15.67:3300/0 conn(0x7f56340c5dd0 0x7f56340c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.447+0000 7f5633400640 1 -- 172.21.15.67:0/2705443974 >> v1:172.21.15.137:6789/0 conn(0x7f5634156300 legacy=0x7f563406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.447+0000 7f5633400640 1 -- 172.21.15.67:0/2705443974 >> v1:172.21.15.67:6789/0 conn(0x7f56341506b0 legacy=0x7f56340c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.447+0000 7f5633400640 1 -- 172.21.15.67:0/2705443974 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340b1130 con 0x7f56340c5dd0 2024-01-17T23:01:12.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.455+0000 7f5633400640 1 --2- 172.21.15.67:0/2705443974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f56340c61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f562c009d90 tx=0x7f562c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caf4461faaa5697 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.455+0000 7f5631600640 1 -- 172.21.15.67:0/2705443974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0a59e0 con 0x7f56340c5dd0 2024-01-17T23:01:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.455+0000 7f5631600640 1 -- 172.21.15.67:0/2705443974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c0a5b40 con 0x7f56340c5dd0 2024-01-17T23:01:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.455+0000 7f5631600640 1 -- 172.21.15.67:0/2705443974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0ad440 con 0x7f56340c5dd0 2024-01-17T23:01:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- 172.21.15.67:0/2705443974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 msgr2=0x7f56340c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 --2- 172.21.15.67:0/2705443974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f56340c61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f562c009d90 tx=0x7f562c01c920 comp rx=0 tx=0).stop 2024-01-17T23:01:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- 172.21.15.67:0/2705443974 shutdown_connections 2024-01-17T23:01:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 --2- 172.21.15.67:0/2705443974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f56340c61e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- 172.21.15.67:0/2705443974 >> 172.21.15.67:0/2705443974 conn(0x7f56340c7a90 msgr2=0x7f56340c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- 172.21.15.67:0/2705443974 shutdown_connections 2024-01-17T23:01:12.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- 172.21.15.67:0/2705443974 wait complete. 2024-01-17T23:01:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 Processor -- start 2024-01-17T23:01:12.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 -- start start 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.459+0000 7f5639e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5639e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56341506b0 0x7f563414a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5639e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5634156300 0x7f56341f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5639e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56341442f0 con 0x7f56340c5dd0 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5639e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340ad940 con 0x7f56341506b0 2024-01-17T23:01:12.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5639e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563414ef30 con 0x7f5634156300 2024-01-17T23:01:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5632a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5632a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50824/0 (socket says 172.21.15.67:50824) 2024-01-17T23:01:12.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.463+0000 7f5632a00640 1 -- 172.21.15.67:0/2836399126 learned_addr learned my addr 172.21.15.67:0/2836399126 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:12.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 -- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5634156300 msgr2=0x7f56341f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5634156300 0x7f56341f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 -- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56341506b0 msgr2=0x7f563414a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56341506b0 0x7f563414a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 -- 172.21.15.67:0/2836399126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c009a70 con 0x7f56340c5dd0 2024-01-17T23:01:12.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.467+0000 7f5632a00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f562400c420 tx=0x7f562400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.471+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240052d0 con 0x7f56340c5dd0 2024-01-17T23:01:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.471+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624005430 con 0x7f56340c5dd0 2024-01-17T23:01:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.471+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624007260 con 0x7f56340c5dd0 2024-01-17T23:01:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.471+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563414f860 con 0x7f56340c5dd0 2024-01-17T23:01:12.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.471+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340af460 con 0x7f56340c5dd0 2024-01-17T23:01:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.475+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340746a0 con 0x7f56340c5dd0 2024-01-17T23:01:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.731+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f56240073c0 con 0x7f56340c5dd0 2024-01-17T23:01:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.731+0000 7f562b400640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 0x7f560c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.731+0000 7f5632000640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 0x7f560c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.731+0000 7f5632000640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 0x7f560c068d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56340c0e20 tx=0x7f561c007a50 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:12.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.755+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5624007670 con 0x7f56340c5dd0 2024-01-17T23:01:12.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.755+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f5624050c70 con 0x7f56340c5dd0 2024-01-17T23:01:12.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.919+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56340b0b00 con 0x7f56340c5dd0 2024-01-17T23:01:12.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f562b400640 1 -- 172.21.15.67:0/2836399126 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5624020070 con 0x7f56340c5dd0 2024-01-17T23:01:12.929 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 msgr2=0x7f560c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 0x7f560c068d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56340c0e20 tx=0x7f561c007a50 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 msgr2=0x7f563414e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f562400c420 tx=0x7f562400c8e0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 shutdown_connections 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f560c0668c0 0x7f560c068d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f5634156300 0x7f56341f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56341506b0 0x7f563414a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 --2- 172.21.15.67:0/2836399126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56340c5dd0 0x7f563414e4f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.927+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 >> 172.21.15.67:0/2836399126 conn(0x7f56340c7a90 msgr2=0x7f563406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.931+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 shutdown_connections 2024-01-17T23:01:12.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:12.931+0000 7f5639e00640 1 -- 172.21.15.67:0/2836399126 wait complete. 2024-01-17T23:01:12.952 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-17T23:01:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 Processor -- start 2024-01-17T23:01:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 -- start start 2024-01-17T23:01:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a80159620 0x7f0a8015d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a8015d8c0 0x7f0a80070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8015cc10 con 0x7f0a801536c0 2024-01-17T23:01:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8015cf60 con 0x7f0a80159620 2024-01-17T23:01:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a87e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a800ca990 con 0x7f0a8015d8c0 2024-01-17T23:01:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a84a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a80159620 0x7f0a8015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a84a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0a80159620 0x7f0a8015d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50840/0 (socket says 172.21.15.67:50840) 2024-01-17T23:01:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a84a00640 1 -- 172.21.15.67:0/697727571 learned_addr learned my addr 172.21.15.67:0/697727571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.095+0000 7f0a85e00640 1 --2- 172.21.15.67:0/697727571 >> v2:172.21.15.137:3300/0 conn(0x7f0a8015d8c0 0x7f0a80070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.099+0000 7f0a84a00640 1 -- 172.21.15.67:0/697727571 >> v2:172.21.15.137:3300/0 conn(0x7f0a8015d8c0 msgr2=0x7f0a80070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.099+0000 7f0a84a00640 1 --2- 172.21.15.67:0/697727571 >> v2:172.21.15.137:3300/0 conn(0x7f0a8015d8c0 0x7f0a80070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.099+0000 7f0a84a00640 1 -- 172.21.15.67:0/697727571 >> v1:172.21.15.137:6789/0 conn(0x7f0a801536c0 legacy=0x7f0a800ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.099+0000 7f0a84a00640 1 -- 172.21.15.67:0/697727571 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800c86f0 con 0x7f0a80159620 2024-01-17T23:01:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.103+0000 7f0a84a00640 1 --2- 172.21.15.67:0/697727571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a80159620 0x7f0a8015d380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a8006d9b0 tx=0x7f0a6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5feb086aff4098ea server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:13.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a7fe00640 1 -- 172.21.15.67:0/697727571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680ac640 con 0x7f0a80159620 2024-01-17T23:01:13.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a7fe00640 1 -- 172.21.15.67:0/697727571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a680ac7a0 con 0x7f0a80159620 2024-01-17T23:01:13.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a7fe00640 1 -- 172.21.15.67:0/697727571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680acb30 con 0x7f0a80159620 2024-01-17T23:01:13.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 -- 172.21.15.67:0/697727571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a80159620 msgr2=0x7f0a8015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 --2- 172.21.15.67:0/697727571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a80159620 0x7f0a8015d380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a8006d9b0 tx=0x7f0a6801c4d0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 -- 172.21.15.67:0/697727571 shutdown_connections 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 --2- 172.21.15.67:0/697727571 >> v2:172.21.15.137:3300/0 conn(0x7f0a8015d8c0 0x7f0a80070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 --2- 172.21.15.67:0/697727571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a80159620 0x7f0a8015d380 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 -- 172.21.15.67:0/697727571 >> 172.21.15.67:0/697727571 conn(0x7f0a80070390 msgr2=0x7f0a8006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 -- 172.21.15.67:0/697727571 shutdown_connections 2024-01-17T23:01:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.107+0000 7f0a87e00640 1 -- 172.21.15.67:0/697727571 wait complete. 2024-01-17T23:01:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 Processor -- start 2024-01-17T23:01:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 -- start start 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a80159620 0x7f0a800b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a8015d8c0 0x7f0a800ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801505c0 con 0x7f0a801536c0 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800accd0 con 0x7f0a8015d8c0 2024-01-17T23:01:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a87e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800ccc30 con 0x7f0a80159620 2024-01-17T23:01:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a85400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a85400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50842/0 (socket says 172.21.15.67:50842) 2024-01-17T23:01:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a85400640 1 -- 172.21.15.67:0/2768890308 learned_addr learned my addr 172.21.15.67:0/2768890308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a84a00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a80159620 0x7f0a800b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.111+0000 7f0a85e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a8015d8c0 0x7f0a800ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.115+0000 7f0a85400640 1 -- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a80159620 msgr2=0x7f0a800b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.115+0000 7f0a85400640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a80159620 0x7f0a800b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.115+0000 7f0a85400640 1 -- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a8015d8c0 msgr2=0x7f0a800ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.115+0000 7f0a85400640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a8015d8c0 0x7f0a800ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.115+0000 7f0a85400640 1 -- 172.21.15.67:0/2768890308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680094d0 con 0x7f0a801536c0 2024-01-17T23:01:13.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.119+0000 7f0a85400640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c3a0 tx=0x7f0a7000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700052d0 con 0x7f0a801536c0 2024-01-17T23:01:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70005430 con 0x7f0a801536c0 2024-01-17T23:01:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70007260 con 0x7f0a801536c0 2024-01-17T23:01:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a801507b0 con 0x7f0a801536c0 2024-01-17T23:01:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a800cd180 con 0x7f0a801536c0 2024-01-17T23:01:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.123+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800746a0 con 0x7f0a801536c0 2024-01-17T23:01:13.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.143+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0a700073c0 con 0x7f0a801536c0 2024-01-17T23:01:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.143+0000 7f0a7d600640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 0x7f0a58068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.143+0000 7f0a84a00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 0x7f0a58068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.147+0000 7f0a84a00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 0x7f0a58068d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a680ae000 tx=0x7f0a680a7000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.387+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a70007670 con 0x7f0a801536c0 2024-01-17T23:01:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.387+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f0a70050f30 con 0x7f0a801536c0 2024-01-17T23:01:13.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.551+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a8014d750 con 0x7f0a801536c0 2024-01-17T23:01:13.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a7d600640 1 -- 172.21.15.67:0/2768890308 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a70020020 con 0x7f0a801536c0 2024-01-17T23:01:13.560 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:01:13.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 msgr2=0x7f0a58068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 0x7f0a58068d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a680ae000 tx=0x7f0a680a7000 comp rx=0 tx=0).stop 2024-01-17T23:01:13.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 msgr2=0x7f0a800b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c3a0 tx=0x7f0a7000c860 comp rx=0 tx=0).stop 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 shutdown_connections 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0a58066890 0x7f0a58068d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a8015d8c0 0x7f0a800ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f0a80159620 0x7f0a800b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 --2- 172.21.15.67:0/2768890308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a801536c0 0x7f0a800b15a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 >> 172.21.15.67:0/2768890308 conn(0x7f0a80070390 msgr2=0x7f0a80146800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 shutdown_connections 2024-01-17T23:01:13.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.559+0000 7f0a87e00640 1 -- 172.21.15.67:0/2768890308 wait complete. 2024-01-17T23:01:13.582 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-17T23:01:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 Processor -- start 2024-01-17T23:01:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 -- start start 2024-01-17T23:01:13.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f236c153780 0x7f236c159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236c159c40 con 0x7f236c0ca2f0 2024-01-17T23:01:13.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236c153b60 con 0x7f236c153780 2024-01-17T23:01:13.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.723+0000 7f2374400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c159f20 con 0x7f236c15d410 2024-01-17T23:01:13.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.727+0000 7f2372400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.727+0000 7f2371a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f236c153780 0x7f236c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.727+0000 7f2372400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:46418/0 (socket says 172.21.15.67:46418) 2024-01-17T23:01:13.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.727+0000 7f2372400640 1 -- 172.21.15.67:0/3314534211 learned_addr learned my addr 172.21.15.67:0/3314534211 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:13.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.731+0000 7f2372400640 1 -- 172.21.15.67:0/3314534211 >> v2:172.21.15.137:3300/0 conn(0x7f236c153780 msgr2=0x7f236c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:13.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.731+0000 7f2372400640 1 --2- 172.21.15.67:0/3314534211 >> v2:172.21.15.137:3300/0 conn(0x7f236c153780 0x7f236c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.731+0000 7f2372400640 1 -- 172.21.15.67:0/3314534211 >> v1:172.21.15.137:6789/0 conn(0x7f236c0ca2f0 legacy=0x7f236c06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.731+0000 7f2372400640 1 -- 172.21.15.67:0/3314534211 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c15a200 con 0x7f236c15d410 2024-01-17T23:01:13.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.739+0000 7f2372400640 1 --2- 172.21.15.67:0/3314534211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2364009e50 tx=0x7f236401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf7b26f3fedf1e server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f236be00640 1 -- 172.21.15.67:0/3314534211 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640af400 con 0x7f236c15d410 2024-01-17T23:01:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f236be00640 1 -- 172.21.15.67:0/3314534211 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23640ab050 con 0x7f236c15d410 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f236be00640 1 -- 172.21.15.67:0/3314534211 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640af780 con 0x7f236c15d410 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- 172.21.15.67:0/3314534211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 msgr2=0x7f236c070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 --2- 172.21.15.67:0/3314534211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2364009e50 tx=0x7f236401f1f0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- 172.21.15.67:0/3314534211 shutdown_connections 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 --2- 172.21.15.67:0/3314534211 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c15d410 0x7f236c070d20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 --2- 172.21.15.67:0/3314534211 >> v2:172.21.15.137:3300/0 conn(0x7f236c153780 0x7f236c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- 172.21.15.67:0/3314534211 >> 172.21.15.67:0/3314534211 conn(0x7f236c070390 msgr2=0x7f236c06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- 172.21.15.67:0/3314534211 shutdown_connections 2024-01-17T23:01:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- 172.21.15.67:0/3314534211 wait complete. 2024-01-17T23:01:13.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 Processor -- start 2024-01-17T23:01:13.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.747+0000 7f2374400640 1 -- start start 2024-01-17T23:01:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c153780 0x7f236c0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f236c15d410 0x7f236c1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b2500 con 0x7f236c0ca2f0 2024-01-17T23:01:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c152100 con 0x7f236c15d410 2024-01-17T23:01:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2374400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c0b15d0 con 0x7f236c153780 2024-01-17T23:01:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2371a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2371a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50844/0 (socket says 172.21.15.67:50844) 2024-01-17T23:01:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2371a00640 1 -- 172.21.15.67:0/1971185124 learned_addr learned my addr 172.21.15.67:0/1971185124 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2372400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f236c15d410 0x7f236c1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.751+0000 7f2371000640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c153780 0x7f236c0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 -- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c153780 msgr2=0x7f236c0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c153780 0x7f236c0cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 -- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f236c15d410 msgr2=0x7f236c1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f236c15d410 0x7f236c1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 -- 172.21.15.67:0/1971185124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364009b30 con 0x7f236c0ca2f0 2024-01-17T23:01:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.755+0000 7f2371a00640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f235c00e960 tx=0x7f235c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.759+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c009690 con 0x7f236c0ca2f0 2024-01-17T23:01:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.759+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00ca00 con 0x7f236c0ca2f0 2024-01-17T23:01:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.759+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00cd70 con 0x7f236c0ca2f0 2024-01-17T23:01:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.759+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c1e54c0 con 0x7f236c0ca2f0 2024-01-17T23:01:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.763+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236c159170 con 0x7f236c0ca2f0 2024-01-17T23:01:13.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.763+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236c0c82a0 con 0x7f236c0ca2f0 2024-01-17T23:01:13.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.783+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f235c013470 con 0x7f236c0ca2f0 2024-01-17T23:01:13.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.783+0000 7f2369600640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 0x7f2344068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:13.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.783+0000 7f2371000640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 0x7f2344068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:13.783+0000 7f2371000640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 0x7f2344068d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f236c15c950 tx=0x7f2354009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:14.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.031+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f235c055940 con 0x7f236c0ca2f0 2024-01-17T23:01:14.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.031+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f235c051c80 con 0x7f236c0ca2f0 2024-01-17T23:01:14.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.199+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f236c1e54c0 con 0x7f236c0ca2f0 2024-01-17T23:01:14.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2369600640 1 -- 172.21.15.67:0/1971185124 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f236c1e54c0 con 0x7f236c0ca2f0 2024-01-17T23:01:14.208 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 msgr2=0x7f2344068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 0x7f2344068d50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f236c15c950 tx=0x7f2354009040 comp rx=0 tx=0).stop 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 msgr2=0x7f236c15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f235c00e960 tx=0x7f235c00ee20 comp rx=0 tx=0).stop 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 shutdown_connections 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2344066890 0x7f2344068d50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f236c15d410 0x7f236c1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f236c153780 0x7f236c0cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 --2- 172.21.15.67:0/1971185124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f236c0ca2f0 0x7f236c15bca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 >> 172.21.15.67:0/1971185124 conn(0x7f236c070390 msgr2=0x7f236c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 shutdown_connections 2024-01-17T23:01:14.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.207+0000 7f2374400640 1 -- 172.21.15.67:0/1971185124 wait complete. 2024-01-17T23:01:14.231 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-17T23:01:14.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.371+0000 7f1384c00640 1 Processor -- start 2024-01-17T23:01:14.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.371+0000 7f1384c00640 1 -- start start 2024-01-17T23:01:14.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f1384c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 0x7f138015a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f1384c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138015a6c0 con 0x7f138015ccb0 2024-01-17T23:01:14.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f1384c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13801596c0 con 0x7f13800c8780 2024-01-17T23:01:14.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f1384c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ca520 con 0x7f1380153880 2024-01-17T23:01:14.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f137e800640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f138015ccb0 0x7f1380070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:39644/0 (socket says 172.21.15.67:39644) 2024-01-17T23:01:14.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f137e800640 1 -- 172.21.15.67:0/2352169669 learned_addr learned my addr 172.21.15.67:0/2352169669 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:14.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.375+0000 7f137de00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 0x7f138015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.379+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183548612 0 0) 0x7f138015a6c0 con 0x7f138015ccb0 2024-01-17T23:01:14.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.379+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1360003530 con 0x7f138015ccb0 2024-01-17T23:01:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725447271 0 0) 0x7f1360003530 con 0x7f138015ccb0 2024-01-17T23:01:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 msgr2=0x7f138015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 0x7f138015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 >> v1:172.21.15.137:6789/0 conn(0x7f13800c8780 legacy=0x7f138006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138015d4f0 con 0x7f138015ccb0 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f1378001a00 con 0x7f138015ccb0 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 >> v1:172.21.15.67:6789/0 conn(0x7f138015ccb0 legacy=0x7f1380070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 0x7f13600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1360003f80 0x7f13600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f1360005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800ca520 con 0x7f1360004d10 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136000bb60 con 0x7f1360003f80 2024-01-17T23:01:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136000bd20 con 0x7f1380153880 2024-01-17T23:01:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.383+0000 7f137e800640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f1360005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.387+0000 7f137e800640 1 -- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 msgr2=0x7f13600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.387+0000 7f137e800640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380153880 0x7f13600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.387+0000 7f137e800640 1 -- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1360003f80 msgr2=0x7f13600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.387+0000 7f137e800640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1360003f80 0x7f13600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.387+0000 7f137e800640 1 -- 172.21.15.67:0/2352169669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360003530 con 0x7f1360004d10 2024-01-17T23:01:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.391+0000 7f137e800640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f1360005190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f137800a750 tx=0x7f137801d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1bb87e7b6dd590 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ad630 con 0x7f1360004d10 2024-01-17T23:01:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780a8070 con 0x7f1360004d10 2024-01-17T23:01:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f137ca00640 1 -- 172.21.15.67:0/2352169669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ad9d0 con 0x7f1360004d10 2024-01-17T23:01:14.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 -- 172.21.15.67:0/2352169669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 msgr2=0x7f1360005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 --2- 172.21.15.67:0/2352169669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f1360005190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f137800a750 tx=0x7f137801d260 comp rx=0 tx=0).stop 2024-01-17T23:01:14.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f137e800640 1 -- 172.21.15.67:0/2352169669 reap_dead start 2024-01-17T23:01:14.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 -- 172.21.15.67:0/2352169669 shutdown_connections 2024-01-17T23:01:14.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 -- 172.21.15.67:0/2352169669 >> 172.21.15.67:0/2352169669 conn(0x7f1380070390 msgr2=0x7f138006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:14.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 -- 172.21.15.67:0/2352169669 shutdown_connections 2024-01-17T23:01:14.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.395+0000 7f1384c00640 1 -- 172.21.15.67:0/2352169669 wait complete. 2024-01-17T23:01:14.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 Processor -- start 2024-01-17T23:01:14.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 -- start start 2024-01-17T23:01:14.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1380070f80 0x7f13801556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380155bf0 0x7f1380143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380155280 con 0x7f1360004d10 2024-01-17T23:01:14.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380156070 con 0x7f1380070f80 2024-01-17T23:01:14.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f1384c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380149640 con 0x7f1380155bf0 2024-01-17T23:01:14.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f137de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f137de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50860/0 (socket says 172.21.15.67:50860) 2024-01-17T23:01:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f137de00640 1 -- 172.21.15.67:0/2294581400 learned_addr learned my addr 172.21.15.67:0/2294581400 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f137d400640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1380070f80 0x7f13801556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.399+0000 7f137e800640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380155bf0 0x7f1380143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.403+0000 7f137de00640 1 -- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380155bf0 msgr2=0x7f1380143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.403+0000 7f137de00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380155bf0 0x7f1380143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.403+0000 7f137de00640 1 -- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1380070f80 msgr2=0x7f13801556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.403+0000 7f137de00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1380070f80 0x7f13801556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.403+0000 7f137de00640 1 -- 172.21.15.67:0/2294581400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380148b60 con 0x7f1360004d10 2024-01-17T23:01:14.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.407+0000 7f137de00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f137000e7c0 tx=0x7f137000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:14.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.407+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000eed0 con 0x7f1360004d10 2024-01-17T23:01:14.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.407+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1380148e40 con 0x7f1360004d10 2024-01-17T23:01:14.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.407+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13801f2e80 con 0x7f1360004d10 2024-01-17T23:01:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.411+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13801f3090 con 0x7f1360004d10 2024-01-17T23:01:14.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.411+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700059a0 con 0x7f1360004d10 2024-01-17T23:01:14.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.411+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370005d30 con 0x7f1360004d10 2024-01-17T23:01:14.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.683+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f137000c8c0 con 0x7f1360004d10 2024-01-17T23:01:14.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.683+0000 7f1376000640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 0x7f1358068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:14.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.683+0000 7f137d400640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 0x7f1358068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:14.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.683+0000 7f137d400640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 0x7f1358068d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1368007fd0 tx=0x7f1368009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:14.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.695+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1370055800 con 0x7f1360004d10 2024-01-17T23:01:14.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.695+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f1370051b40 con 0x7f1360004d10 2024-01-17T23:01:14.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.863+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13800746a0 con 0x7f1360004d10 2024-01-17T23:01:14.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.867+0000 7f1376000640 1 -- 172.21.15.67:0/2294581400 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1370021070 con 0x7f1360004d10 2024-01-17T23:01:14.870 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 msgr2=0x7f1358068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 0x7f1358068d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1368007fd0 tx=0x7f1368009040 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 msgr2=0x7f13801543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f137000e7c0 tx=0x7f137000ec80 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 shutdown_connections 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1358066870 0x7f1358068d30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1380155bf0 0x7f1380143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1380070f80 0x7f13801556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 --2- 172.21.15.67:0/2294581400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1360004d10 0x7f13801543e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:14.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 >> 172.21.15.67:0/2294581400 conn(0x7f1380070390 msgr2=0x7f138006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:14.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 shutdown_connections 2024-01-17T23:01:14.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:14.871+0000 7f1384c00640 1 -- 172.21.15.67:0/2294581400 wait complete. 2024-01-17T23:01:14.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:01:15.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.030+0000 7f68d4a00640 1 Processor -- start 2024-01-17T23:01:15.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.030+0000 7f68d4a00640 1 -- start start 2024-01-17T23:01:15.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d4a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f68cc0c9060 0x7f68cc0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d4a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f68cc06aca0 0x7f68cc06b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d4a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc151c30 con 0x7f68cc151850 2024-01-17T23:01:15.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d4a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc06b670 con 0x7f68cc0c9060 2024-01-17T23:01:15.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d4a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc15b890 con 0x7f68cc06aca0 2024-01-17T23:01:15.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f68cc0c9060 0x7f68cc0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f68cc0c9060 0x7f68cc0c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50874/0 (socket says 172.21.15.67:50874) 2024-01-17T23:01:15.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 -- 172.21.15.67:0/230948415 learned_addr learned my addr 172.21.15.67:0/230948415 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:15.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d3400640 1 --2- 172.21.15.67:0/230948415 >> v2:172.21.15.137:3300/0 conn(0x7f68cc06aca0 0x7f68cc06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 -- 172.21.15.67:0/230948415 >> v2:172.21.15.137:3300/0 conn(0x7f68cc06aca0 msgr2=0x7f68cc06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 --2- 172.21.15.67:0/230948415 >> v2:172.21.15.137:3300/0 conn(0x7f68cc06aca0 0x7f68cc06b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 -- 172.21.15.67:0/230948415 >> v1:172.21.15.137:6789/0 conn(0x7f68cc151850 legacy=0x7f68cc0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.034+0000 7f68d1600640 1 -- 172.21.15.67:0/230948415 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc15ad10 con 0x7f68cc0c9060 2024-01-17T23:01:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.042+0000 7f68d1600640 1 --2- 172.21.15.67:0/230948415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0c9060 0x7f68cc0c9480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68cc155010 tx=0x7f68b401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168a1fc83231223b server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d0c00640 1 -- 172.21.15.67:0/230948415 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a89b0 con 0x7f68cc0c9060 2024-01-17T23:01:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d0c00640 1 -- 172.21.15.67:0/230948415 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b40a8b10 con 0x7f68cc0c9060 2024-01-17T23:01:15.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d0c00640 1 -- 172.21.15.67:0/230948415 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a8ea0 con 0x7f68cc0c9060 2024-01-17T23:01:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 -- 172.21.15.67:0/230948415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0c9060 msgr2=0x7f68cc0c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 --2- 172.21.15.67:0/230948415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0c9060 0x7f68cc0c9480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68cc155010 tx=0x7f68b401ecb0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 -- 172.21.15.67:0/230948415 shutdown_connections 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 --2- 172.21.15.67:0/230948415 >> v2:172.21.15.137:3300/0 conn(0x7f68cc06aca0 0x7f68cc06b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 --2- 172.21.15.67:0/230948415 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc0c9060 0x7f68cc0c9480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 -- 172.21.15.67:0/230948415 >> 172.21.15.67:0/230948415 conn(0x7f68cc0705c0 msgr2=0x7f68cc0709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 -- 172.21.15.67:0/230948415 shutdown_connections 2024-01-17T23:01:15.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.046+0000 7f68d4a00640 1 -- 172.21.15.67:0/230948415 wait complete. 2024-01-17T23:01:15.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 Processor -- start 2024-01-17T23:01:15.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 -- start start 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68cc06aca0 0x7f68cc0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68cc0c9060 0x7f68cc1f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0ade70 con 0x7f68cc151850 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1f3090 con 0x7f68cc0c9060 2024-01-17T23:01:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d4a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0afb30 con 0x7f68cc06aca0 2024-01-17T23:01:15.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50880/0 (socket says 172.21.15.67:50880) 2024-01-17T23:01:15.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d1600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68cc0c9060 0x7f68cc1f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d3400640 1 -- 172.21.15.67:0/3706684221 learned_addr learned my addr 172.21.15.67:0/3706684221 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:15.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.050+0000 7f68d2000640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68cc06aca0 0x7f68cc0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.054+0000 7f68d3400640 1 -- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68cc06aca0 msgr2=0x7f68cc0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.054+0000 7f68d3400640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68cc06aca0 0x7f68cc0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.054+0000 7f68d3400640 1 -- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68cc0c9060 msgr2=0x7f68cc1f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.054+0000 7f68d3400640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68cc0c9060 0x7f68cc1f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.054+0000 7f68d3400640 1 -- 172.21.15.67:0/3706684221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40094d0 con 0x7f68cc151850 2024-01-17T23:01:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.058+0000 7f68d3400640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68c4007d50 tx=0x7f68c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4014420 con 0x7f68cc151850 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40145a0 con 0x7f68cc151850 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4014950 con 0x7f68cc151850 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0b2150 con 0x7f68cc151850 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0b0630 con 0x7f68cc151850 2024-01-17T23:01:15.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.062+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0746a0 con 0x7f68cc151850 2024-01-17T23:01:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.318+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f68c4014ab0 con 0x7f68cc151850 2024-01-17T23:01:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.318+0000 7f68ca000640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 0x7f68a4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.318+0000 7f68d2000640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 0x7f68a4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.322+0000 7f68d2000640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 0x7f68a4068d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68bc007fd0 tx=0x7f68bc007e40 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:15.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.330+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68c4056690 con 0x7f68cc151850 2024-01-17T23:01:15.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.334+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f68c4083e60 con 0x7f68cc151850 2024-01-17T23:01:15.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.530+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc0c8660 con 0x7f68cc151850 2024-01-17T23:01:15.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.542+0000 7f68ca000640 1 -- 172.21.15.67:0/3706684221 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6555 (secure 0 0 0) 0x7f68c4056460 con 0x7f68cc151850 2024-01-17T23:01:15.547 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:15.547 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:57.312320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T23:01:15.547 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-01-17T23:01:15.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 msgr2=0x7f68a4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 0x7f68a4068d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68bc007fd0 tx=0x7f68bc007e40 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 msgr2=0x7f68cc0aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68c4007d50 tx=0x7f68c400e4b0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 shutdown_connections 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f68a40668c0 0x7f68a4068d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68cc151850 0x7f68cc0aec80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68cc0c9060 0x7f68cc1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 --2- 172.21.15.67:0/3706684221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f68cc06aca0 0x7f68cc0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 >> 172.21.15.67:0/3706684221 conn(0x7f68cc0705c0 msgr2=0x7f68cc1498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 shutdown_connections 2024-01-17T23:01:15.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.546+0000 7f68d4a00640 1 -- 172.21.15.67:0/3706684221 wait complete. 2024-01-17T23:01:15.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-17T23:01:15.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 Processor -- start 2024-01-17T23:01:15.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 -- start start 2024-01-17T23:01:15.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46cc1539a0 0x7f46cc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46cc15d3f0 0x7f46cc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc0c9890 con 0x7f46cc0c79c0 2024-01-17T23:01:15.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc06d570 con 0x7f46cc15d3f0 2024-01-17T23:01:15.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46d1a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc159bf0 con 0x7f46cc1539a0 2024-01-17T23:01:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.706+0000 7f46cb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46cc15d3f0 0x7f46cc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f46cc15d3f0 0x7f46cc15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50890/0 (socket says 172.21.15.67:50890) 2024-01-17T23:01:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 -- 172.21.15.67:0/1731258434 learned_addr learned my addr 172.21.15.67:0/1731258434 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:15.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46caa00640 1 --2- 172.21.15.67:0/1731258434 >> v2:172.21.15.137:3300/0 conn(0x7f46cc1539a0 0x7f46cc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 -- 172.21.15.67:0/1731258434 >> v2:172.21.15.137:3300/0 conn(0x7f46cc1539a0 msgr2=0x7f46cc0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 --2- 172.21.15.67:0/1731258434 >> v2:172.21.15.137:3300/0 conn(0x7f46cc1539a0 0x7f46cc0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 -- 172.21.15.67:0/1731258434 >> v1:172.21.15.137:6789/0 conn(0x7f46cc0c79c0 legacy=0x7f46cc061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:15.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.710+0000 7f46cb400640 1 -- 172.21.15.67:0/1731258434 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc15dd60 con 0x7f46cc15d3f0 2024-01-17T23:01:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.714+0000 7f46cb400640 1 --2- 172.21.15.67:0/1731258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc15d820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f46cc061cf0 tx=0x7f46c401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917b01ef7f8e7e80 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:15.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46c9600640 1 -- 172.21.15.67:0/1731258434 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40a5820 con 0x7f46cc15d3f0 2024-01-17T23:01:15.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46c9600640 1 -- 172.21.15.67:0/1731258434 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c40a5980 con 0x7f46cc15d3f0 2024-01-17T23:01:15.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46c9600640 1 -- 172.21.15.67:0/1731258434 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40a5d10 con 0x7f46cc15d3f0 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 -- 172.21.15.67:0/1731258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 msgr2=0x7f46cc15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 --2- 172.21.15.67:0/1731258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc15d820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f46cc061cf0 tx=0x7f46c401c960 comp rx=0 tx=0).stop 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 -- 172.21.15.67:0/1731258434 shutdown_connections 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 --2- 172.21.15.67:0/1731258434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc15d820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 --2- 172.21.15.67:0/1731258434 >> v2:172.21.15.137:3300/0 conn(0x7f46cc1539a0 0x7f46cc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 -- 172.21.15.67:0/1731258434 >> 172.21.15.67:0/1731258434 conn(0x7f46cc06ad40 msgr2=0x7f46cc06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:15.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 -- 172.21.15.67:0/1731258434 shutdown_connections 2024-01-17T23:01:15.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.718+0000 7f46d1a00640 1 -- 172.21.15.67:0/1731258434 wait complete. 2024-01-17T23:01:15.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 Processor -- start 2024-01-17T23:01:15.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 -- start start 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46cc0c79c0 0x7f46cc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46cc1539a0 0x7f46cc1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc15af40 con 0x7f46cc15d3f0 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1f1c90 con 0x7f46cc0c79c0 2024-01-17T23:01:15.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46d1a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc15b140 con 0x7f46cc1539a0 2024-01-17T23:01:15.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46cb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46cb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50900/0 (socket says 172.21.15.67:50900) 2024-01-17T23:01:15.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46cb400640 1 -- 172.21.15.67:0/2677835138 learned_addr learned my addr 172.21.15.67:0/2677835138 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:15.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46caa00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46cc0c79c0 0x7f46cc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.722+0000 7f46ca000640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46cc1539a0 0x7f46cc1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.726+0000 7f46cb400640 1 -- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46cc1539a0 msgr2=0x7f46cc1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.726+0000 7f46cb400640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46cc1539a0 0x7f46cc1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.726+0000 7f46cb400640 1 -- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46cc0c79c0 msgr2=0x7f46cc15aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.726+0000 7f46cb400640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46cc0c79c0 0x7f46cc15aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:15.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.726+0000 7f46cb400640 1 -- 172.21.15.67:0/2677835138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009b30 con 0x7f46cc15d3f0 2024-01-17T23:01:15.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.730+0000 7f46cb400640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46c401b010 tx=0x7f46c4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:15.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40b8670 con 0x7f46cc15d3f0 2024-01-17T23:01:15.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c40b87d0 con 0x7f46cc15d3f0 2024-01-17T23:01:15.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40b8b80 con 0x7f46cc15d3f0 2024-01-17T23:01:15.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc15b400 con 0x7f46cc15d3f0 2024-01-17T23:01:15.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1f21f0 con 0x7f46cc15d3f0 2024-01-17T23:01:15.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.734+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc06b620 con 0x7f46cc15d3f0 2024-01-17T23:01:15.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.754+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f46c40b8ce0 con 0x7f46cc15d3f0 2024-01-17T23:01:15.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.754+0000 7f46c2a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 0x7f46a4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:15.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.758+0000 7f46caa00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 0x7f46a4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:15.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:15.758+0000 7f46caa00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 0x7f46a4068d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46bc006aa0 tx=0x7f46bc008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:16.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.006+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46c40f0ff0 con 0x7f46cc15d3f0 2024-01-17T23:01:16.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.006+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f46c40ed330 con 0x7f46cc15d3f0 2024-01-17T23:01:16.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.166+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46cc06b620 con 0x7f46cc15d3f0 2024-01-17T23:01:16.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46c2a00640 1 -- 172.21.15.67:0/2677835138 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f46c40f0950 con 0x7f46cc15d3f0 2024-01-17T23:01:16.213 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:16.213 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-17T23:01:16.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 msgr2=0x7f46a4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 0x7f46a4068d00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46bc006aa0 tx=0x7f46bc008040 comp rx=0 tx=0).stop 2024-01-17T23:01:16.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 msgr2=0x7f46cc14df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46c401b010 tx=0x7f46c4019700 comp rx=0 tx=0).stop 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 shutdown_connections 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f46a4066840 0x7f46a4068d00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46cc15d3f0 0x7f46cc14df00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f46cc1539a0 0x7f46cc1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 --2- 172.21.15.67:0/2677835138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46cc0c79c0 0x7f46cc15aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 >> 172.21.15.67:0/2677835138 conn(0x7f46cc06ad40 msgr2=0x7f46cc0c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:16.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.210+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 shutdown_connections 2024-01-17T23:01:16.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.214+0000 7f46d1a00640 1 -- 172.21.15.67:0/2677835138 wait complete. 2024-01-17T23:01:16.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-17T23:01:16.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 Processor -- start 2024-01-17T23:01:16.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 -- start start 2024-01-17T23:01:16.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe14415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe1440ca780 0x7fe1440c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440c7d10 con 0x7fe1440ca3a0 2024-01-17T23:01:16.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1441576d0 con 0x7fe1440ca780 2024-01-17T23:01:16.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe14a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe144157970 con 0x7fe1441517f0 2024-01-17T23:01:16.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe142a00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe1440ca3a0 0x7fe144061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:49576/0 (socket says 172.21.15.67:49576) 2024-01-17T23:01:16.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe142a00640 1 -- 172.21.15.67:0/2805292155 learned_addr learned my addr 172.21.15.67:0/2805292155 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:16.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.378+0000 7fe143400640 1 --2- 172.21.15.67:0/2805292155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe14415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.386+0000 7fe143400640 1 -- 172.21.15.67:0/2805292155 >> v2:172.21.15.67:3300/0 conn(0x7fe1440ca780 msgr2=0x7fe1440c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.386+0000 7fe143400640 1 --2- 172.21.15.67:0/2805292155 >> v2:172.21.15.67:3300/0 conn(0x7fe1440ca780 0x7fe1440c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.386+0000 7fe143400640 1 -- 172.21.15.67:0/2805292155 >> v1:172.21.15.137:6789/0 conn(0x7fe1440ca3a0 legacy=0x7fe144061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.386+0000 7fe143400640 1 -- 172.21.15.67:0/2805292155 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144157c50 con 0x7fe1441517f0 2024-01-17T23:01:16.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.394+0000 7fe143400640 1 --2- 172.21.15.67:0/2805292155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe14415b620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097c0 tx=0x7fe13401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c6b956684b39a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:16.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.402+0000 7fe142000640 1 -- 172.21.15.67:0/2805292155 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340ab680 con 0x7fe1441517f0 2024-01-17T23:01:16.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.402+0000 7fe142000640 1 -- 172.21.15.67:0/2805292155 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1340ab7e0 con 0x7fe1441517f0 2024-01-17T23:01:16.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.402+0000 7fe142000640 1 -- 172.21.15.67:0/2805292155 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340abb70 con 0x7fe1441517f0 2024-01-17T23:01:16.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.402+0000 7fe14a000640 1 -- 172.21.15.67:0/2805292155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 msgr2=0x7fe14415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.402+0000 7fe14a000640 1 --2- 172.21.15.67:0/2805292155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe14415b620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097c0 tx=0x7fe13401c480 comp rx=0 tx=0).stop 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- 172.21.15.67:0/2805292155 shutdown_connections 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 --2- 172.21.15.67:0/2805292155 >> v2:172.21.15.67:3300/0 conn(0x7fe1440ca780 0x7fe1440c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 --2- 172.21.15.67:0/2805292155 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe14415b620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- 172.21.15.67:0/2805292155 >> 172.21.15.67:0/2805292155 conn(0x7fe14406ad40 msgr2=0x7fe14406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- 172.21.15.67:0/2805292155 shutdown_connections 2024-01-17T23:01:16.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- 172.21.15.67:0/2805292155 wait complete. 2024-01-17T23:01:16.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 Processor -- start 2024-01-17T23:01:16.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- start start 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1440ca3a0 0x7fe144152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe144147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415a420 con 0x7fe1440ca3a0 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441f3320 con 0x7fe1440ca780 2024-01-17T23:01:16.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.406+0000 7fe14a000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1441535a0 con 0x7fe1441517f0 2024-01-17T23:01:16.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.410+0000 7fe142a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:16.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.410+0000 7fe142a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:43444/0 (socket says 172.21.15.67:43444) 2024-01-17T23:01:16.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.410+0000 7fe142a00640 1 -- 172.21.15.67:0/779876147 learned_addr learned my addr 172.21.15.67:0/779876147 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:16.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.410+0000 7fe143e00640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe144147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:16.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.418+0000 7fe142a00640 1 -- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 msgr2=0x7fe144147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.418+0000 7fe142a00640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe144147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.418+0000 7fe142a00640 1 -- 172.21.15.67:0/779876147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1440ca3a0 msgr2=0x7fe144152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:16.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.418+0000 7fe142a00640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1440ca3a0 0x7fe144152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:16.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.418+0000 7fe142a00640 1 -- 172.21.15.67:0/779876147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134009420 con 0x7fe1440ca780 2024-01-17T23:01:16.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.426+0000 7fe142a00640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c420 tx=0x7fe12c00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.438+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c005cf0 con 0x7fe1440ca780 2024-01-17T23:01:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.438+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c005e50 con 0x7fe1440ca780 2024-01-17T23:01:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.438+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0072f0 con 0x7fe1440ca780 2024-01-17T23:01:16.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.438+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1441f2940 con 0x7fe1440ca780 2024-01-17T23:01:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.438+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14415a670 con 0x7fe1440ca780 2024-01-17T23:01:16.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.442+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1441f2df0 con 0x7fe1440ca780 2024-01-17T23:01:16.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.818+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fe12c007450 con 0x7fe1440ca780 2024-01-17T23:01:16.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.818+0000 7fe13b400640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 0x7fe11c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:16.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.818+0000 7fe143400640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 0x7fe11c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.822+0000 7fe143400640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 0x7fe11c068d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1340af000 tx=0x7fe134008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:16.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.826+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe12c013e70 con 0x7fe1440ca780 2024-01-17T23:01:16.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:16.846+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fe12c051160 con 0x7fe1440ca780 2024-01-17T23:01:17.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.046+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe14406b620 con 0x7fe1440ca780 2024-01-17T23:01:17.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe13b400640 1 -- 172.21.15.67:0/779876147 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6555 (secure 0 0 0) 0x7fe12c017020 con 0x7fe1440ca780 2024-01-17T23:01:17.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-17T23:01:17.109 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:00:57.312320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":7,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-17T23:01:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 14 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 msgr2=0x7fe11c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 0x7fe11c068d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1340af000 tx=0x7fe134008040 comp rx=0 tx=0).stop 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 msgr2=0x7fe144152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c420 tx=0x7fe12c00c8e0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 shutdown_connections 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fe11c0668c0 0x7fe11c068d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fe1441517f0 0x7fe144147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe1440ca780 0x7fe144152fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 --2- 172.21.15.67:0/779876147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1440ca3a0 0x7fe144152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 >> 172.21.15.67:0/779876147 conn(0x7fe14406ad40 msgr2=0x7fe14406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 shutdown_connections 2024-01-17T23:01:17.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.106+0000 7fe14a000640 1 -- 172.21.15.67:0/779876147 wait complete. 2024-01-17T23:01:17.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-17T23:00:18.027327+0000', 'modified': '2024-01-17T23:00:57.312320+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4282, 'mds_1': 4276, 'mds_2': 4256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4256': {'gid': 4256, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.137:6838/746278968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 746278968}, {'type': 'v1', 'addr': '172.21.15.137:6838', 'nonce': 746278968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.137:6835/3667909367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 3667909367}, {'type': 'v1', 'addr': '172.21.15.137:6835', 'nonce': 3667909367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4282': {'gid': 4282, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.137:6839/2865340697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6837', 'nonce': 2865340697}, {'type': 'v1', 'addr': '172.21.15.137:6839', 'nonce': 2865340697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-17T23:01:17.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-01-17T23:01:17.737 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-17T23:01:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 Processor -- start 2024-01-17T23:01:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 -- start start 2024-01-17T23:01:17.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62c4153bb0 0x7f62c406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62c406f1f0 0x7f62c40c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c40c2a00 0x7f62c4159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c415db50 con 0x7f62c406f1f0 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c415ccf0 con 0x7f62c4153bb0 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62cba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c415cf40 con 0x7f62c40c2a00 2024-01-17T23:01:17.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62c3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62c406f1f0 0x7f62c40c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62c3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62c406f1f0 0x7f62c40c24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50926/0 (socket says 172.21.15.67:50926) 2024-01-17T23:01:17.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.882+0000 7f62c3e00640 1 -- 172.21.15.67:0/190338533 learned_addr learned my addr 172.21.15.67:0/190338533 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:17.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.886+0000 7f62c3e00640 1 -- 172.21.15.67:0/190338533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c40c2a00 msgr2=0x7f62c4159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.886+0000 7f62c3e00640 1 --2- 172.21.15.67:0/190338533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c40c2a00 0x7f62c4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.886+0000 7f62c3e00640 1 -- 172.21.15.67:0/190338533 >> v2:172.21.15.137:3300/0 conn(0x7f62c4153bb0 msgr2=0x7f62c406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.886+0000 7f62c3e00640 1 --2- 172.21.15.67:0/190338533 >> v2:172.21.15.137:3300/0 conn(0x7f62c4153bb0 0x7f62c406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.886+0000 7f62c3e00640 1 -- 172.21.15.67:0/190338533 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c415d220 con 0x7f62c406f1f0 2024-01-17T23:01:17.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.890+0000 7f62c3e00640 1 --2- 172.21.15.67:0/190338533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c406f1f0 0x7f62c40c24c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62c406cc80 tx=0x7f62ac01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188d2f44d80053c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62c3400640 1 -- 172.21.15.67:0/190338533 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a89b0 con 0x7f62c406f1f0 2024-01-17T23:01:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62c3400640 1 -- 172.21.15.67:0/190338533 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0a8b10 con 0x7f62c406f1f0 2024-01-17T23:01:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62c3400640 1 -- 172.21.15.67:0/190338533 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a8ea0 con 0x7f62c406f1f0 2024-01-17T23:01:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 -- 172.21.15.67:0/190338533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c406f1f0 msgr2=0x7f62c40c24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 --2- 172.21.15.67:0/190338533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c406f1f0 0x7f62c40c24c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62c406cc80 tx=0x7f62ac01ecf0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 -- 172.21.15.67:0/190338533 shutdown_connections 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 --2- 172.21.15.67:0/190338533 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c40c2a00 0x7f62c4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 --2- 172.21.15.67:0/190338533 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c406f1f0 0x7f62c40c24c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 --2- 172.21.15.67:0/190338533 >> v2:172.21.15.137:3300/0 conn(0x7f62c4153bb0 0x7f62c406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 -- 172.21.15.67:0/190338533 >> 172.21.15.67:0/190338533 conn(0x7f62c406fc50 msgr2=0x7f62c4070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 -- 172.21.15.67:0/190338533 shutdown_connections 2024-01-17T23:01:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.894+0000 7f62cba00640 1 -- 172.21.15.67:0/190338533 wait complete. 2024-01-17T23:01:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 Processor -- start 2024-01-17T23:01:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 -- start start 2024-01-17T23:01:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c406f1f0 0x7f62c415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62c4153bb0 0x7f62c4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41f0250 con 0x7f62c40c2a00 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41efcd0 con 0x7f62c4153bb0 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62cba00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414d6b0 con 0x7f62c406f1f0 2024-01-17T23:01:17.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50942/0 (socket says 172.21.15.67:50942) 2024-01-17T23:01:17.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.898+0000 7f62c3e00640 1 -- 172.21.15.67:0/3716705303 learned_addr learned my addr 172.21.15.67:0/3716705303 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:17.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.902+0000 7f62c3e00640 1 -- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c406f1f0 msgr2=0x7f62c415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.902+0000 7f62c3e00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c406f1f0 0x7f62c415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.902+0000 7f62c3e00640 1 -- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62c4153bb0 msgr2=0x7f62c4157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.902+0000 7f62c3e00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62c4153bb0 0x7f62c4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.902+0000 7f62c3e00640 1 -- 172.21.15.67:0/3716705303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0094d0 con 0x7f62c40c2a00 2024-01-17T23:01:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.906+0000 7f62c3e00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01d3a0 tx=0x7f62ac01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:17.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.910+0000 7f62c0c00640 1 -- 172.21.15.67:0/3716705303 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0b0e40 con 0x7f62c40c2a00 2024-01-17T23:01:17.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.910+0000 7f62c0c00640 1 -- 172.21.15.67:0/3716705303 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0ba440 con 0x7f62c40c2a00 2024-01-17T23:01:17.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.910+0000 7f62c0c00640 1 -- 172.21.15.67:0/3716705303 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0ba7f0 con 0x7f62c40c2a00 2024-01-17T23:01:17.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.910+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41eff70 con 0x7f62c40c2a00 2024-01-17T23:01:17.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.910+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415bad0 con 0x7f62c40c2a00 2024-01-17T23:01:17.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 Processor -- start 2024-01-17T23:01:17.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 -- start start 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e6e0730 0x55992e6e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e71b7d0 0x55992e71bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e536d70 con 0x55992e71c0f0 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e532ba0 con 0x55992e71b7d0 2024-01-17T23:01:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.914+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55992e5300d0 con 0x55992e6e0730 2024-01-17T23:01:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.930+0000 7f62c0c00640 1 -- 172.21.15.67:0/3716705303 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f62ac0ba950 con 0x7f62c40c2a00 2024-01-17T23:01:17.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c0c00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 0x7f629c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c9a00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 0x7f629c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c9a00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 0x7f629c068d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62c415b590 tx=0x7f62bc00b250 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c0c00640 1 -- 172.21.15.67:0/3716705303 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62ac0f5840 con 0x7f62c40c2a00 2024-01-17T23:01:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.934+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e6e0730 0x55992e6e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50948/0 (socket says 172.21.15.67:50948) 2024-01-17T23:01:17.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 -- 172.21.15.67:0/1250270637 learned_addr learned my addr 172.21.15.67:0/1250270637 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 -- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e6e0730 msgr2=0x55992e6e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e6e0730 0x55992e6e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 -- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e71b7d0 msgr2=0x55992e71bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e71b7d0 0x55992e71bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.938+0000 7f62c3e00640 1 -- 172.21.15.67:0/1250270637 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55992e222890 con 0x55992e71c0f0 2024-01-17T23:01:17.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.942+0000 7f62c3e00640 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0f50d0 tx=0x7f62ac0f4aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8b6e4fb9c5e03 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:17.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62b9600640 1 -- 172.21.15.67:0/1250270637 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0fd4d0 con 0x55992e71c0f0 2024-01-17T23:01:17.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62b9600640 1 -- 172.21.15.67:0/1250270637 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0f1850 con 0x55992e71c0f0 2024-01-17T23:01:17.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62b9600640 1 -- 172.21.15.67:0/1250270637 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0f55a0 con 0x55992e71c0f0 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- 172.21.15.67:0/1250270637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 msgr2=0x55992e726a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0f50d0 tx=0x7f62ac0f4aa0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- 172.21.15.67:0/1250270637 shutdown_connections 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e726a60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e71b7d0 0x55992e71bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 --2- 172.21.15.67:0/1250270637 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e6e0730 0x55992e6e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- 172.21.15.67:0/1250270637 >> 172.21.15.67:0/1250270637 conn(0x55992e717580 msgr2=0x55992e719970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- 172.21.15.67:0/1250270637 shutdown_connections 2024-01-17T23:01:17.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- 172.21.15.67:0/1250270637 wait complete. 2024-01-17T23:01:17.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.966+0000 7f62ceeed000 1 -- start start 2024-01-17T23:01:17.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 Processor -- start 2024-01-17T23:01:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e6dc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e52b9c0 con 0x55992e71c0f0 2024-01-17T23:01:17.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e4e3040 con 0x55992e6e0730 2024-01-17T23:01:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55992e4e8ee0 con 0x55992e71b7d0 2024-01-17T23:01:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62ceeed000 10 client.0 _ll_register_callbacks cb 0x55992e4e61b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e6dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50964/0 (socket says 172.21.15.67:50964) 2024-01-17T23:01:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62c9a00640 1 -- 172.21.15.67:0/2030061844 learned_addr learned my addr 172.21.15.67:0/2030061844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:17.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.970+0000 7f62c9000640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.974+0000 7f62c9a00640 1 -- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 msgr2=0x55992e6dc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.974+0000 7f62c9a00640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e6dc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.974+0000 7f62c9a00640 1 -- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 msgr2=0x55992e6dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.974+0000 7f62c9a00640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:17.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.974+0000 7f62c9a00640 1 -- 172.21.15.67:0/2030061844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415bad0 con 0x55992e71c0f0 2024-01-17T23:01:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.978+0000 7f62c9a00640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62bc004fd0 tx=0x7f62bc006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926da6e4f01bcef0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:17.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.978+0000 7f62b2000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:17.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.978+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00fba0 con 0x55992e71c0f0 2024-01-17T23:01:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.978+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62bc00fd00 con 0x55992e71c0f0 2024-01-17T23:01:17.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.978+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55992e4b1e30 con 0x55992e71c0f0 2024-01-17T23:01:17.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.982+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62bc024470 con 0x55992e71c0f0 2024-01-17T23:01:17.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.982+0000 7f62ceeed000 10 client.4746 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:17.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.982+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55992e4eb5e0 con 0x55992e71c0f0 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55992e4b1e30 con 0x55992e71c0f0 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f62bc017040 con 0x55992e71c0f0 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 10 client.4746 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 10 client.4746 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 20 client.4746 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e72fd80 0x55992e732170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 4 client.4746 mds_command: new command op to 4256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T23:01:17.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.986+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 --> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55992e4e8870 con 0x55992e72fd80 2024-01-17T23:01:17.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:17.990+0000 7f62c9000640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e72fd80 0x55992e732170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.082+0000 7f62c9000640 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e72fd80 0x55992e732170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18579025581335f6 server_cookie=bf654a61a85a77d8 in_seq=0 out_seq=0 2024-01-17T23:01:18.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.082+0000 7f62b2000640 10 client.4746 ms_handle_connect on v2:172.21.15.137:6836/746278968 2024-01-17T23:01:18.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.282+0000 7f62b2000640 1 -- 172.21.15.67:0/2030061844 <== mds.2 v2:172.21.15.137:6836/746278968 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55992e4e8870 con 0x55992e72fd80 2024-01-17T23:01:18.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.282+0000 7f62b2000640 10 client.4746 handle_command_reply: tid=0 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.282+0000 7f62ceeed000 1 client.4746 shutdown 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.282+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 msgr2=0x55992e6dc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.282+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62bc004fd0 tx=0x7f62bc006c50 comp rx=0 tx=0).stop 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 shutdown_connections 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e72fd80 0x55992e732170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e6dc750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e6dc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 --2- 172.21.15.67:0/2030061844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62b2000640 0 client.4746 ms_handle_reset on v2:172.21.15.137:6836/746278968 2024-01-17T23:01:18.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 >> 172.21.15.67:0/2030061844 conn(0x55992e717580 msgr2=0x55992e716d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 shutdown_connections 2024-01-17T23:01:18.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 1 -- 172.21.15.67:0/2030061844 wait complete. 2024-01-17T23:01:18.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.286+0000 7f62ceeed000 20 client.4746 trim_cache size 0 max 16384 2024-01-17T23:01:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 Processor -- start 2024-01-17T23:01:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 -- start start 2024-01-17T23:01:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e7167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e1e3940 con 0x55992e71c0f0 2024-01-17T23:01:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e580e40 con 0x55992e6e0730 2024-01-17T23:01:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55992e4ed720 con 0x55992e71b7d0 2024-01-17T23:01:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50968/0 (socket says 172.21.15.67:50968) 2024-01-17T23:01:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62c9a00640 1 -- 172.21.15.67:0/444809607 learned_addr learned my addr 172.21.15.67:0/444809607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62c3e00640 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e7167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.302+0000 7f62c9000640 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 -- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 msgr2=0x55992e7167a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e7167a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 -- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 msgr2=0x55992e6dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 -- 172.21.15.67:0/444809607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55992e4d18e0 con 0x55992e71c0f0 2024-01-17T23:01:18.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.306+0000 7f62c9a00640 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009080 tx=0x7f62bc01d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4f3690c1d2bb1a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62b8c00640 1 -- 172.21.15.67:0/444809607 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0060d0 con 0x55992e71c0f0 2024-01-17T23:01:18.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62b8c00640 1 -- 172.21.15.67:0/444809607 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc024470 con 0x55992e71c0f0 2024-01-17T23:01:18.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62b8c00640 1 -- 172.21.15.67:0/444809607 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0245e0 con 0x55992e71c0f0 2024-01-17T23:01:18.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 -- 172.21.15.67:0/444809607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 msgr2=0x55992e716ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009080 tx=0x7f62bc01d070 comp rx=0 tx=0).stop 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 -- 172.21.15.67:0/444809607 shutdown_connections 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e716ce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e7167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.310+0000 7f62ceeed000 1 --2- 172.21.15.67:0/444809607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e6dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- 172.21.15.67:0/444809607 >> 172.21.15.67:0/444809607 conn(0x55992e717580 msgr2=0x55992e6da680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- 172.21.15.67:0/444809607 shutdown_connections 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- 172.21.15.67:0/444809607 wait complete. 2024-01-17T23:01:18.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- start start 2024-01-17T23:01:18.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 Processor -- start 2024-01-17T23:01:18.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e7167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e716ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e56c440 con 0x55992e71c0f0 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55992e5291d0 con 0x55992e6e0730 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55992e52f9c0 con 0x55992e71b7d0 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62ceeed000 10 client.0 _ll_register_callbacks cb 0x55992e558a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:18.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62c9a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50980/0 (socket says 172.21.15.67:50980) 2024-01-17T23:01:18.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62c9a00640 1 -- 172.21.15.67:0/4035227388 learned_addr learned my addr 172.21.15.67:0/4035227388 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.314+0000 7f62c3e00640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e716ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9000640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e7167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9a00640 1 -- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 msgr2=0x55992e716ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9a00640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e716ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9a00640 1 -- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 msgr2=0x55992e7167a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9a00640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e7167a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.318+0000 7f62c9a00640 1 -- 172.21.15.67:0/4035227388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55992e4eb5e0 con 0x55992e71c0f0 2024-01-17T23:01:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.322+0000 7f62c9a00640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62bc002240 tx=0x7f62bc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a733927c38e0848a server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.322+0000 7f62b2000640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.322+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc024a20 con 0x55992e71c0f0 2024-01-17T23:01:18.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.322+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55992e6d9bc0 con 0x55992e71c0f0 2024-01-17T23:01:18.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.326+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62bc024b80 con 0x55992e71c0f0 2024-01-17T23:01:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.326+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62bc024d40 con 0x55992e71c0f0 2024-01-17T23:01:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.326+0000 7f62ceeed000 10 client.4752 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:18.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.326+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55992e222cc0 con 0x55992e71c0f0 2024-01-17T23:01:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55992e6d9bc0 con 0x55992e71c0f0 2024-01-17T23:01:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f62bc00f7f0 con 0x55992e71c0f0 2024-01-17T23:01:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 10 client.4752 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:18.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 10 client.4752 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-17T23:01:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 20 client.4752 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e742160 0x55992e742540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 4 client.4752 mds_command: new command op to 4256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T23:01:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 --> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55992e4dd4f0 con 0x55992e742160 2024-01-17T23:01:18.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.330+0000 7f62c9000640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e742160 0x55992e742540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.338+0000 7f62c9000640 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e742160 0x55992e742540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3616ee715edff25 server_cookie=a6135883e7e5d9c in_seq=0 out_seq=0 2024-01-17T23:01:18.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.338+0000 7f62b2000640 10 client.4752 ms_handle_connect on v2:172.21.15.137:6836/746278968 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62b2000640 1 -- 172.21.15.67:0/4035227388 <== mds.2 v2:172.21.15.137:6836/746278968 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55992e4dd4f0 con 0x55992e742160 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62b2000640 10 client.4752 handle_command_reply: tid=0 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 client.4752 shutdown 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 msgr2=0x55992e741c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62bc002240 tx=0x7f62bc004ac0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 shutdown_connections 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:6836/746278968,v1:172.21.15.137:6838/746278968] conn(0x55992e742160 0x55992e742540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55992e71c0f0 0x55992e741c20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55992e71b7d0 0x55992e716ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 --2- 172.21.15.67:0/4035227388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55992e6e0730 0x55992e7167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62b2000640 0 client.4752 ms_handle_reset on v2:172.21.15.137:6836/746278968 2024-01-17T23:01:18.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 >> 172.21.15.67:0/4035227388 conn(0x55992e717580 msgr2=0x55992e6da680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 shutdown_connections 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 1 -- 172.21.15.67:0/4035227388 wait complete. 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.362+0000 7f62ceeed000 20 client.4752 trim_cache size 0 max 16384 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1", 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 2, 2024-01-17T23:01:18.369 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4256, 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 22.367999793999999, 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 14, 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 29, 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 29, 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 85.721535775999996 2024-01-17T23:01:18.370 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 msgr2=0x7f629c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 0x7f629c068d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62c415b590 tx=0x7f62bc00b250 comp rx=0 tx=0).stop 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 msgr2=0x7f62c41578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62ac01d3a0 tx=0x7f62ac01ba90 comp rx=0 tx=0).stop 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 shutdown_connections 2024-01-17T23:01:18.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f629c066890 0x7f629c068d50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62c4153bb0 0x7f62c4157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62c40c2a00 0x7f62c41578d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 --2- 172.21.15.67:0/3716705303 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f62c406f1f0 0x7f62c415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 >> 172.21.15.67:0/3716705303 conn(0x7f62c406fc50 msgr2=0x7f62c406a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 shutdown_connections 2024-01-17T23:01:18.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.366+0000 7f62cba00640 1 -- 172.21.15.67:0/3716705303 wait complete. 2024-01-17T23:01:18.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-17T23:01:18.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 Processor -- start 2024-01-17T23:01:18.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 -- start start 2024-01-17T23:01:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa39814ff10 0x7fa398156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa39806d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa398159ad0 con 0x7fa3980c68c0 2024-01-17T23:01:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa398156ad0 con 0x7fa39814ff10 2024-01-17T23:01:18.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa39ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39806cc20 con 0x7fa3980c6480 2024-01-17T23:01:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa395e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa39814ff10 0x7fa398156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa395e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa39814ff10 0x7fa398156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50988/0 (socket says 172.21.15.67:50988) 2024-01-17T23:01:18.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.530+0000 7fa395e00640 1 -- 172.21.15.67:0/2020628597 learned_addr learned my addr 172.21.15.67:0/2020628597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.534+0000 7fa395e00640 1 -- 172.21.15.67:0/2020628597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 msgr2=0x7fa39806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.534+0000 7fa395e00640 1 --2- 172.21.15.67:0/2020628597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa39806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.534+0000 7fa395e00640 1 -- 172.21.15.67:0/2020628597 >> v1:172.21.15.67:6789/0 conn(0x7fa3980c68c0 legacy=0x7fa39806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.534+0000 7fa395e00640 1 -- 172.21.15.67:0/2020628597 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39806cf00 con 0x7fa39814ff10 2024-01-17T23:01:18.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.538+0000 7fa395e00640 1 --2- 172.21.15.67:0/2020628597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa398156590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa388009870 tx=0x7fa38801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329ae600e479b67f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.542+0000 7fa394a00640 1 -- 172.21.15.67:0/2020628597 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880a8a30 con 0x7fa39814ff10 2024-01-17T23:01:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.542+0000 7fa394a00640 1 -- 172.21.15.67:0/2020628597 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880a8b90 con 0x7fa39814ff10 2024-01-17T23:01:18.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.542+0000 7fa394a00640 1 -- 172.21.15.67:0/2020628597 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880b0440 con 0x7fa39814ff10 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- 172.21.15.67:0/2020628597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 msgr2=0x7fa398156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- 172.21.15.67:0/2020628597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa398156590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa388009870 tx=0x7fa38801ed30 comp rx=0 tx=0).stop 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- 172.21.15.67:0/2020628597 shutdown_connections 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- 172.21.15.67:0/2020628597 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa39806d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- 172.21.15.67:0/2020628597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa398156590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- 172.21.15.67:0/2020628597 >> 172.21.15.67:0/2020628597 conn(0x7fa3980cb070 msgr2=0x7fa3980cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- 172.21.15.67:0/2020628597 shutdown_connections 2024-01-17T23:01:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- 172.21.15.67:0/2020628597 wait complete. 2024-01-17T23:01:18.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 Processor -- start 2024-01-17T23:01:18.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- start start 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa398141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3980c68c0 0x7fa39813dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398154940 con 0x7fa39814ff10 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39813f5b0 con 0x7fa3980c68c0 2024-01-17T23:01:18.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.546+0000 7fa39ce00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39813f890 con 0x7fa3980c6480 2024-01-17T23:01:18.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.550+0000 7fa396800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.550+0000 7fa396800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50994/0 (socket says 172.21.15.67:50994) 2024-01-17T23:01:18.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.550+0000 7fa396800640 1 -- 172.21.15.67:0/1286939260 learned_addr learned my addr 172.21.15.67:0/1286939260 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 -- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 msgr2=0x7fa398141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa398141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 -- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3980c68c0 msgr2=0x7fa39813dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3980c68c0 0x7fa39813dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 -- 172.21.15.67:0/1286939260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880094d0 con 0x7fa39814ff10 2024-01-17T23:01:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.554+0000 7fa396800640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c7a0 tx=0x7fa39000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.558+0000 7fa38e000640 1 -- 172.21.15.67:0/1286939260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390003b80 con 0x7fa39814ff10 2024-01-17T23:01:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.558+0000 7fa38e000640 1 -- 172.21.15.67:0/1286939260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390003ce0 con 0x7fa39814ff10 2024-01-17T23:01:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.558+0000 7fa38e000640 1 -- 172.21.15.67:0/1286939260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000aa30 con 0x7fa39814ff10 2024-01-17T23:01:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.558+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39813fb70 con 0x7fa39814ff10 2024-01-17T23:01:18.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.558+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa398140130 con 0x7fa39814ff10 2024-01-17T23:01:18.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.562+0000 7fa3a0262000 1 Processor -- start 2024-01-17T23:01:18.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.562+0000 7fa3a0262000 1 -- start start 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8362e8d70 con 0x55b8364cd7d0 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8362e4ba0 con 0x55b836492730 2024-01-17T23:01:18.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.566+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8362e20d0 con 0x55b8364ce0f0 2024-01-17T23:01:18.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.578+0000 7fa395400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.582+0000 7fa395400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:43512/0 (socket says 172.21.15.67:43512) 2024-01-17T23:01:18.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.582+0000 7fa395400640 1 -- 172.21.15.67:0/2614453053 learned_addr learned my addr 172.21.15.67:0/2614453053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.582+0000 7fa395e00640 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.582+0000 7fa38e000640 1 -- 172.21.15.67:0/1286939260 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa39000ab90 con 0x7fa39814ff10 2024-01-17T23:01:18.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.586+0000 7fa38e000640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 0x7fa370068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.586+0000 7fa396800640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 0x7fa370068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.586+0000 7fa396800640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 0x7fa370068d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa39005cc40 tx=0x7fa39005b040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.586+0000 7fa38e000640 1 -- 172.21.15.67:0/1286939260 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa39000ae40 con 0x7fa39814ff10 2024-01-17T23:01:18.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.590+0000 7fa395400640 1 -- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 msgr2=0x55b8364d8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.590+0000 7fa395400640 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.590+0000 7fa395400640 1 -- 172.21.15.67:0/2614453053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 msgr2=0x55b8364cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.590+0000 7fa395400640 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.590+0000 7fa395400640 1 -- 172.21.15.67:0/2614453053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b835fd4890 con 0x55b836492730 2024-01-17T23:01:18.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.594+0000 7fa395400640 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3800017c0 tx=0x7fa380001c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303a501c47da7282 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.606+0000 7fa386a00640 1 -- 172.21.15.67:0/2614453053 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800074f0 con 0x55b836492730 2024-01-17T23:01:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.606+0000 7fa386a00640 1 -- 172.21.15.67:0/2614453053 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380007650 con 0x55b836492730 2024-01-17T23:01:18.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.606+0000 7fa386a00640 1 -- 172.21.15.67:0/2614453053 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380008bd0 con 0x55b836492730 2024-01-17T23:01:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 msgr2=0x55b836492b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa3800017c0 tx=0x7fa380001c80 comp rx=0 tx=0).stop 2024-01-17T23:01:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- 172.21.15.67:0/2614453053 shutdown_connections 2024-01-17T23:01:18.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2614453053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b836492b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- 172.21.15.67:0/2614453053 >> 172.21.15.67:0/2614453053 conn(0x55b8364c9580 msgr2=0x55b8364cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- 172.21.15.67:0/2614453053 shutdown_connections 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- 172.21.15.67:0/2614453053 wait complete. 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- start start 2024-01-17T23:01:18.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 Processor -- start 2024-01-17T23:01:18.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364cd7d0 0x55b8364c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8362dd9c0 con 0x55b836492730 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836295040 con 0x55b8364cd7d0 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b83629aee0 con 0x55b8364ce0f0 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa3a0262000 10 client.0 _ll_register_callbacks cb 0x55b8362981b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa395400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa395400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51024/0 (socket says 172.21.15.67:51024) 2024-01-17T23:01:18.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.610+0000 7fa395400640 1 -- 172.21.15.67:0/2845603025 learned_addr learned my addr 172.21.15.67:0/2845603025 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395e00640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364cd7d0 0x55b8364c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395400640 1 -- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 msgr2=0x55b8364d4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395400640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395400640 1 -- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364cd7d0 msgr2=0x55b8364c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395400640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364cd7d0 0x55b8364c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.614+0000 7fa395400640 1 -- 172.21.15.67:0/2845603025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3800014a0 con 0x55b836492730 2024-01-17T23:01:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.618+0000 7fa395400640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55b836389620 tx=0x7fa380000f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd80ad68415e64 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.618+0000 7fa37f400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:18.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800049f0 con 0x55b836492730 2024-01-17T23:01:18.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa380004b50 con 0x55b836492730 2024-01-17T23:01:18.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b836263e30 con 0x55b836492730 2024-01-17T23:01:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa380004d10 con 0x55b836492730 2024-01-17T23:01:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa3a0262000 10 client.4767 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:18.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.622+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b83629d5e0 con 0x55b836492730 2024-01-17T23:01:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b836263e30 con 0x55b836492730 2024-01-17T23:01:18.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7fa380004030 con 0x55b836492730 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 10 client.4767 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 10 client.4767 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 20 client.4767 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364d5600 0x55b8364d59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 4 client.4767 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T23:01:18.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.626+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 --> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b83629a870 con 0x55b8364d5600 2024-01-17T23:01:18.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.630+0000 7fa395e00640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364d5600 0x55b8364d59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.722+0000 7fa395e00640 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364d5600 0x55b8364d59e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5801fd9f755d4f7a server_cookie=ebf3dcd7fe84229a in_seq=0 out_seq=0 2024-01-17T23:01:18.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.722+0000 7fa37f400640 10 client.4767 ms_handle_connect on v2:172.21.15.137:6834/3667909367 2024-01-17T23:01:18.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa37f400640 1 -- 172.21.15.67:0/2845603025 <== mds.1 v2:172.21.15.137:6834/3667909367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b83629a870 con 0x55b8364d5600 2024-01-17T23:01:18.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa37f400640 10 client.4767 handle_command_reply: tid=0 2024-01-17T23:01:18.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 client.4767 shutdown 2024-01-17T23:01:18.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 msgr2=0x55b8364c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55b836389620 tx=0x7fa380000f70 comp rx=0 tx=0).stop 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 shutdown_connections 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364d5600 0x55b8364d59e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364ce0f0 0x55b8364d4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364cd7d0 0x55b8364c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa37f400640 0 client.4767 ms_handle_reset on v2:172.21.15.137:6834/3667909367 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 --2- 172.21.15.67:0/2845603025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364c7d00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 >> 172.21.15.67:0/2845603025 conn(0x55b8364c9580 msgr2=0x55b8364c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 shutdown_connections 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 1 -- 172.21.15.67:0/2845603025 wait complete. 2024-01-17T23:01:18.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.922+0000 7fa3a0262000 20 client.4767 trim_cache size 0 max 16384 2024-01-17T23:01:18.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 Processor -- start 2024-01-17T23:01:18.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 -- start start 2024-01-17T23:01:18.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364c9580 0x55b8364cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364cd7d0 0x55b8364cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b835f95940 con 0x55b836492730 2024-01-17T23:01:18.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836477ca0 con 0x55b8364c9580 2024-01-17T23:01:18.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b83625fac0 con 0x55b8364cd7d0 2024-01-17T23:01:18.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa395e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa395e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51040/0 (socket says 172.21.15.67:51040) 2024-01-17T23:01:18.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.938+0000 7fa395e00640 1 -- 172.21.15.67:0/499564077 learned_addr learned my addr 172.21.15.67:0/499564077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.942+0000 7fa395e00640 1 -- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364cd7d0 msgr2=0x55b8364cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.942+0000 7fa395e00640 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364cd7d0 0x55b8364cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.942+0000 7fa395e00640 1 -- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364c9580 msgr2=0x55b8364cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.942+0000 7fa395e00640 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364c9580 0x55b8364cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.942+0000 7fa395e00640 1 -- 172.21.15.67:0/499564077 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8362838e0 con 0x55b836492730 2024-01-17T23:01:18.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.946+0000 7fa395e00640 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa388000c10 tx=0x7fa388004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821aa4903deb929f server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.946+0000 7fa386000640 1 -- 172.21.15.67:0/499564077 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880c4d80 con 0x55b836492730 2024-01-17T23:01:18.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.946+0000 7fa386000640 1 -- 172.21.15.67:0/499564077 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880c4390 con 0x55b836492730 2024-01-17T23:01:18.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.946+0000 7fa386000640 1 -- 172.21.15.67:0/499564077 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880c4700 con 0x55b836492730 2024-01-17T23:01:18.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- 172.21.15.67:0/499564077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 msgr2=0x55b8364cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:18.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa388000c10 tx=0x7fa388004740 comp rx=0 tx=0).stop 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- 172.21.15.67:0/499564077 shutdown_connections 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364cd7d0 0x55b8364cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b836492730 0x55b8364cbeb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- 172.21.15.67:0/499564077 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8364c9580 0x55b8364cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- 172.21.15.67:0/499564077 >> 172.21.15.67:0/499564077 conn(0x55b8364c9140 msgr2=0x55b8364e01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- 172.21.15.67:0/499564077 shutdown_connections 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- 172.21.15.67:0/499564077 wait complete. 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- start start 2024-01-17T23:01:18.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 Processor -- start 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b8364e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364c9580 0x55b8364e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8362dadc0 con 0x55b8364cd7d0 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b835fd51b0 con 0x55b836492730 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8362e63f0 con 0x55b8364c9580 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa3a0262000 10 client.0 _ll_register_callbacks cb 0x55b83630aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.950+0000 7fa395400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51044/0 (socket says 172.21.15.67:51044) 2024-01-17T23:01:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 -- 172.21.15.67:0/3346212223 learned_addr learned my addr 172.21.15.67:0/3346212223 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 -- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364c9580 msgr2=0x55b8364e0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364c9580 0x55b8364e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 -- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 msgr2=0x55b8364e04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b8364e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.954+0000 7fa395400640 1 -- 172.21.15.67:0/3346212223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39806cf00 con 0x55b8364cd7d0 2024-01-17T23:01:18.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.958+0000 7fa395400640 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3800017b0 tx=0x7fa380009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9fdac4712932fc server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:18.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.958+0000 7fa37f400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380004cb0 con 0x55b8364cd7d0 2024-01-17T23:01:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa380008990 con 0x55b8364cd7d0 2024-01-17T23:01:18.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b83628f4f0 con 0x55b8364cd7d0 2024-01-17T23:01:18.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa380008b50 con 0x55b8364cd7d0 2024-01-17T23:01:18.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa3a0262000 10 client.4773 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:18.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.962+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b835fd4cc0 con 0x55b8364cd7d0 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b83628f4f0 con 0x55b8364cd7d0 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7fa380008cb0 con 0x55b8364cd7d0 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 10 client.4773 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 10 client.4773 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 20 client.4773 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364ce0f0 0x55b8364f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 4 client.4773 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T23:01:18.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.966+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 --> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b8362dc310 con 0x55b8364ce0f0 2024-01-17T23:01:18.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.970+0000 7fa395e00640 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364ce0f0 0x55b8364f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.978+0000 7fa395e00640 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364ce0f0 0x55b8364f4dd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86e7c83a1a77e4b0 server_cookie=fed331eabb9b8674 in_seq=0 out_seq=0 2024-01-17T23:01:18.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:18.978+0000 7fa37f400640 10 client.4773 ms_handle_connect on v2:172.21.15.137:6834/3667909367 2024-01-17T23:01:19.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa37f400640 1 -- 172.21.15.67:0/3346212223 <== mds.1 v2:172.21.15.137:6834/3667909367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b8362dc310 con 0x55b8364ce0f0 2024-01-17T23:01:19.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa37f400640 10 client.4773 handle_command_reply: tid=0 2024-01-17T23:01:19.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 client.4773 shutdown 2024-01-17T23:01:19.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 msgr2=0x55b8364f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3800017b0 tx=0x7fa380009ad0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 shutdown_connections 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:6834/3667909367,v1:172.21.15.137:6835/3667909367] conn(0x55b8364ce0f0 0x55b8364f4dd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b8364cd7d0 0x55b8364f4890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55b8364c9580 0x55b8364e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 --2- 172.21.15.67:0/3346212223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b836492730 0x55b8364e04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa37f400640 0 client.4773 ms_handle_reset on v2:172.21.15.137:6834/3667909367 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 >> 172.21.15.67:0/3346212223 conn(0x55b8364c9140 msgr2=0x55b8364df960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 shutdown_connections 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 1 -- 172.21.15.67:0/3346212223 wait complete. 2024-01-17T23:01:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa3a0262000 20 client.4773 trim_cache size 0 max 16384 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1", 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 1, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4276, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 25.571607140000001, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 14, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 29, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 29, 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 86.457539474000001 2024-01-17T23:01:19.016 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 msgr2=0x7fa370068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 0x7fa370068d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa39005cc40 tx=0x7fa39005b040 comp rx=0 tx=0).stop 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 msgr2=0x7fa39813e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c7a0 tx=0x7fa39000cc60 comp rx=0 tx=0).stop 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.010+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 shutdown_connections 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa370066890 0x7fa370068d50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa39814ff10 0x7fa39813e1d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3980c68c0 0x7fa39813dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 --2- 172.21.15.67:0/1286939260 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa3980c6480 0x7fa398141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 >> 172.21.15.67:0/1286939260 conn(0x7fa3980cb070 msgr2=0x7fa3980c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 shutdown_connections 2024-01-17T23:01:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.014+0000 7fa39ce00640 1 -- 172.21.15.67:0/1286939260 wait complete. 2024-01-17T23:01:19.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-01-17T23:01:19.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 Processor -- start 2024-01-17T23:01:19.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 -- start start 2024-01-17T23:01:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 0x7f3e1c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c06dc10 con 0x7f3e1c0c0090 2024-01-17T23:01:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c06d7e0 con 0x7f3e1c0c5a70 2024-01-17T23:01:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.174+0000 7f3e24a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1564c0 con 0x7f3e1c150560 2024-01-17T23:01:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.178+0000 7f3e22a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3e1c0c0090 0x7f3e1c160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:39654/0 (socket says 172.21.15.67:39654) 2024-01-17T23:01:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.178+0000 7f3e22a00640 1 -- 172.21.15.67:0/292351438 learned_addr learned my addr 172.21.15.67:0/292351438 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.178+0000 7f3e22000640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 0x7f3e1c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.178+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190594381 0 0) 0x7f3e1c06dc10 con 0x7f3e1c0c0090 2024-01-17T23:01:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.178+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dfc003530 con 0x7f3e1c0c0090 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238575046 0 0) 0x7f3dfc003530 con 0x7f3e1c0c0090 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 msgr2=0x7f3e1c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 0x7f3e1c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 >> v1:172.21.15.137:6789/0 conn(0x7f3e1c0c5a70 legacy=0x7f3e1c0722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c06d220 con 0x7f3e1c0c0090 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f3e14001a20 con 0x7f3e1c0c0090 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 >> v1:172.21.15.67:6789/0 conn(0x7f3e1c0c0090 legacy=0x7f3e1c160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc0039b0 0x7f3dfc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 0x7f3dfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dfc004d10 0x7f3dfc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1564c0 con 0x7f3dfc004d10 2024-01-17T23:01:19.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00dd30 con 0x7f3dfc0039b0 2024-01-17T23:01:19.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.182+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00def0 con 0x7f3e1c150560 2024-01-17T23:01:19.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.186+0000 7f3e22a00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dfc004d10 0x7f3dfc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.190+0000 7f3e22a00640 1 -- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 msgr2=0x7f3dfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.190+0000 7f3e22a00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c150560 0x7f3dfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.190+0000 7f3e22a00640 1 -- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc0039b0 msgr2=0x7f3dfc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.190+0000 7f3e22a00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc0039b0 0x7f3dfc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.190+0000 7f3e22a00640 1 -- 172.21.15.67:0/292351438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc003530 con 0x7f3dfc004d10 2024-01-17T23:01:19.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.194+0000 7f3e22a00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dfc004d10 0x7f3dfc005190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400a7e0 tx=0x7f3e1401fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a08ab90764ef2d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140ac640 con 0x7f3dfc004d10 2024-01-17T23:01:19.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e140ac7a0 con 0x7f3dfc004d10 2024-01-17T23:01:19.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e20c00640 1 -- 172.21.15.67:0/292351438 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140acb50 con 0x7f3dfc004d10 2024-01-17T23:01:19.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 -- 172.21.15.67:0/292351438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dfc004d10 msgr2=0x7f3dfc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 --2- 172.21.15.67:0/292351438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dfc004d10 0x7f3dfc005190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400a7e0 tx=0x7f3e1401fa20 comp rx=0 tx=0).stop 2024-01-17T23:01:19.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e22a00640 1 -- 172.21.15.67:0/292351438 reap_dead start 2024-01-17T23:01:19.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 -- 172.21.15.67:0/292351438 shutdown_connections 2024-01-17T23:01:19.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 -- 172.21.15.67:0/292351438 >> 172.21.15.67:0/292351438 conn(0x7f3e1c0cb070 msgr2=0x7f3e1c0cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 -- 172.21.15.67:0/292351438 shutdown_connections 2024-01-17T23:01:19.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.198+0000 7f3e24a00640 1 -- 172.21.15.67:0/292351438 wait complete. 2024-01-17T23:01:19.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 Processor -- start 2024-01-17T23:01:19.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 -- start start 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc004d10 0x7f3e1c1efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c157ec0 0x7f3e1c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1ef970 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0713d0 con 0x7f3dfc004d10 2024-01-17T23:01:19.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e24a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0ad0c0 con 0x7f3e1c157ec0 2024-01-17T23:01:19.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e22a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e22a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51074/0 (socket says 172.21.15.67:51074) 2024-01-17T23:01:19.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e22a00640 1 -- 172.21.15.67:0/4279850391 learned_addr learned my addr 172.21.15.67:0/4279850391 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e22000640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc004d10 0x7f3e1c1efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.202+0000 7f3e21600640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c157ec0 0x7f3e1c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.206+0000 7f3e22a00640 1 -- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c157ec0 msgr2=0x7f3e1c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.206+0000 7f3e22a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c157ec0 0x7f3e1c0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.206+0000 7f3e22a00640 1 -- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc004d10 msgr2=0x7f3e1c1efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.206+0000 7f3e22a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc004d10 0x7f3e1c1efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.206+0000 7f3e22a00640 1 -- 172.21.15.67:0/4279850391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0ad3a0 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.210+0000 7f3e22a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400a7e0 tx=0x7f3dfc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.214+0000 7f3e1a000640 1 -- 172.21.15.67:0/4279850391 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140ac640 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.214+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c0ad680 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.214+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c15a6a0 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.214+0000 7f3e1a000640 1 -- 172.21.15.67:0/4279850391 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14001290 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.214+0000 7f3e1a000640 1 -- 172.21.15.67:0/4279850391 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14004d70 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 Processor -- start 2024-01-17T23:01:19.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 -- start start 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c10cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c117a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf27d70 con 0x55f64c10d0f0 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf23ba0 con 0x55f64c0d1730 2024-01-17T23:01:19.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.218+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf210d0 con 0x55f64c10c7d0 2024-01-17T23:01:19.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.222+0000 7f3e21600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.222+0000 7f3e21600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:43578/0 (socket says 172.21.15.67:43578) 2024-01-17T23:01:19.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.222+0000 7f3e21600640 1 -- 172.21.15.67:0/1797945733 learned_addr learned my addr 172.21.15.67:0/1797945733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.222+0000 7f3e22000640 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c10cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.222+0000 7f3e21600640 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c117a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.226+0000 7f3e21600640 1 -- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 msgr2=0x55f64c10cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.226+0000 7f3e21600640 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c10cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.226+0000 7f3e21600640 1 -- 172.21.15.67:0/1797945733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 msgr2=0x55f64c117a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.226+0000 7f3e21600640 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c117a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.226+0000 7f3e21600640 1 -- 172.21.15.67:0/1797945733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f64bc13890 con 0x55f64c0d1730 2024-01-17T23:01:19.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.234+0000 7f3e21600640 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001900 tx=0x7f3e04001370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb670459c304d1f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.234+0000 7f3e1a000640 1 -- 172.21.15.67:0/4279850391 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3e140be070 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.238+0000 7f3e1a000640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 0x7f3df4068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.238+0000 7f3e22000640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 0x7f3df4068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.238+0000 7f3e22000640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 0x7f3df4068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0093b0 tx=0x7f3e0c009320 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.238+0000 7f3e1a000640 1 -- 172.21.15.67:0/4279850391 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e140f3af0 con 0x7f3e1c0acbf0 2024-01-17T23:01:19.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.246+0000 7f3e12a00640 1 -- 172.21.15.67:0/1797945733 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04005310 con 0x55f64c0d1730 2024-01-17T23:01:19.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.246+0000 7f3e12a00640 1 -- 172.21.15.67:0/1797945733 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04005470 con 0x55f64c0d1730 2024-01-17T23:01:19.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.246+0000 7f3e12a00640 1 -- 172.21.15.67:0/1797945733 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04013a70 con 0x55f64c0d1730 2024-01-17T23:01:19.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 msgr2=0x55f64c0d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001900 tx=0x7f3e04001370 comp rx=0 tx=0).stop 2024-01-17T23:01:19.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1797945733 shutdown_connections 2024-01-17T23:01:19.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c117a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c10cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1797945733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c0d1b10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1797945733 >> 172.21.15.67:0/1797945733 conn(0x55f64c108580 msgr2=0x55f64c10a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1797945733 shutdown_connections 2024-01-17T23:01:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1797945733 wait complete. 2024-01-17T23:01:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- start start 2024-01-17T23:01:19.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 Processor -- start 2024-01-17T23:01:19.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c106d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c107240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf1c9c0 con 0x55f64c10d0f0 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bed4040 con 0x55f64c0d1730 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64bed9ee0 con 0x55f64c10c7d0 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e27ed8000 10 client.0 _ll_register_callbacks cb 0x55f64bed71b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e22a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e22a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51090/0 (socket says 172.21.15.67:51090) 2024-01-17T23:01:19.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.250+0000 7f3e22a00640 1 -- 172.21.15.67:0/1156571034 learned_addr learned my addr 172.21.15.67:0/1156571034 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.254+0000 7f3e22a00640 1 -- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 msgr2=0x55f64c107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.254+0000 7f3e22a00640 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.254+0000 7f3e22a00640 1 -- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 msgr2=0x55f64c106d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.254+0000 7f3e22a00640 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c106d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.254+0000 7f3e22a00640 1 -- 172.21.15.67:0/1156571034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c06d7e0 con 0x55f64c10d0f0 2024-01-17T23:01:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.258+0000 7f3e22a00640 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e140fb8a0 tx=0x7f3e140fbf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35916ba4661f054c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.258+0000 7f3e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140f2fe0 con 0x55f64c10d0f0 2024-01-17T23:01:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e140f3140 con 0x55f64c10d0f0 2024-01-17T23:01:19.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f64bea2e30 con 0x55f64c10d0f0 2024-01-17T23:01:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e140fb940 con 0x55f64c10d0f0 2024-01-17T23:01:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e27ed8000 10 client.4782 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:19.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.262+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f64bedc5e0 con 0x55f64c10d0f0 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f64bea2e30 con 0x55f64c10d0f0 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f3e140c8070 con 0x55f64c10d0f0 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 10 client.4782 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 10 client.4782 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 20 client.4782 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c0cd640 0x55f64c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 4 client.4782 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-17T23:01:19.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.266+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 --> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f64bed9870 con 0x55f64c0cd640 2024-01-17T23:01:19.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.270+0000 7f3e22000640 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c0cd640 0x55f64c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.278+0000 7f3e22000640 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c0cd640 0x55f64c0cda20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa560cbfe569c26b server_cookie=335348697421a2f1 in_seq=0 out_seq=0 2024-01-17T23:01:19.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.278+0000 7f3e0b400640 10 client.4782 ms_handle_connect on v2:172.21.15.137:6837/2865340697 2024-01-17T23:01:19.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.314+0000 7f3e0b400640 1 -- 172.21.15.67:0/1156571034 <== mds.0 v2:172.21.15.137:6837/2865340697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f64bed9870 con 0x55f64c0cd640 2024-01-17T23:01:19.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.314+0000 7f3e0b400640 10 client.4782 handle_command_reply: tid=0 2024-01-17T23:01:19.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.314+0000 7f3e27ed8000 1 client.4782 shutdown 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.314+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 msgr2=0x55f64c0cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.314+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3e140fb8a0 tx=0x7f3e140fbf10 comp rx=0 tx=0).stop 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 shutdown_connections 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c0cd640 0x55f64c0cda20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10d0f0 0x55f64c0cc8a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10c7d0 0x55f64c107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e0b400640 0 client.4782 ms_handle_reset on v2:172.21.15.137:6837/2865340697 2024-01-17T23:01:19.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1156571034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 >> 172.21.15.67:0/1156571034 conn(0x55f64c108580 msgr2=0x55f64c107d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 shutdown_connections 2024-01-17T23:01:19.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1156571034 wait complete. 2024-01-17T23:01:19.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.318+0000 7f3e27ed8000 20 client.4782 trim_cache size 0 max 16384 2024-01-17T23:01:19.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 Processor -- start 2024-01-17T23:01:19.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 -- start start 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c10b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10d0f0 0x55f64c123ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bbd4940 con 0x55f64c10c7d0 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf7bc90 con 0x55f64c0d1730 2024-01-17T23:01:19.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf1d270 con 0x55f64c10d0f0 2024-01-17T23:01:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e21600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e22000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c10b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e21600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51100/0 (socket says 172.21.15.67:51100) 2024-01-17T23:01:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e21600640 1 -- 172.21.15.67:0/1020815353 learned_addr learned my addr 172.21.15.67:0/1020815353 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.334+0000 7f3e22a00640 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10d0f0 0x55f64c123ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 -- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10d0f0 msgr2=0x55f64c123ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10d0f0 0x55f64c123ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 -- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 msgr2=0x55f64c10b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c10b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 -- 172.21.15.67:0/1020815353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f64bec28e0 con 0x55f64c10c7d0 2024-01-17T23:01:19.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.338+0000 7f3e21600640 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f64bfc8620 tx=0x7f3e040077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2271cdc63159f1c server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e12000640 1 -- 172.21.15.67:0/1020815353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04001450 con 0x55f64c10c7d0 2024-01-17T23:01:19.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e12000640 1 -- 172.21.15.67:0/1020815353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04005110 con 0x55f64c10c7d0 2024-01-17T23:01:19.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e12000640 1 -- 172.21.15.67:0/1020815353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040054c0 con 0x55f64c10c7d0 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1020815353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 msgr2=0x55f64c10bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f64bfc8620 tx=0x7f3e040077f0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1020815353 shutdown_connections 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c10d0f0 0x55f64c123ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c10bec0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/1020815353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c0d1730 0x55f64c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1020815353 >> 172.21.15.67:0/1020815353 conn(0x55f64c108580 msgr2=0x55f64c1073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1020815353 shutdown_connections 2024-01-17T23:01:19.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.342+0000 7f3e27ed8000 1 -- 172.21.15.67:0/1020815353 wait complete. 2024-01-17T23:01:19.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 -- start start 2024-01-17T23:01:19.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 Processor -- start 2024-01-17T23:01:19.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c0d1730 0x55f64c16b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c10d0f0 0x55f64c125e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf19dc0 con 0x55f64c10c7d0 2024-01-17T23:01:19.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64bf5d440 con 0x55f64c10d0f0 2024-01-17T23:01:19.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64bee3eb0 con 0x55f64c0d1730 2024-01-17T23:01:19.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e27ed8000 10 client.0 _ll_register_callbacks cb 0x55f64bf49a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-17T23:01:19.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e22000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c0d1730 0x55f64c16b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e21600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e21600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51102/0 (socket says 172.21.15.67:51102) 2024-01-17T23:01:19.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.346+0000 7f3e21600640 1 -- 172.21.15.67:0/2419627967 learned_addr learned my addr 172.21.15.67:0/2419627967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e22a00640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c10d0f0 0x55f64c125e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e21600640 1 -- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c0d1730 msgr2=0x55f64c16b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e21600640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c0d1730 0x55f64c16b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e21600640 1 -- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c10d0f0 msgr2=0x55f64c125e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-17T23:01:19.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e21600640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c10d0f0 0x55f64c125e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.350+0000 7f3e21600640 1 -- 172.21.15.67:0/2419627967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0401b040 con 0x55f64c10c7d0 2024-01-17T23:01:19.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.354+0000 7f3e21600640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005040 tx=0x7f3e04007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8546f44555843f32 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.354+0000 7f3e0b400640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-01-17T23:01:19.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.358+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04007020 con 0x55f64c10c7d0 2024-01-17T23:01:19.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.358+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e04007180 con 0x55f64c10c7d0 2024-01-17T23:01:19.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.358+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f64c0cab80 con 0x55f64c10c7d0 2024-01-17T23:01:19.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.362+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e04007380 con 0x55f64c10c7d0 2024-01-17T23:01:19.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.362+0000 7f3e27ed8000 10 client.4788 fetch_fsmap learned FSMap version 14 2024-01-17T23:01:19.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.362+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55f64bc13cc0 con 0x55f64c10c7d0 2024-01-17T23:01:19.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f64c0cab80 con 0x55f64c10c7d0 2024-01-17T23:01:19.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f3e040074e0 con 0x55f64c10c7d0 2024-01-17T23:01:19.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 10 client.4788 fetch_fsmap finished waiting for FSMap version 14 2024-01-17T23:01:19.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 10 client.4788 resolve_mds: resolved name 'f' to daemon mds.f 2024-01-17T23:01:19.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 20 client.4788 populate_metadata read hostname 'smithi067' 2024-01-17T23:01:19.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c126700 0x55f64c126ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 4 client.4788 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-17T23:01:19.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 --> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f64bece4f0 con 0x55f64c126700 2024-01-17T23:01:19.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.366+0000 7f3e22000640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c126700 0x55f64c126ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.374+0000 7f3e22000640 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c126700 0x55f64c126ae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71dbc80de0e8bb15 server_cookie=d1298cf0b925360e in_seq=0 out_seq=0 2024-01-17T23:01:19.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.374+0000 7f3e0b400640 10 client.4788 ms_handle_connect on v2:172.21.15.137:6837/2865340697 2024-01-17T23:01:19.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e0b400640 1 -- 172.21.15.67:0/2419627967 <== mds.0 v2:172.21.15.137:6837/2865340697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f64bece4f0 con 0x55f64c126700 2024-01-17T23:01:19.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e0b400640 10 client.4788 handle_command_reply: tid=0 2024-01-17T23:01:19.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 client.4788 shutdown 2024-01-17T23:01:19.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 msgr2=0x55f64c16bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e04005040 tx=0x7f3e04007de0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 shutdown_connections 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:6837/2865340697,v1:172.21.15.137:6839/2865340697] conn(0x55f64c126700 0x55f64c126ae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f64c10d0f0 0x55f64c125e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f64c10c7d0 0x55f64c16bd00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 --2- 172.21.15.67:0/2419627967 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x55f64c0d1730 0x55f64c16b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e0b400640 0 client.4788 ms_handle_reset on v2:172.21.15.137:6837/2865340697 2024-01-17T23:01:19.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 >> 172.21.15.67:0/2419627967 conn(0x55f64c108580 msgr2=0x55f64c10bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 shutdown_connections 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 1 -- 172.21.15.67:0/2419627967 wait complete. 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.382+0000 7f3e27ed8000 20 client.4788 trim_cache size 0 max 16384 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1", 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4282, 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-01-17T23:01:19.388 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 60.108192791999997, 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 14, 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 29, 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 29, 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 86.762467595999993 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-17T23:01:19.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 msgr2=0x7f3df4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 0x7f3df4068d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0093b0 tx=0x7f3e0c009320 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 msgr2=0x7f3e1c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400a7e0 tx=0x7f3dfc005800 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 shutdown_connections 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3df4066840 0x7f3df4068d00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e1c0acbf0 0x7f3e1c1598a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3e1c157ec0 0x7f3e1c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 --2- 172.21.15.67:0/4279850391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3dfc004d10 0x7f3e1c1efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 >> 172.21.15.67:0/4279850391 conn(0x7f3e1c0cb070 msgr2=0x7f3e1c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 shutdown_connections 2024-01-17T23:01:19.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.386+0000 7f3e24a00640 1 -- 172.21.15.67:0/4279850391 wait complete. 2024-01-17T23:01:19.409 INFO:teuthology.run_tasks:Running task kclient... 2024-01-17T23:01:19.422 INFO:tasks.kclient:Mounting kernel clients... 2024-01-17T23:01:19.422 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-17T23:01:19.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:19.422 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-17T23:01:19.431 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-17T23:01:19.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:19.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-17T23:01:19.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:19.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-01-17T23:01:19.706 INFO:tasks.kclient:client.0 config is {} 2024-01-17T23:01:19.706 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-17T23:01:19.706 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:19.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-17T23:01:19.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 Processor -- start 2024-01-17T23:01:19.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 -- start start 2024-01-17T23:01:19.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f699c0c79c0 0x7f699c061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c0c9890 con 0x7f699c061640 2024-01-17T23:01:19.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c159bf0 con 0x7f699c1539a0 2024-01-17T23:01:19.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f69a1400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c06d570 con 0x7f699c0c79c0 2024-01-17T23:01:19.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f6999e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f699c0c79c0 0x7f699c061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f699a800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f699c1539a0 0x7f699c0ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:49598/0 (socket says 172.21.15.67:49598) 2024-01-17T23:01:19.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.846+0000 7f699a800640 1 -- 172.21.15.67:0/3082297785 learned_addr learned my addr 172.21.15.67:0/3082297785 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-17T23:01:19.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.850+0000 7f6999e00640 1 -- 172.21.15.67:0/3082297785 >> v1:172.21.15.137:6789/0 conn(0x7f699c1539a0 legacy=0x7f699c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.850+0000 7f6999e00640 1 -- 172.21.15.67:0/3082297785 >> v1:172.21.15.67:6789/0 conn(0x7f699c061640 legacy=0x7f699c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.850+0000 7f6999e00640 1 -- 172.21.15.67:0/3082297785 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c159eb0 con 0x7f699c0c79c0 2024-01-17T23:01:19.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.854+0000 7f6999e00640 1 --2- 172.21.15.67:0/3082297785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c0c79c0 0x7f699c061100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f699c159de0 tx=0x7f698401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bca2afa9c6f4c20 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.858+0000 7f6999400640 1 -- 172.21.15.67:0/3082297785 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840ab5f0 con 0x7f699c0c79c0 2024-01-17T23:01:19.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.858+0000 7f6999400640 1 -- 172.21.15.67:0/3082297785 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840ab750 con 0x7f699c0c79c0 2024-01-17T23:01:19.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.858+0000 7f6999400640 1 -- 172.21.15.67:0/3082297785 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840abae0 con 0x7f699c0c79c0 2024-01-17T23:01:19.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- 172.21.15.67:0/3082297785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c0c79c0 msgr2=0x7f699c061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 --2- 172.21.15.67:0/3082297785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c0c79c0 0x7f699c061100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f699c159de0 tx=0x7f698401c3f0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- 172.21.15.67:0/3082297785 shutdown_connections 2024-01-17T23:01:19.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 --2- 172.21.15.67:0/3082297785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c0c79c0 0x7f699c061100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- 172.21.15.67:0/3082297785 >> 172.21.15.67:0/3082297785 conn(0x7f699c06ad40 msgr2=0x7f699c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:19.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- 172.21.15.67:0/3082297785 shutdown_connections 2024-01-17T23:01:19.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- 172.21.15.67:0/3082297785 wait complete. 2024-01-17T23:01:19.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 Processor -- start 2024-01-17T23:01:19.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- start start 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c0c79c0 0x7f699c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f699c1539a0 0x7f699c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c1569c0 con 0x7f699c061640 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0cbf40 con 0x7f699c0c79c0 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f69a1400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c1560b0 con 0x7f699c1539a0 2024-01-17T23:01:19.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.862+0000 7f699a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f699a800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51120/0 (socket says 172.21.15.67:51120) 2024-01-17T23:01:19.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f699a800640 1 -- 172.21.15.67:0/3584464364 learned_addr learned my addr 172.21.15.67:0/3584464364 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-17T23:01:19.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f6999e00640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c0c79c0 0x7f699c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f699b200640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f699c1539a0 0x7f699c0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f699a800640 1 -- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f699c1539a0 msgr2=0x7f699c0cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.866+0000 7f699a800640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f699c1539a0 0x7f699c0cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.870+0000 7f699a800640 1 -- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c0c79c0 msgr2=0x7f699c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.870+0000 7f699a800640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c0c79c0 0x7f699c154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:19.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.870+0000 7f699a800640 1 -- 172.21.15.67:0/3584464364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6984009420 con 0x7f699c061640 2024-01-17T23:01:19.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.870+0000 7f699a800640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c370 tx=0x7f698c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c005cf0 con 0x7f699c061640 2024-01-17T23:01:19.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c1599c0 con 0x7f699c061640 2024-01-17T23:01:19.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c14e8c0 con 0x7f699c061640 2024-01-17T23:01:19.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c005e50 con 0x7f699c061640 2024-01-17T23:01:19.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0072d0 con 0x7f699c061640 2024-01-17T23:01:19.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.874+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c0746a0 con 0x7f699c061640 2024-01-17T23:01:19.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.894+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f698c007430 con 0x7f699c061640 2024-01-17T23:01:19.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.894+0000 7f6992a00640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 0x7f6974068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-17T23:01:19.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.894+0000 7f6999e00640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 0x7f6974068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-17T23:01:19.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.898+0000 7f6999e00640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 0x7f6974068d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69840af000 tx=0x7f69840a7000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-17T23:01:19.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:19.898+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f698c054e00 con 0x7f699c061640 2024-01-17T23:01:20.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.146+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f698c051140 con 0x7f699c061640 2024-01-17T23:01:20.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.342+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f699c06b620 con 0x7f699c061640 2024-01-17T23:01:20.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.346+0000 7f6992a00640 1 -- 172.21.15.67:0/3584464364 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+88 (secure 0 0 0) 0x7f698c021070 con 0x7f699c061640 2024-01-17T23:01:20.350 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.346+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 msgr2=0x7f6974068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.346+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 0x7f6974068d30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69840af000 tx=0x7f69840a7000 comp rx=0 tx=0).stop 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.346+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 msgr2=0x7f699c156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.346+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c370 tx=0x7f698c00c830 comp rx=0 tx=0).stop 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 shutdown_connections 2024-01-17T23:01:20.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6974066870 0x7f6974068d30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f699c1539a0 0x7f699c0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c0c79c0 0x7f699c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 --2- 172.21.15.67:0/3584464364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f699c061640 0x7f699c156de0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 >> 172.21.15.67:0/3584464364 conn(0x7f699c06ad40 msgr2=0x7f699c0c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 shutdown_connections 2024-01-17T23:01:20.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-17T23:01:20.350+0000 7f69a1400640 1 -- 172.21.15.67:0/3584464364 wait complete. 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-17T23:01:20.373 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-17T23:01:20.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.374 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-01-17T23:01:20.383 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 38116sec preferred_lft 38116sec 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 02:42:01:41:8f:bb brd ff:ff:ff:ff:ff:ff 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-17T23:01:20.384 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-01-17T23:01:20.385 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-17T23:01:20.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-17T23:01:20.385 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:01:20.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.497 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-17T23:01:20.516 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-01-17T23:01:20.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.519 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-01-17T23:01:20.570 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-01-17T23:01:20.570 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-17T23:01:20.570 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-17T23:01:20.570 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-17T23:01:20.570 INFO:teuthology.orchestra.run.smithi067.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-17T23:01:20.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-17T23:01:20.571 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:01:20.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.662 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-17T23:01:20.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.671 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-01-17T23:01:20.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.721 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:01:20.721 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:01:20.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-17T23:01:20.721 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-17T23:01:20.721 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:01:20.801 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-17T23:01:20.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.801 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-17T23:01:20.802 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:01:20.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:20.943 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2024-01-17T23:01:20.943 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-01-17T23:01:20.943 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-01-17T23:01:20.943 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-01-17T23:01:20.943 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-01-17T23:01:20.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T23:01:20.983 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:21.031 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-17T23:01:21.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-17T23:01:21.032 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:21.087 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-17T23:01:21.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:21.087 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T23:01:21.177 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T23:01:21.177 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-17T23:01:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-17T23:01:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-17T23:01:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.137:3300,172.21.15.137:3301" 2024-01-17T23:01:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1.cephfs=/ 2024-01-17T23:01:22.243 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.67:3300/172.21.15.137:3300/172.21.15.137:3301" will pass to kernel 2024-01-17T23:01:22.247 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-17T23:01:22.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:22.247 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:22.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:22.267 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T23:01:22.338 INFO:teuthology.orchestra.run.smithi067.stdout:client4607 2024-01-17T23:01:22.338 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T23:01:22.338 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-17T23:01:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:22.388 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T23:01:22.467 INFO:teuthology.orchestra.run.smithi067.stdout:client4607 2024-01-17T23:01:22.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:22.467 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-17T23:01:22.545 INFO:teuthology.orchestra.run.smithi067.stdout:client4607 2024-01-17T23:01:22.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-17T23:01:22.546 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1.client4607/status') 2024-01-17T23:01:22.607 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4607 (3)172.21.15.67:0/1676712360 2024-01-17T23:01:22.607 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-01-17T23:01:22.607 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-01-17T23:01:22.607 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-01-17T23:01:22.607 INFO:teuthology.orchestra.run.smithi067.stderr:70 bytes copied, 6.6201e-05 s, 1.1 MB/s 2024-01-17T23:01:22.609 INFO:teuthology.run_tasks:Running task workunit... 2024-01-17T23:01:22.621 INFO:tasks.workunit:Pulling workunits from ref 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T23:01:22.621 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-17T23:01:22.621 INFO:tasks.workunit:timeout=6h 2024-01-17T23:01:22.621 INFO:tasks.workunit:cleanup=True 2024-01-17T23:01:22.621 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:22.659 INFO:teuthology.orchestra.run.smithi067.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:22.659 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-01-17 23:00:19.561219685 +0000 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-01-17 23:00:34.740045446 +0000 2024-01-17T23:01:22.660 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-01-17 23:00:19.561219685 +0000 2024-01-17T23:01:22.660 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-17T23:01:22.660 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-17T23:01:23.749 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 2024-01-17T23:01:23.760 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-17T23:01:35.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:01:35.364 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:05.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:05.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:33.421 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 65% (7968/12176) Updating files: 66% (8037/12176) Updating files: 67% (8158/12176) Updating files: 68% (8280/12176) Updating files: 69% (8402/12176) Updating files: 70% (8524/12176) Updating files: 71% (8645/12176) Updating files: 72% (8767/12176) Updating files: 73% (8889/12176) Updating files: 74% (9011/12176) Updating files: 75% (9132/12176) Updating files: 76% (9254/12176) Updating files: 77% (9376/12176) Updating files: 78% (9498/12176) Updating files: 79% (9620/12176) Updating files: 80% (9741/12176) Updating files: 81% (9863/12176) Updating files: 82% (9985/12176) Updating files: 83% (10107/12176) Updating files: 84% (10228/12176) Updating files: 85% (10350/12176) Updating files: 86% (10472/12176) Updating files: 87% (10594/12176) Updating files: 88% (10715/12176) Updating files: 89% (10837/12176) Updating files: 90% (10959/12176) Updating files: 91% (11081/12176) Updating files: 92% (11202/12176) Updating files: 93% (11324/12176) Updating files: 94% (11446/12176) Updating files: 95% (11568/12176) Updating files: 96% (11689/12176) Updating files: 97% (11811/12176) Updating files: 98% (11933/12176) Updating files: 99% (12055/12176) Updating files: 100% (12176/12176) Updating files: 100% (12176/12176), done. 2024-01-17T23:02:33.824 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '1ec1182e55b4a38b17dd0d004d9fa6814d0269d4'. 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-01-17T23:02:33.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.826 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-17T23:02:33.826 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-01-17T23:02:33.826 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 1ec1182e55b Merge pull request #53678 from cbodley/wip-qa-rgw-upgrade-reef 2024-01-17T23:02:33.828 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-17T23:02:33.837 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-17T23:02:33.840 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T23:02:33.840 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-17T23:02:34.633 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-17T23:02:34.736 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-17T23:02:34.792 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-17T23:02:34.795 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T23:02:34.795 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-17T23:02:34.849 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-17T23:02:34.854 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-17T23:02:34.854 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-17T23:02:34.908 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-01-17T23:02:34.909 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-01-17T23:02:34.909 DEBUG:teuthology.orchestra.run.smithi067:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ec1182e55b4a38b17dd0d004d9fa6814d0269d4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-01-17T23:02:35.181 INFO:tasks.workunit.client.0.smithi067.stderr:+ mkdir -p fsstress 2024-01-17T23:02:35.229 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd fsstress 2024-01-17T23:02:35.229 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:02:35.229 INFO:tasks.workunit.client.0.smithi067.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-01-17T23:02:35.570 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:35.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:02:36.288 INFO:tasks.workunit.client.0.smithi067.stderr:+ tar xzf ltp-full.tgz 2024-01-17T23:03:05.697 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:05.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:35.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:03:35.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:05.944 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:05.949 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:35.999 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:04:36.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:06.121 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:06.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:36.251 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:05:36.255 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:06.330 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:06.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:36.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:06:36.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:06.446 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:06.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:36.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:07:36.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:06.633 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:06.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:34.891 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:09:23.106 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:34.954 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:09:23.170 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.094 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:09:23.404 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.131 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:09:23.440 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.220 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:09:23.529 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.266 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:09:23.576 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.400 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:09:23.616 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.878 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:09:24.187 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:35.901 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:09:24.210 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:08:36.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:08:36.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:06.769 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:06.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:19.090 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:10:07.306 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.101 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:10:07.317 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.141 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:10:07.450 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.152 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:10:07.462 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.155 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:10:07.465 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.159 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:10:07.375 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.165 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:10:07.474 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.254 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:10:07.563 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:19.277 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:10:07.586 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:09:36.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:09:36.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:07.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:07.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:37.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:10:37.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:07.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:07.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:37.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:11:37.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:07.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:07.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:37.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:37.540 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:12:45.610 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:13:33.826 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.611 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:13:33.828 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.713 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:13:33.930 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.716 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:13:34.026 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.719 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:13:34.029 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.719 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:13:34.029 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.722 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:13:34.032 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.834 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:13:34.144 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:12:45.848 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:13:34.158 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:13:07.640 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:07.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:37.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:13:37.716 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:07.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:07.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:37.964 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:14:37.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:08.029 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:08.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:38.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:15:38.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:08.229 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:08.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:13.185 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:01.401 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.186 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:01.403 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.277 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:01.494 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.288 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:01.599 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.291 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:01.601 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.299 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:01.610 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.302 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:01.612 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.410 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:01.721 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:13.443 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:01.754 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:38.368 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:38.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:16:56.145 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:44.362 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.165 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:44.381 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.196 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:17:44.413 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.262 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:44.572 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.269 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:44.580 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.271 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:44.582 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.281 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:44.592 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.314 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:17:44.624 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:16:56.314 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:17:44.625 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:17:08.481 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:08.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:38.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:17:38.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:08.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:08.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:38.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:18:38.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:08.842 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:08.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:38.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:19:38.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:08.960 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:08.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:39.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:20:39.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:09.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:09.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:39.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:21:39.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:09.414 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:09.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:39.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:22:39.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:06.801 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:23:55.018 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.809 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:23:55.026 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.834 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:23:55.145 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.839 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:23:55.150 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.844 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:23:55.156 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.912 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:23:55.223 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:06.967 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:23:55.183 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:07.090 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:23:55.401 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:07.222 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:23:55.533 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:09.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:09.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:39.679 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:39.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:23:57.511 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:24:45.727 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.518 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:24:45.735 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.555 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:24:45.772 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.665 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:24:45.976 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.675 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:24:45.986 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.679 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:24:45.991 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.682 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:24:45.994 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.727 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:24:46.039 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:23:57.781 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:24:46.093 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:24:09.834 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:09.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:39.898 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:24:39.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:10.028 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:10.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:17.799 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:26:06.016 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.802 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:26:06.019 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.841 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:26:06.058 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.933 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:26:06.244 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.936 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:26:06.247 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.955 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:26:06.266 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:17.959 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:26:06.270 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:18.009 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:26:06.321 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:18.042 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:26:06.353 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:25:40.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:25:40.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:10.206 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:10.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:33.378 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:27:21.595 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.384 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:27:21.601 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.405 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:27:21.716 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.414 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:27:21.725 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.423 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:27:21.734 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.433 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:27:21.744 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.438 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:27:21.655 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.520 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:27:21.832 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:33.548 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:27:21.859 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:26:40.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:26:40.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:10.439 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:10.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:40.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:27:40.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:10.865 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:10.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:40.939 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:28:40.944 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:11.001 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:11.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:41.283 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:29:41.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:00.827 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:30:49.043 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.830 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:30:49.047 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.863 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:30:49.174 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.876 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:30:49.187 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.881 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:30:49.192 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.890 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:30:49.202 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:00.926 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:30:49.143 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:01.045 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:30:49.356 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:01.120 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:30:49.431 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:30:11.346 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:11.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:41.492 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:30:41.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:11.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:11.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:37.054 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-01-17T23:31:38.660 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:31:38.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ make 2024-01-17T23:31:39.903 INFO:tasks.workunit.client.0.smithi067.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-01-17T23:31:41.144 INFO:tasks.workunit.client.0.smithi067.stderr:++ readlink -f fsstress 2024-01-17T23:31:41.145 INFO:tasks.workunit.client.0.smithi067.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-01-17T23:31:41.145 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2024-01-17T23:31:41.146 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:31:41.146 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2024-01-17T23:31:41.146 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp 2024-01-17T23:31:41.146 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -d -p . 2024-01-17T23:31:41.228 INFO:tasks.workunit.client.0.smithi067.stderr:+ T=./tmp.Xi9umTeGb6 2024-01-17T23:31:41.228 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Xi9umTeGb6 -l 1 -n 1000 -p 10 -v 2024-01-17T23:31:41.264 INFO:tasks.workunit.client.0.smithi067.stdout:seed = 1705797964 2024-01-17T23:31:41.517 INFO:tasks.workunit.client.0.smithi067.stdout:0/0: write - no filename 2024-01-17T23:31:41.624 INFO:tasks.workunit.client.0.smithi067.stdout:1/0: rename - no filename 2024-01-17T23:31:41.624 INFO:tasks.workunit.client.0.smithi067.stdout:0/1: mknod c0 0 2024-01-17T23:31:41.624 INFO:tasks.workunit.client.0.smithi067.stdout:1/1: read - no filename 2024-01-17T23:31:41.624 INFO:tasks.workunit.client.0.smithi067.stdout:1/2: getdents . 0 2024-01-17T23:31:41.624 INFO:tasks.workunit.client.0.smithi067.stdout:1/3: fdatasync - no filename 2024-01-17T23:31:41.710 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:41.713 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:31:41.803 INFO:tasks.workunit.client.0.smithi067.stdout:2/0: dread - no filename 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:2/1: chown . 6 1 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/2: symlink l1 0 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/3: dwrite - no filename 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/4: write - no filename 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/5: truncate - no filename 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/4: mkdir d0 0 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/5: write - no filename 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/6: getdents d0 0 2024-01-17T23:31:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/7: chown d0 1361031264 1 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/0: rename - no filename 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/1: unlink - no file 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/2: chown . 3650 1 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/3: dwrite - no filename 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/4: unlink - no file 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/5: rmdir - no directory 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/6: getdents . 0 2024-01-17T23:31:41.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/7: write - no filename 2024-01-17T23:31:41.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/8: chown . 381125 1 2024-01-17T23:31:41.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/9: getdents . 0 2024-01-17T23:31:41.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/10: chown . 29336 1 2024-01-17T23:31:41.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/11: dread - no filename 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:2/2: symlink l0 0 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:2/3: dwrite - no filename 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:2/4: chown l0 6638021 1 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/6: creat f2 x:0 0 0 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/7: write f2 [990834,98387] 0 2024-01-17T23:31:41.970 INFO:tasks.workunit.client.0.smithi067.stdout:1/8: creat d0/f1 x:0 0 0 2024-01-17T23:31:42.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/8: dwrite f2 [0,4194304] 0 2024-01-17T23:31:42.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/9: truncate f2 4538165 0 2024-01-17T23:31:42.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/10: fdatasync f2 0 2024-01-17T23:31:42.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/11: read f2 [3858091,44076] 0 2024-01-17T23:31:42.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/12: readlink l1 0 2024-01-17T23:31:42.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/0: chown . 867063 1 2024-01-17T23:31:42.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/1: write - no filename 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/2: readlink - no filename 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/12: mkdir d0 0 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/3: stat - no entries 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/13: dwrite - no filename 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/4: readlink - no filename 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/14: chown d0 65 1 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/15: dread - no filename 2024-01-17T23:31:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:3/16: rename d0 to d0/d1 22 2024-01-17T23:31:42.165 INFO:tasks.workunit.client.0.smithi067.stdout:2/5: rename l0 to l1 0 2024-01-17T23:31:42.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/9: unlink d0/f1 0 2024-01-17T23:31:42.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/10: creat d0/f2 x:0 0 0 2024-01-17T23:31:42.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/11: dread - d0/f2 zero size 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/0: write - no filename 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/5: creat f0 x:0 0 0 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/1: getdents . 0 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/6: truncate f0 812312 0 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:3/17: creat d0/f2 x:0 0 0 2024-01-17T23:31:42.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/7: write f0 [1671854,7435] 0 2024-01-17T23:31:42.480 INFO:tasks.workunit.client.0.smithi067.stdout:3/18: dwrite d0/f2 [0,4194304] 0 2024-01-17T23:31:42.480 INFO:tasks.workunit.client.0.smithi067.stdout:3/19: creat d0/f3 x:0 0 0 2024-01-17T23:31:42.480 INFO:tasks.workunit.client.0.smithi067.stdout:3/20: creat d0/f4 x:0 0 0 2024-01-17T23:31:42.480 INFO:tasks.workunit.client.0.smithi067.stdout:3/21: creat d0/f5 x:0 0 0 2024-01-17T23:31:42.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/6: creat f2 x:0 0 0 2024-01-17T23:31:42.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/7: readlink l1 0 2024-01-17T23:31:42.486 INFO:tasks.workunit.client.0.smithi067.stdout:4/8: dread f0 [0,4194304] 0 2024-01-17T23:31:42.486 INFO:tasks.workunit.client.0.smithi067.stdout:4/9: creat f1 x:0 0 0 2024-01-17T23:31:42.490 INFO:tasks.workunit.client.0.smithi067.stdout:4/10: read f0 [321370,86773] 0 2024-01-17T23:31:43.243 INFO:tasks.workunit.client.0.smithi067.stdout:0/13: getdents . 0 2024-01-17T23:31:44.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/22: mknod d0/c6 0 2024-01-17T23:31:44.894 INFO:tasks.workunit.client.0.smithi067.stdout:2/8: mknod c3 0 2024-01-17T23:31:44.894 INFO:tasks.workunit.client.0.smithi067.stdout:2/9: write f2 [349039,84553] 0 2024-01-17T23:31:44.904 INFO:tasks.workunit.client.0.smithi067.stdout:2/10: dread f2 [0,4194304] 0 2024-01-17T23:31:45.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/11: mkdir d2 0 2024-01-17T23:31:46.015 INFO:tasks.workunit.client.0.smithi067.stdout:2/11: fsync f2 0 2024-01-17T23:31:46.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/12: read f2 [256576,99531] 0 2024-01-17T23:31:46.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/12: fsync d0/f2 0 2024-01-17T23:31:46.191 INFO:tasks.workunit.client.0.smithi067.stdout:1/13: dwrite d0/f2 [0,4194304] 0 2024-01-17T23:31:46.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/14: write d0/f2 [205430,2610] 0 2024-01-17T23:32:11.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:11.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:19.004 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:33:07.221 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.006 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:33:07.222 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.073 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:33:07.290 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.126 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:33:07.437 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.127 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:33:07.439 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.131 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:33:07.443 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.135 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:33:07.446 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.262 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:33:07.574 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:19.263 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:33:07.575 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:32:27.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/14: mkdir d3 0 2024-01-17T23:32:27.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/0: symlink l0 0 2024-01-17T23:32:27.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/1: dwrite - no filename 2024-01-17T23:32:27.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/23: mkdir d0/d7 0 2024-01-17T23:32:27.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/24: rename d0 to d0/d8 22 2024-01-17T23:32:27.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/25: write d0/f4 [730999,46585] 0 2024-01-17T23:32:28.116 INFO:tasks.workunit.client.0.smithi067.stdout:4/12: rmdir d2 0 2024-01-17T23:32:28.492 INFO:tasks.workunit.client.0.smithi067.stdout:1/15: mknod d0/c3 0 2024-01-17T23:32:28.492 INFO:tasks.workunit.client.0.smithi067.stdout:1/16: fsync d0/f2 0 2024-01-17T23:32:28.536 INFO:tasks.workunit.client.0.smithi067.stdout:1/17: dwrite d0/f2 [0,4194304] 0 2024-01-17T23:32:28.559 INFO:tasks.workunit.client.0.smithi067.stdout:1/18: write d0/f2 [3658531,130161] 0 2024-01-17T23:32:28.559 INFO:tasks.workunit.client.0.smithi067.stdout:1/19: stat d0 0 2024-01-17T23:32:28.888 INFO:tasks.workunit.client.0.smithi067.stdout:0/15: creat d3/f4 x:0 0 0 2024-01-17T23:32:28.888 INFO:tasks.workunit.client.0.smithi067.stdout:0/16: readlink l1 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/2: creat f1 x:0 0 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/3: chown l0 23524079 1 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/4: stat l0 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/5: write f1 [126960,10393] 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/6: creat f2 x:0 0 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/7: dread - f2 zero size 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/8: creat f3 x:0 0 0 2024-01-17T23:32:28.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/9: chown f2 243 1 2024-01-17T23:32:28.948 INFO:tasks.workunit.client.0.smithi067.stdout:6/10: creat f4 x:0 0 0 2024-01-17T23:32:28.948 INFO:tasks.workunit.client.0.smithi067.stdout:6/11: fdatasync f3 0 2024-01-17T23:32:29.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/13: mkdir d3 0 2024-01-17T23:32:29.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/14: chown f1 109030 1 2024-01-17T23:32:29.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/13: getdents . 0 2024-01-17T23:32:29.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/14: rmdir - no directory 2024-01-17T23:32:29.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/15: write f2 [1202524,49689] 0 2024-01-17T23:32:29.396 INFO:tasks.workunit.client.0.smithi067.stdout:1/20: mknod d0/c4 0 2024-01-17T23:32:29.418 INFO:tasks.workunit.client.0.smithi067.stdout:1/21: dread d0/f2 [0,4194304] 0 2024-01-17T23:32:29.945 INFO:tasks.workunit.client.0.smithi067.stdout:0/17: mkdir d3/d5 0 2024-01-17T23:32:29.977 INFO:tasks.workunit.client.0.smithi067.stdout:4/15: creat d3/f4 x:0 0 0 2024-01-17T23:32:30.008 INFO:tasks.workunit.client.0.smithi067.stdout:2/16: rename f2 to f4 0 2024-01-17T23:32:30.019 INFO:tasks.workunit.client.0.smithi067.stdout:2/17: dread f4 [0,4194304] 0 2024-01-17T23:32:30.019 INFO:tasks.workunit.client.0.smithi067.stdout:2/18: truncate f4 1436275 0 2024-01-17T23:32:30.714 INFO:tasks.workunit.client.0.smithi067.stdout:1/22: unlink d0/f2 0 2024-01-17T23:32:30.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/18: mkdir d3/d6 0 2024-01-17T23:32:30.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/16: mkdir d3/d5 0 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/23: unlink d0/c3 0 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/24: truncate - no filename 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/25: dwrite - no filename 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/26: creat d0/f5 x:0 0 0 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/27: chown d0 11 1 2024-01-17T23:32:31.118 INFO:tasks.workunit.client.0.smithi067.stdout:1/28: chown d0 21160280 1 2024-01-17T23:32:31.258 INFO:tasks.workunit.client.0.smithi067.stdout:0/19: unlink f2 0 2024-01-17T23:32:31.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/20: rename d3 to d3/d6/d7 22 2024-01-17T23:32:31.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/21: creat d3/f8 x:0 0 0 2024-01-17T23:32:31.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/22: fdatasync d3/f8 0 2024-01-17T23:32:31.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/23: dread - d3/f8 zero size 2024-01-17T23:32:31.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/24: write d3/f8 [803623,126207] 0 2024-01-17T23:32:31.531 INFO:tasks.workunit.client.0.smithi067.stdout:2/19: mkdir d5 0 2024-01-17T23:32:31.733 INFO:tasks.workunit.client.0.smithi067.stdout:0/25: unlink l1 0 2024-01-17T23:32:31.810 INFO:tasks.workunit.client.0.smithi067.stdout:2/20: mkdir d5/d6 0 2024-01-17T23:32:32.040 INFO:tasks.workunit.client.0.smithi067.stdout:0/26: rename d3/f8 to d3/d5/f9 0 2024-01-17T23:32:32.040 INFO:tasks.workunit.client.0.smithi067.stdout:0/27: dread - d3/f4 zero size 2024-01-17T23:32:32.040 INFO:tasks.workunit.client.0.smithi067.stdout:0/28: write d3/f4 [278976,12655] 0 2024-01-17T23:32:32.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/21: unlink l1 0 2024-01-17T23:32:33.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/22: mkdir d5/d7 0 2024-01-17T23:32:33.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/23: dread f4 [0,4194304] 0 2024-01-17T23:32:34.150 INFO:tasks.workunit.client.0.smithi067.stdout:3/26: getdents d0 0 2024-01-17T23:32:34.151 INFO:tasks.workunit.client.0.smithi067.stdout:3/27: fsync d0/f4 0 2024-01-17T23:32:34.151 INFO:tasks.workunit.client.0.smithi067.stdout:5/2: sync 2024-01-17T23:32:34.152 INFO:tasks.workunit.client.0.smithi067.stdout:5/3: rename - no filename 2024-01-17T23:32:34.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/28: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:32:34.214 INFO:tasks.workunit.client.0.smithi067.stdout:3/29: dwrite d0/f2 [0,4194304] 0 2024-01-17T23:32:34.244 INFO:tasks.workunit.client.0.smithi067.stdout:3/30: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:32:34.684 INFO:tasks.workunit.client.0.smithi067.stdout:6/12: getdents . 0 2024-01-17T23:32:34.714 INFO:tasks.workunit.client.0.smithi067.stdout:0/29: truncate d3/d5/f9 716160 0 2024-01-17T23:32:35.074 INFO:tasks.workunit.client.0.smithi067.stdout:7/0: readlink - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/1: write - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/2: link - no file 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/3: write - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/4: dwrite - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/5: dread - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/6: write - no filename 2024-01-17T23:32:35.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/30: write d3/d5/f9 [811430,41369] 0 2024-01-17T23:32:35.085 INFO:tasks.workunit.client.0.smithi067.stdout:2/24: mkdir d5/d6/d8 0 2024-01-17T23:32:35.085 INFO:tasks.workunit.client.0.smithi067.stdout:5/4: creat f0 x:0 0 0 2024-01-17T23:32:35.086 INFO:tasks.workunit.client.0.smithi067.stdout:5/5: write f0 [330872,36690] 0 2024-01-17T23:32:35.086 INFO:tasks.workunit.client.0.smithi067.stdout:2/25: write f4 [1968236,84859] 0 2024-01-17T23:32:35.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/26: dwrite f4 [0,4194304] 0 2024-01-17T23:32:35.373 INFO:tasks.workunit.client.0.smithi067.stdout:3/31: creat d0/f9 x:0 0 0 2024-01-17T23:32:35.459 INFO:tasks.workunit.client.0.smithi067.stdout:6/13: unlink l0 0 2024-01-17T23:32:35.740 INFO:tasks.workunit.client.0.smithi067.stdout:7/7: creat f0 x:0 0 0 2024-01-17T23:32:35.740 INFO:tasks.workunit.client.0.smithi067.stdout:7/8: chown f0 36359 1 2024-01-17T23:32:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:7/9: dread - f0 zero size 2024-01-17T23:32:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:7/10: dread - f0 zero size 2024-01-17T23:32:35.768 INFO:tasks.workunit.client.0.smithi067.stdout:4/17: sync 2024-01-17T23:32:35.768 INFO:tasks.workunit.client.0.smithi067.stdout:1/29: sync 2024-01-17T23:32:35.768 INFO:tasks.workunit.client.0.smithi067.stdout:4/18: chown f1 0 1 2024-01-17T23:32:35.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/19: dwrite f1 [0,4194304] 0 2024-01-17T23:32:35.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/20: getdents d3/d5 0 2024-01-17T23:32:35.794 INFO:tasks.workunit.client.0.smithi067.stdout:4/21: chown d3/d5 20 1 2024-01-17T23:32:35.798 INFO:tasks.workunit.client.0.smithi067.stdout:4/22: dread f0 [0,4194304] 0 2024-01-17T23:32:35.799 INFO:tasks.workunit.client.0.smithi067.stdout:4/23: dread - d3/f4 zero size 2024-01-17T23:32:35.895 INFO:tasks.workunit.client.0.smithi067.stdout:0/31: creat d3/d5/fa x:0 0 0 2024-01-17T23:32:35.981 INFO:tasks.workunit.client.0.smithi067.stdout:5/6: rename f0 to f1 0 2024-01-17T23:32:36.182 INFO:tasks.workunit.client.0.smithi067.stdout:3/32: rmdir d0/d7 0 2024-01-17T23:32:36.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/33: dwrite d0/f9 [0,4194304] 0 2024-01-17T23:32:36.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/14: rename f4 to f5 0 2024-01-17T23:32:36.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/0: creat f0 x:0 0 0 2024-01-17T23:32:36.430 INFO:tasks.workunit.client.0.smithi067.stdout:1/30: symlink d0/l6 0 2024-01-17T23:32:36.430 INFO:tasks.workunit.client.0.smithi067.stdout:1/31: write d0/f5 [428638,77776] 0 2024-01-17T23:32:36.430 INFO:tasks.workunit.client.0.smithi067.stdout:1/32: write d0/f5 [1053226,65696] 0 2024-01-17T23:32:36.445 INFO:tasks.workunit.client.0.smithi067.stdout:1/33: dread d0/f5 [0,4194304] 0 2024-01-17T23:32:36.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/34: write d0/f5 [834540,31783] 0 2024-01-17T23:32:36.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/35: chown d0/l6 89309515 1 2024-01-17T23:32:36.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/24: mknod d3/d5/c6 0 2024-01-17T23:32:36.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/25: fsync d3/f4 0 2024-01-17T23:32:36.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/32: mknod d3/cb 0 2024-01-17T23:32:36.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/33: dwrite d3/f4 [0,4194304] 0 2024-01-17T23:32:36.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/34: stat d3/d5 0 2024-01-17T23:32:37.047 INFO:tasks.workunit.client.0.smithi067.stdout:7/11: fsync f0 0 2024-01-17T23:32:37.047 INFO:tasks.workunit.client.0.smithi067.stdout:7/12: dread - f0 zero size 2024-01-17T23:32:37.048 INFO:tasks.workunit.client.0.smithi067.stdout:7/13: dread - f0 zero size 2024-01-17T23:32:37.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/14: dwrite f0 [0,4194304] 0 2024-01-17T23:32:37.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/15: read f0 [1371077,40601] 0 2024-01-17T23:32:37.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/16: chown f0 648 1 2024-01-17T23:32:37.587 INFO:tasks.workunit.client.0.smithi067.stdout:2/27: unlink c3 0 2024-01-17T23:32:37.936 INFO:tasks.workunit.client.0.smithi067.stdout:3/34: rename d0/f4 to d0/fa 0 2024-01-17T23:32:38.013 INFO:tasks.workunit.client.0.smithi067.stdout:6/15: mkdir d6 0 2024-01-17T23:32:38.100 INFO:tasks.workunit.client.0.smithi067.stdout:9/0: creat f0 x:0 0 0 2024-01-17T23:32:38.348 INFO:tasks.workunit.client.0.smithi067.stdout:1/36: mkdir d0/d7 0 2024-01-17T23:32:38.777 INFO:tasks.workunit.client.0.smithi067.stdout:7/17: rename f0 to f1 0 2024-01-17T23:32:38.779 INFO:tasks.workunit.client.0.smithi067.stdout:5/7: sync 2024-01-17T23:32:38.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/8: dread f1 [0,4194304] 0 2024-01-17T23:32:38.786 INFO:tasks.workunit.client.0.smithi067.stdout:5/9: read f1 [50639,18910] 0 2024-01-17T23:32:39.287 INFO:tasks.workunit.client.0.smithi067.stdout:2/28: creat d5/d6/d8/f9 x:0 0 0 2024-01-17T23:32:39.287 INFO:tasks.workunit.client.0.smithi067.stdout:2/29: write d5/d6/d8/f9 [681559,113073] 0 2024-01-17T23:32:39.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/30: dwrite d5/d6/d8/f9 [0,4194304] 0 2024-01-17T23:32:39.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/35: truncate d0/fa 91829 0 2024-01-17T23:32:39.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/36: chown d0/f2 520313 1 2024-01-17T23:32:39.423 INFO:tasks.workunit.client.0.smithi067.stdout:3/37: write d0/f3 [496448,12922] 0 2024-01-17T23:32:39.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/16: symlink d6/l7 0 2024-01-17T23:32:39.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/17: stat f5 0 2024-01-17T23:32:39.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/18: write f5 [98935,111001] 0 2024-01-17T23:32:39.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/19: chown f5 320 1 2024-01-17T23:32:39.561 INFO:tasks.workunit.client.0.smithi067.stdout:6/20: dwrite f2 [0,4194304] 0 2024-01-17T23:32:39.589 INFO:tasks.workunit.client.0.smithi067.stdout:6/21: dwrite f2 [0,4194304] 0 2024-01-17T23:32:39.763 INFO:tasks.workunit.client.0.smithi067.stdout:8/1: rename f0 to f1 0 2024-01-17T23:32:39.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/2: creat f2 x:0 0 0 2024-01-17T23:32:39.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/26: truncate f1 4172830 0 2024-01-17T23:32:40.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/18: fsync f1 0 2024-01-17T23:32:40.155 INFO:tasks.workunit.client.0.smithi067.stdout:5/10: rename f1 to f2 0 2024-01-17T23:32:40.406 INFO:tasks.workunit.client.0.smithi067.stdout:2/31: creat d5/fa x:0 0 0 2024-01-17T23:32:40.427 INFO:tasks.workunit.client.0.smithi067.stdout:2/32: read d5/d6/d8/f9 [1268230,44839] 0 2024-01-17T23:32:40.660 INFO:tasks.workunit.client.0.smithi067.stdout:3/38: mknod d0/cb 0 2024-01-17T23:32:40.660 INFO:tasks.workunit.client.0.smithi067.stdout:3/39: chown d0 107768740 1 2024-01-17T23:32:40.685 INFO:tasks.workunit.client.0.smithi067.stdout:3/40: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:40.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/41: chown d0/fa 55251 1 2024-01-17T23:32:40.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/42: creat d0/fc x:0 0 0 2024-01-17T23:32:40.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/35: mknod d3/cc 0 2024-01-17T23:32:40.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/22: unlink f1 0 2024-01-17T23:32:41.027 INFO:tasks.workunit.client.0.smithi067.stdout:9/1: getdents . 0 2024-01-17T23:32:41.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/37: getdents d0 0 2024-01-17T23:32:41.402 INFO:tasks.workunit.client.0.smithi067.stdout:4/27: unlink d3/f4 0 2024-01-17T23:32:41.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:41.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:32:41.911 INFO:tasks.workunit.client.0.smithi067.stdout:0/36: mkdir d3/d6/dd 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:6/23: unlink f3 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:9/2: mknod c1 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:1/38: mknod d0/c8 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:1/39: readlink d0/l6 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:1/40: stat d0/c4 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/3: unlink f2 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/4: read - f1 zero size 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/5: fdatasync f1 0 2024-01-17T23:32:41.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/6: write f1 [727407,19861] 0 2024-01-17T23:32:41.930 INFO:tasks.workunit.client.0.smithi067.stdout:8/7: chown f1 10 1 2024-01-17T23:32:41.930 INFO:tasks.workunit.client.0.smithi067.stdout:9/3: write f0 [410414,96307] 0 2024-01-17T23:32:41.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/41: dread d0/f5 [0,4194304] 0 2024-01-17T23:32:41.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/42: fdatasync d0/f5 0 2024-01-17T23:32:41.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/43: readlink d0/l6 0 2024-01-17T23:32:41.939 INFO:tasks.workunit.client.0.smithi067.stdout:0/37: dwrite d3/d5/fa [0,4194304] 0 2024-01-17T23:32:41.945 INFO:tasks.workunit.client.0.smithi067.stdout:9/4: dread f0 [0,4194304] 0 2024-01-17T23:32:41.945 INFO:tasks.workunit.client.0.smithi067.stdout:9/5: readlink - no filename 2024-01-17T23:32:41.945 INFO:tasks.workunit.client.0.smithi067.stdout:9/6: fsync f0 0 2024-01-17T23:32:41.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/7: dwrite f0 [0,4194304] 0 2024-01-17T23:32:41.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/8: fdatasync f0 0 2024-01-17T23:32:41.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/9: fsync f0 0 2024-01-17T23:32:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:7/19: getdents . 0 2024-01-17T23:32:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:8/8: mknod c3 0 2024-01-17T23:32:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:8/9: rmdir - no directory 2024-01-17T23:32:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:0/38: symlink d3/d6/le 0 2024-01-17T23:32:42.141 INFO:tasks.workunit.client.0.smithi067.stdout:0/39: write d3/d5/f9 [200182,49229] 0 2024-01-17T23:32:42.142 INFO:tasks.workunit.client.0.smithi067.stdout:8/10: fdatasync f1 0 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/11: write f1 [175193,115133] 0 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/12: write f1 [1375738,80896] 0 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/13: rmdir - no directory 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/14: readlink - no filename 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/15: write f1 [425451,689] 0 2024-01-17T23:32:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/16: chown f1 2 1 2024-01-17T23:32:42.158 INFO:tasks.workunit.client.0.smithi067.stdout:8/17: dread f1 [0,4194304] 0 2024-01-17T23:32:42.284 INFO:tasks.workunit.client.0.smithi067.stdout:9/10: link f0 f2 0 2024-01-17T23:32:42.302 INFO:tasks.workunit.client.0.smithi067.stdout:9/11: write f0 [3369441,109046] 0 2024-01-17T23:32:42.302 INFO:tasks.workunit.client.0.smithi067.stdout:9/12: write f2 [3967473,62175] 0 2024-01-17T23:32:42.302 INFO:tasks.workunit.client.0.smithi067.stdout:9/13: write f0 [3084347,93354] 0 2024-01-17T23:32:42.409 INFO:tasks.workunit.client.0.smithi067.stdout:7/20: creat f2 x:0 0 0 2024-01-17T23:32:42.689 INFO:tasks.workunit.client.0.smithi067.stdout:0/40: creat d3/d6/ff x:0 0 0 2024-01-17T23:32:42.704 INFO:tasks.workunit.client.0.smithi067.stdout:0/41: dread d3/f4 [0,4194304] 0 2024-01-17T23:32:42.741 INFO:tasks.workunit.client.0.smithi067.stdout:0/42: dwrite d3/f4 [0,4194304] 0 2024-01-17T23:32:42.750 INFO:tasks.workunit.client.0.smithi067.stdout:0/43: dread d3/d5/f9 [0,4194304] 0 2024-01-17T23:32:43.013 INFO:tasks.workunit.client.0.smithi067.stdout:2/33: write d5/d6/d8/f9 [5114167,113772] 0 2024-01-17T23:32:43.013 INFO:tasks.workunit.client.0.smithi067.stdout:7/21: truncate f1 1356447 0 2024-01-17T23:32:43.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/22: creat f3 x:0 0 0 2024-01-17T23:32:43.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/23: fdatasync f2 0 2024-01-17T23:32:43.014 INFO:tasks.workunit.client.0.smithi067.stdout:2/34: write d5/d6/d8/f9 [4705930,36327] 0 2024-01-17T23:32:43.046 INFO:tasks.workunit.client.0.smithi067.stdout:2/35: dwrite d5/d6/d8/f9 [4194304,4194304] 0 2024-01-17T23:32:43.047 INFO:tasks.workunit.client.0.smithi067.stdout:2/36: chown f4 2 1 2024-01-17T23:32:43.086 INFO:tasks.workunit.client.0.smithi067.stdout:0/44: symlink d3/d6/l10 0 2024-01-17T23:32:43.087 INFO:tasks.workunit.client.0.smithi067.stdout:0/45: truncate d3/d5/fa 4512616 0 2024-01-17T23:32:43.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/28: rename f0 to d3/f7 0 2024-01-17T23:32:43.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/29: stat f1 0 2024-01-17T23:32:43.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/37: mknod d5/cb 0 2024-01-17T23:32:43.520 INFO:tasks.workunit.client.0.smithi067.stdout:0/46: creat d3/f11 x:0 0 0 2024-01-17T23:32:43.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/47: dread d3/d5/f9 [0,4194304] 0 2024-01-17T23:32:43.652 INFO:tasks.workunit.client.0.smithi067.stdout:6/24: rename f5 to d6/f8 0 2024-01-17T23:32:43.652 INFO:tasks.workunit.client.0.smithi067.stdout:1/44: rename d0 to d0/d7/d9 22 2024-01-17T23:32:43.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/45: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:43.713 INFO:tasks.workunit.client.0.smithi067.stdout:1/46: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:43.770 INFO:tasks.workunit.client.0.smithi067.stdout:4/30: unlink d3/d5/c6 0 2024-01-17T23:32:43.789 INFO:tasks.workunit.client.0.smithi067.stdout:4/31: dread f1 [0,4194304] 0 2024-01-17T23:32:43.793 INFO:tasks.workunit.client.0.smithi067.stdout:4/32: dread d3/f7 [0,4194304] 0 2024-01-17T23:32:43.793 INFO:tasks.workunit.client.0.smithi067.stdout:4/33: chown d3/f7 9737855 1 2024-01-17T23:32:44.044 INFO:tasks.workunit.client.0.smithi067.stdout:2/38: unlink d5/cb 0 2024-01-17T23:32:44.044 INFO:tasks.workunit.client.0.smithi067.stdout:2/39: write d5/fa [690581,90449] 0 2024-01-17T23:32:44.044 INFO:tasks.workunit.client.0.smithi067.stdout:0/48: mknod d3/c12 0 2024-01-17T23:32:44.055 INFO:tasks.workunit.client.0.smithi067.stdout:2/40: dread d5/d6/d8/f9 [4194304,4194304] 0 2024-01-17T23:32:44.184 INFO:tasks.workunit.client.0.smithi067.stdout:1/47: mknod d0/d7/ca 0 2024-01-17T23:32:44.197 INFO:tasks.workunit.client.0.smithi067.stdout:1/48: write d0/f5 [1789762,27060] 0 2024-01-17T23:32:44.336 INFO:tasks.workunit.client.0.smithi067.stdout:4/34: mkdir d3/d8 0 2024-01-17T23:32:44.337 INFO:tasks.workunit.client.0.smithi067.stdout:4/35: rename d3 to d3/d9 22 2024-01-17T23:32:44.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/41: symlink d5/d6/lc 0 2024-01-17T23:32:44.462 INFO:tasks.workunit.client.0.smithi067.stdout:0/49: unlink d3/d6/le 0 2024-01-17T23:32:44.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/42: dwrite d5/d6/d8/f9 [0,4194304] 0 2024-01-17T23:32:44.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/43: rename d5/d6 to d5/d6/dd 22 2024-01-17T23:32:44.509 INFO:tasks.workunit.client.0.smithi067.stdout:2/44: dread d5/d6/d8/f9 [0,4194304] 0 2024-01-17T23:32:44.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/45: dread d5/d6/d8/f9 [0,4194304] 0 2024-01-17T23:32:44.551 INFO:tasks.workunit.client.0.smithi067.stdout:1/49: mknod d0/d7/cb 0 2024-01-17T23:32:44.581 INFO:tasks.workunit.client.0.smithi067.stdout:1/50: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:44.616 INFO:tasks.workunit.client.0.smithi067.stdout:1/51: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:44.622 INFO:tasks.workunit.client.0.smithi067.stdout:4/36: dwrite d3/f7 [0,4194304] 0 2024-01-17T23:32:44.622 INFO:tasks.workunit.client.0.smithi067.stdout:4/37: fdatasync f1 0 2024-01-17T23:32:44.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/38: dread f1 [0,4194304] 0 2024-01-17T23:32:44.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/39: chown d3/d5 85272 1 2024-01-17T23:32:44.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/50: link d3/c12 d3/d6/dd/c13 0 2024-01-17T23:32:44.900 INFO:tasks.workunit.client.0.smithi067.stdout:2/46: rename d5/d7 to d5/d6/d8/de 0 2024-01-17T23:32:44.914 INFO:tasks.workunit.client.0.smithi067.stdout:2/47: write f4 [3788169,38353] 0 2024-01-17T23:32:45.294 INFO:tasks.workunit.client.0.smithi067.stdout:4/40: mknod d3/ca 0 2024-01-17T23:32:45.483 INFO:tasks.workunit.client.0.smithi067.stdout:0/51: mknod d3/d6/dd/c14 0 2024-01-17T23:32:45.485 INFO:tasks.workunit.client.0.smithi067.stdout:5/11: sync 2024-01-17T23:32:45.485 INFO:tasks.workunit.client.0.smithi067.stdout:3/43: sync 2024-01-17T23:32:45.497 INFO:tasks.workunit.client.0.smithi067.stdout:0/52: write d3/d5/fa [2797686,126675] 0 2024-01-17T23:32:45.662 INFO:tasks.workunit.client.0.smithi067.stdout:2/48: rename d5/d6/d8/f9 to d5/d6/d8/ff 0 2024-01-17T23:32:45.662 INFO:tasks.workunit.client.0.smithi067.stdout:2/49: chown d5/fa 6377 1 2024-01-17T23:32:45.719 INFO:tasks.workunit.client.0.smithi067.stdout:8/18: getdents . 0 2024-01-17T23:32:45.719 INFO:tasks.workunit.client.0.smithi067.stdout:8/19: chown c3 35 1 2024-01-17T23:32:45.719 INFO:tasks.workunit.client.0.smithi067.stdout:8/20: chown c3 1822748 1 2024-01-17T23:32:45.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/12: mknod c3 0 2024-01-17T23:32:45.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/13: chown f2 1923 1 2024-01-17T23:32:45.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/14: write f2 [958272,48823] 0 2024-01-17T23:32:45.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/15: chown c3 24782328 1 2024-01-17T23:32:45.898 INFO:tasks.workunit.client.0.smithi067.stdout:5/16: dread f2 [0,4194304] 0 2024-01-17T23:32:46.194 INFO:tasks.workunit.client.0.smithi067.stdout:0/53: symlink d3/d6/l15 0 2024-01-17T23:32:46.222 INFO:tasks.workunit.client.0.smithi067.stdout:9/14: dwrite f0 [4194304,4194304] 0 2024-01-17T23:32:46.861 INFO:tasks.workunit.client.0.smithi067.stdout:5/17: unlink c3 0 2024-01-17T23:32:47.095 INFO:tasks.workunit.client.0.smithi067.stdout:0/54: mknod d3/c16 0 2024-01-17T23:32:47.131 INFO:tasks.workunit.client.0.smithi067.stdout:0/55: dwrite d3/d5/fa [0,4194304] 0 2024-01-17T23:32:47.131 INFO:tasks.workunit.client.0.smithi067.stdout:0/56: dread - d3/d6/ff zero size 2024-01-17T23:32:47.159 INFO:tasks.workunit.client.0.smithi067.stdout:0/57: dwrite d3/d5/f9 [0,4194304] 0 2024-01-17T23:32:47.159 INFO:tasks.workunit.client.0.smithi067.stdout:0/58: creat d3/d6/f17 x:0 0 0 2024-01-17T23:32:47.159 INFO:tasks.workunit.client.0.smithi067.stdout:0/59: chown d3/d5/f9 1160 1 2024-01-17T23:32:47.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/24: fsync f1 0 2024-01-17T23:32:47.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/25: readlink - no filename 2024-01-17T23:32:47.343 INFO:tasks.workunit.client.0.smithi067.stdout:9/15: mkdir d3 0 2024-01-17T23:32:47.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/16: write f0 [5574432,7419] 0 2024-01-17T23:32:47.708 INFO:tasks.workunit.client.0.smithi067.stdout:0/60: symlink d3/d5/l18 0 2024-01-17T23:32:47.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/25: getdents d6 0 2024-01-17T23:32:47.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/26: chown f2 403335 1 2024-01-17T23:32:47.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/27: chown d6/f8 11644970 1 2024-01-17T23:32:47.778 INFO:tasks.workunit.client.0.smithi067.stdout:6/28: write f2 [4281070,2041] 0 2024-01-17T23:32:47.790 INFO:tasks.workunit.client.0.smithi067.stdout:6/29: read f2 [3303995,31984] 0 2024-01-17T23:32:47.912 INFO:tasks.workunit.client.0.smithi067.stdout:7/26: mkdir d4 0 2024-01-17T23:32:48.113 INFO:tasks.workunit.client.0.smithi067.stdout:9/17: symlink d3/l4 0 2024-01-17T23:32:48.113 INFO:tasks.workunit.client.0.smithi067.stdout:9/18: write f2 [3994091,127687] 0 2024-01-17T23:32:48.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/19: stat d3 0 2024-01-17T23:32:48.274 INFO:tasks.workunit.client.0.smithi067.stdout:0/61: symlink d3/d6/l19 0 2024-01-17T23:32:48.274 INFO:tasks.workunit.client.0.smithi067.stdout:0/62: write d3/f4 [4817595,70445] 0 2024-01-17T23:32:48.274 INFO:tasks.workunit.client.0.smithi067.stdout:0/63: chown d3/d6 2 1 2024-01-17T23:32:48.274 INFO:tasks.workunit.client.0.smithi067.stdout:0/64: dread - d3/d6/f17 zero size 2024-01-17T23:32:48.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/65: dread d3/d5/f9 [0,4194304] 0 2024-01-17T23:32:48.387 INFO:tasks.workunit.client.0.smithi067.stdout:6/30: rmdir d6 39 2024-01-17T23:32:48.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/27: link f1 d4/f5 0 2024-01-17T23:32:48.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/28: truncate f3 570886 0 2024-01-17T23:32:48.603 INFO:tasks.workunit.client.0.smithi067.stdout:9/20: creat d3/f5 x:0 0 0 2024-01-17T23:32:48.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/66: mkdir d3/d5/d1a 0 2024-01-17T23:32:48.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/67: fsync d3/d5/fa 0 2024-01-17T23:32:49.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/29: link d4/f5 d4/f6 0 2024-01-17T23:32:49.269 INFO:tasks.workunit.client.0.smithi067.stdout:9/21: mkdir d3/d6 0 2024-01-17T23:32:49.303 INFO:tasks.workunit.client.0.smithi067.stdout:4/41: dwrite d3/f7 [4194304,4194304] 0 2024-01-17T23:32:49.565 INFO:tasks.workunit.client.0.smithi067.stdout:7/30: unlink f2 0 2024-01-17T23:32:49.566 INFO:tasks.workunit.client.0.smithi067.stdout:7/31: dread f3 [0,4194304] 0 2024-01-17T23:32:49.593 INFO:tasks.workunit.client.0.smithi067.stdout:7/32: dwrite d4/f5 [0,4194304] 0 2024-01-17T23:32:49.707 INFO:tasks.workunit.client.0.smithi067.stdout:9/22: rename c1 to d3/d6/c7 0 2024-01-17T23:32:49.707 INFO:tasks.workunit.client.0.smithi067.stdout:9/23: write f0 [8228805,129295] 0 2024-01-17T23:32:49.827 INFO:tasks.workunit.client.0.smithi067.stdout:4/42: mknod d3/d8/cb 0 2024-01-17T23:32:49.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/43: write d3/f7 [4848591,107917] 0 2024-01-17T23:32:49.989 INFO:tasks.workunit.client.0.smithi067.stdout:1/52: truncate d0/f5 2861322 0 2024-01-17T23:32:50.055 INFO:tasks.workunit.client.0.smithi067.stdout:7/33: creat d4/f7 x:0 0 0 2024-01-17T23:32:50.087 INFO:tasks.workunit.client.0.smithi067.stdout:7/34: dwrite d4/f5 [0,4194304] 0 2024-01-17T23:32:50.088 INFO:tasks.workunit.client.0.smithi067.stdout:7/35: dread f3 [0,4194304] 0 2024-01-17T23:32:50.205 INFO:tasks.workunit.client.0.smithi067.stdout:9/24: symlink d3/d6/l8 0 2024-01-17T23:32:50.205 INFO:tasks.workunit.client.0.smithi067.stdout:3/44: write d0/fa [180456,18989] 0 2024-01-17T23:32:50.205 INFO:tasks.workunit.client.0.smithi067.stdout:3/45: creat d0/fd x:0 0 0 2024-01-17T23:32:50.349 INFO:tasks.workunit.client.0.smithi067.stdout:4/44: creat d3/d5/fc x:0 0 0 2024-01-17T23:32:50.371 INFO:tasks.workunit.client.0.smithi067.stdout:4/45: dread d3/f7 [0,4194304] 0 2024-01-17T23:32:50.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/53: link d0/c8 d0/cc 0 2024-01-17T23:32:50.596 INFO:tasks.workunit.client.0.smithi067.stdout:7/36: link d4/f5 d4/f8 0 2024-01-17T23:32:50.596 INFO:tasks.workunit.client.0.smithi067.stdout:7/37: write f3 [900600,116561] 0 2024-01-17T23:32:50.702 INFO:tasks.workunit.client.0.smithi067.stdout:9/25: creat d3/d6/f9 x:0 0 0 2024-01-17T23:32:51.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/54: symlink d0/ld 0 2024-01-17T23:32:51.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/38: mknod d4/c9 0 2024-01-17T23:32:51.099 INFO:tasks.workunit.client.0.smithi067.stdout:7/39: creat d4/fa x:0 0 0 2024-01-17T23:32:51.182 INFO:tasks.workunit.client.0.smithi067.stdout:8/21: truncate f1 98347 0 2024-01-17T23:32:51.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/26: mkdir d3/da 0 2024-01-17T23:32:51.511 INFO:tasks.workunit.client.0.smithi067.stdout:1/55: rename d0/d7/ca to d0/ce 0 2024-01-17T23:32:51.511 INFO:tasks.workunit.client.0.smithi067.stdout:1/56: stat d0/c4 0 2024-01-17T23:32:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:9/27: symlink d3/da/lb 0 2024-01-17T23:32:51.941 INFO:tasks.workunit.client.0.smithi067.stdout:9/28: stat d3/f5 0 2024-01-17T23:32:51.941 INFO:tasks.workunit.client.0.smithi067.stdout:9/29: creat d3/fc x:0 0 0 2024-01-17T23:32:52.466 INFO:tasks.workunit.client.0.smithi067.stdout:6/31: truncate f2 3590248 0 2024-01-17T23:32:52.813 INFO:tasks.workunit.client.0.smithi067.stdout:7/40: fsync d4/f6 0 2024-01-17T23:32:52.813 INFO:tasks.workunit.client.0.smithi067.stdout:7/41: creat d4/fb x:0 0 0 2024-01-17T23:32:52.813 INFO:tasks.workunit.client.0.smithi067.stdout:7/42: stat d4/f6 0 2024-01-17T23:32:52.813 INFO:tasks.workunit.client.0.smithi067.stdout:7/43: creat d4/fc x:0 0 0 2024-01-17T23:32:52.843 INFO:tasks.workunit.client.0.smithi067.stdout:7/44: dwrite d4/f7 [0,4194304] 0 2024-01-17T23:32:52.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/45: dwrite d4/fb [0,4194304] 0 2024-01-17T23:32:53.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/46: getdents d3/d5 0 2024-01-17T23:32:53.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/47: dwrite f1 [0,4194304] 0 2024-01-17T23:32:53.294 INFO:tasks.workunit.client.0.smithi067.stdout:3/46: getdents d0 0 2024-01-17T23:32:53.294 INFO:tasks.workunit.client.0.smithi067.stdout:3/47: read - d0/fc zero size 2024-01-17T23:32:53.323 INFO:tasks.workunit.client.0.smithi067.stdout:3/48: dwrite d0/fa [0,4194304] 0 2024-01-17T23:32:53.434 INFO:tasks.workunit.client.0.smithi067.stdout:9/30: unlink d3/fc 0 2024-01-17T23:32:53.434 INFO:tasks.workunit.client.0.smithi067.stdout:9/31: creat d3/fd x:0 0 0 2024-01-17T23:32:53.500 INFO:tasks.workunit.client.0.smithi067.stdout:8/22: read f1 [29802,41717] 0 2024-01-17T23:32:53.501 INFO:tasks.workunit.client.0.smithi067.stdout:5/18: sync 2024-01-17T23:32:53.501 INFO:tasks.workunit.client.0.smithi067.stdout:2/50: sync 2024-01-17T23:32:53.502 INFO:tasks.workunit.client.0.smithi067.stdout:8/23: dread f1 [0,4194304] 0 2024-01-17T23:32:54.676 INFO:tasks.workunit.client.0.smithi067.stdout:7/46: unlink d4/f5 0 2024-01-17T23:32:55.041 INFO:tasks.workunit.client.0.smithi067.stdout:3/49: unlink d0/cb 0 2024-01-17T23:32:55.041 INFO:tasks.workunit.client.0.smithi067.stdout:3/50: readlink - no filename 2024-01-17T23:32:55.043 INFO:tasks.workunit.client.0.smithi067.stdout:1/57: truncate d0/f5 1948830 0 2024-01-17T23:32:55.165 INFO:tasks.workunit.client.0.smithi067.stdout:5/19: dread f2 [0,4194304] 0 2024-01-17T23:32:55.320 INFO:tasks.workunit.client.0.smithi067.stdout:2/51: mknod d5/d6/d8/de/c10 0 2024-01-17T23:32:55.320 INFO:tasks.workunit.client.0.smithi067.stdout:2/52: fsync d5/fa 0 2024-01-17T23:32:55.320 INFO:tasks.workunit.client.0.smithi067.stdout:2/53: fdatasync f4 0 2024-01-17T23:32:55.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/54: dread d5/fa [0,4194304] 0 2024-01-17T23:32:55.356 INFO:tasks.workunit.client.0.smithi067.stdout:2/55: dwrite d5/d6/d8/ff [0,4194304] 0 2024-01-17T23:32:55.356 INFO:tasks.workunit.client.0.smithi067.stdout:2/56: chown d5/d6 1471 1 2024-01-17T23:32:55.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/57: dread d5/d6/d8/ff [0,4194304] 0 2024-01-17T23:32:55.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/58: chown f4 3 1 2024-01-17T23:32:55.419 INFO:tasks.workunit.client.0.smithi067.stdout:8/24: dwrite f1 [0,4194304] 0 2024-01-17T23:32:55.419 INFO:tasks.workunit.client.0.smithi067.stdout:8/25: rmdir - no directory 2024-01-17T23:32:55.433 INFO:tasks.workunit.client.0.smithi067.stdout:8/26: write f1 [3919492,16398] 0 2024-01-17T23:32:55.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/68: creat d3/f1b x:0 0 0 2024-01-17T23:32:55.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/69: write d3/d5/f9 [5076318,111918] 0 2024-01-17T23:32:55.690 INFO:tasks.workunit.client.0.smithi067.stdout:0/70: dwrite d3/f1b [0,4194304] 0 2024-01-17T23:32:55.703 INFO:tasks.workunit.client.0.smithi067.stdout:0/71: write d3/f4 [143807,97328] 0 2024-01-17T23:32:55.801 INFO:tasks.workunit.client.0.smithi067.stdout:7/47: dwrite d4/f6 [0,4194304] 0 2024-01-17T23:32:55.814 INFO:tasks.workunit.client.0.smithi067.stdout:7/48: write d4/f7 [3128140,96643] 0 2024-01-17T23:32:56.273 INFO:tasks.workunit.client.0.smithi067.stdout:9/32: getdents d3/d6 0 2024-01-17T23:32:56.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/59: creat d5/d6/f11 x:0 0 0 2024-01-17T23:32:56.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/60: write d5/fa [1269870,9704] 0 2024-01-17T23:32:56.494 INFO:tasks.workunit.client.0.smithi067.stdout:2/61: chown d5 1671 1 2024-01-17T23:32:56.647 INFO:tasks.workunit.client.0.smithi067.stdout:6/32: sync 2024-01-17T23:32:56.647 INFO:tasks.workunit.client.0.smithi067.stdout:6/33: read d6/f8 [199351,111885] 0 2024-01-17T23:32:56.823 INFO:tasks.workunit.client.0.smithi067.stdout:4/48: mknod d3/cd 0 2024-01-17T23:32:56.823 INFO:tasks.workunit.client.0.smithi067.stdout:8/27: creat f4 x:0 0 0 2024-01-17T23:32:57.153 INFO:tasks.workunit.client.0.smithi067.stdout:0/72: mkdir d3/d5/d1a/d1c 0 2024-01-17T23:32:57.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/58: unlink d0/c4 0 2024-01-17T23:32:57.546 INFO:tasks.workunit.client.0.smithi067.stdout:7/49: rename f3 to d4/fd 0 2024-01-17T23:32:57.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/33: creat d3/d6/fe x:0 0 0 2024-01-17T23:32:57.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/34: readlink d3/l4 0 2024-01-17T23:32:57.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/35: creat d3/d6/ff x:0 0 0 2024-01-17T23:32:57.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/36: fdatasync f2 0 2024-01-17T23:32:57.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/37: dread f0 [4194304,4194304] 0 2024-01-17T23:32:57.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/38: readlink d3/da/lb 0 2024-01-17T23:32:57.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/39: write d3/d6/f9 [500994,113896] 0 2024-01-17T23:32:57.606 INFO:tasks.workunit.client.0.smithi067.stdout:5/20: dwrite f2 [0,4194304] 0 2024-01-17T23:32:57.810 INFO:tasks.workunit.client.0.smithi067.stdout:2/62: symlink d5/d6/d8/de/l12 0 2024-01-17T23:32:57.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/34: mkdir d6/d9 0 2024-01-17T23:32:57.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/35: getdents d6/d9 0 2024-01-17T23:32:58.048 INFO:tasks.workunit.client.0.smithi067.stdout:4/49: mkdir d3/d8/de 0 2024-01-17T23:32:58.068 INFO:tasks.workunit.client.0.smithi067.stdout:4/50: dread f1 [0,4194304] 0 2024-01-17T23:32:58.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/73: mkdir d3/d5/d1a/d1c/d1d 0 2024-01-17T23:32:58.532 INFO:tasks.workunit.client.0.smithi067.stdout:7/50: mkdir d4/de 0 2024-01-17T23:32:58.567 INFO:tasks.workunit.client.0.smithi067.stdout:7/51: dwrite d4/f7 [0,4194304] 0 2024-01-17T23:32:58.567 INFO:tasks.workunit.client.0.smithi067.stdout:7/52: dread - d4/fa zero size 2024-01-17T23:32:58.567 INFO:tasks.workunit.client.0.smithi067.stdout:7/53: chown d4/f7 6 1 2024-01-17T23:32:58.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/51: sync 2024-01-17T23:32:58.715 INFO:tasks.workunit.client.0.smithi067.stdout:1/59: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:32:59.664 INFO:tasks.workunit.client.0.smithi067.stdout:5/21: mknod c4 0 2024-01-17T23:32:59.683 INFO:tasks.workunit.client.0.smithi067.stdout:5/22: write f2 [1827536,89618] 0 2024-01-17T23:32:59.700 INFO:tasks.workunit.client.0.smithi067.stdout:5/23: dread f2 [0,4194304] 0 2024-01-17T23:32:59.700 INFO:tasks.workunit.client.0.smithi067.stdout:5/24: rmdir - no directory 2024-01-17T23:33:00.138 INFO:tasks.workunit.client.0.smithi067.stdout:2/63: getdents d5 0 2024-01-17T23:33:00.196 INFO:tasks.workunit.client.0.smithi067.stdout:6/36: creat d6/fa x:0 0 0 2024-01-17T23:33:00.199 INFO:tasks.workunit.client.0.smithi067.stdout:6/37: dread d6/f8 [0,4194304] 0 2024-01-17T23:33:00.278 INFO:tasks.workunit.client.0.smithi067.stdout:8/28: link f1 f5 0 2024-01-17T23:33:00.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/29: dwrite f4 [0,4194304] 0 2024-01-17T23:33:00.425 INFO:tasks.workunit.client.0.smithi067.stdout:0/74: creat d3/d6/f1e x:0 0 0 2024-01-17T23:33:00.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/54: rename d4/fc to d4/ff 0 2024-01-17T23:33:00.592 INFO:tasks.workunit.client.0.smithi067.stdout:7/55: dread d4/f6 [0,4194304] 0 2024-01-17T23:33:00.741 INFO:tasks.workunit.client.0.smithi067.stdout:3/52: symlink d0/le 0 2024-01-17T23:33:00.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/60: getdents d0/d7 0 2024-01-17T23:33:00.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/61: fdatasync d0/f5 0 2024-01-17T23:33:00.784 INFO:tasks.workunit.client.0.smithi067.stdout:2/64: symlink d5/d6/d8/de/l13 0 2024-01-17T23:33:00.796 INFO:tasks.workunit.client.0.smithi067.stdout:2/65: dread d5/d6/d8/ff [0,4194304] 0 2024-01-17T23:33:00.796 INFO:tasks.workunit.client.0.smithi067.stdout:2/66: truncate d5/fa 1877241 0 2024-01-17T23:33:00.815 INFO:tasks.workunit.client.0.smithi067.stdout:6/38: link f2 d6/fb 0 2024-01-17T23:33:00.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/30: mkdir d6 0 2024-01-17T23:33:00.952 INFO:tasks.workunit.client.0.smithi067.stdout:8/31: stat c3 0 2024-01-17T23:33:01.139 INFO:tasks.workunit.client.0.smithi067.stdout:0/75: symlink d3/d5/l1f 0 2024-01-17T23:33:01.356 INFO:tasks.workunit.client.0.smithi067.stdout:3/53: symlink d0/lf 0 2024-01-17T23:33:01.388 INFO:tasks.workunit.client.0.smithi067.stdout:3/54: dwrite d0/fd [0,4194304] 0 2024-01-17T23:33:01.404 INFO:tasks.workunit.client.0.smithi067.stdout:3/55: read d0/f9 [4132019,52047] 0 2024-01-17T23:33:01.494 INFO:tasks.workunit.client.0.smithi067.stdout:1/62: mknod d0/d7/cf 0 2024-01-17T23:33:01.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/51: sync 2024-01-17T23:33:01.495 INFO:tasks.workunit.client.0.smithi067.stdout:9/40: sync 2024-01-17T23:33:01.495 INFO:tasks.workunit.client.0.smithi067.stdout:4/52: stat d3/cd 0 2024-01-17T23:33:01.495 INFO:tasks.workunit.client.0.smithi067.stdout:1/63: stat d0/l6 0 2024-01-17T23:33:01.495 INFO:tasks.workunit.client.0.smithi067.stdout:1/64: stat d0/f5 0 2024-01-17T23:33:01.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/53: write d3/f7 [3663281,23149] 0 2024-01-17T23:33:01.743 INFO:tasks.workunit.client.0.smithi067.stdout:2/67: creat d5/d6/d8/de/f14 x:0 0 0 2024-01-17T23:33:01.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/68: write d5/fa [1851062,120762] 0 2024-01-17T23:33:01.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/69: truncate d5/d6/d8/de/f14 609700 0 2024-01-17T23:33:01.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/39: mknod d6/cc 0 2024-01-17T23:33:01.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/40: getdents d6/d9 0 2024-01-17T23:33:01.921 INFO:tasks.workunit.client.0.smithi067.stdout:6/41: dwrite d6/f8 [0,4194304] 0 2024-01-17T23:33:01.921 INFO:tasks.workunit.client.0.smithi067.stdout:6/42: creat d6/fd x:0 0 0 2024-01-17T23:33:01.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/32: rename f1 to d6/f7 0 2024-01-17T23:33:01.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/33: readlink - no filename 2024-01-17T23:33:02.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/25: truncate f2 3821953 0 2024-01-17T23:33:02.535 INFO:tasks.workunit.client.0.smithi067.stdout:9/41: mkdir d3/d6/d10 0 2024-01-17T23:33:02.625 INFO:tasks.workunit.client.0.smithi067.stdout:1/65: mknod d0/c10 0 2024-01-17T23:33:02.641 INFO:tasks.workunit.client.0.smithi067.stdout:1/66: write d0/f5 [1876502,89213] 0 2024-01-17T23:33:02.826 INFO:tasks.workunit.client.0.smithi067.stdout:4/54: link d3/ca d3/d8/de/cf 0 2024-01-17T23:33:03.193 INFO:tasks.workunit.client.0.smithi067.stdout:2/70: symlink d5/d6/d8/de/l15 0 2024-01-17T23:33:03.194 INFO:tasks.workunit.client.0.smithi067.stdout:6/43: creat d6/d9/fe x:0 0 0 2024-01-17T23:33:03.194 INFO:tasks.workunit.client.0.smithi067.stdout:6/44: creat d6/ff x:0 0 0 2024-01-17T23:33:03.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/45: write d6/d9/fe [717518,22775] 0 2024-01-17T23:33:03.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/46: creat d6/d9/f10 x:0 0 0 2024-01-17T23:33:03.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/47: write f2 [3066815,92941] 0 2024-01-17T23:33:03.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/48: rename d6 to d6/d11 22 2024-01-17T23:33:03.195 INFO:tasks.workunit.client.0.smithi067.stdout:6/49: creat d6/d9/f12 x:0 0 0 2024-01-17T23:33:03.373 INFO:tasks.workunit.client.0.smithi067.stdout:8/34: mknod d6/c8 0 2024-01-17T23:33:03.373 INFO:tasks.workunit.client.0.smithi067.stdout:0/76: getdents d3/d5 0 2024-01-17T23:33:03.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/42: mkdir d3/d6/d11 0 2024-01-17T23:33:03.391 INFO:tasks.workunit.client.0.smithi067.stdout:4/55: symlink d3/l10 0 2024-01-17T23:33:03.394 INFO:tasks.workunit.client.0.smithi067.stdout:8/35: write f4 [3269183,129351] 0 2024-01-17T23:33:03.394 INFO:tasks.workunit.client.0.smithi067.stdout:8/36: write f4 [2456202,128568] 0 2024-01-17T23:33:03.409 INFO:tasks.workunit.client.0.smithi067.stdout:4/56: dread d3/f7 [4194304,4194304] 0 2024-01-17T23:33:03.505 INFO:tasks.workunit.client.0.smithi067.stdout:2/71: mkdir d5/d6/d8/de/d16 0 2024-01-17T23:33:03.505 INFO:tasks.workunit.client.0.smithi067.stdout:2/72: write d5/d6/f11 [558079,51881] 0 2024-01-17T23:33:03.507 INFO:tasks.workunit.client.0.smithi067.stdout:2/73: dread d5/d6/d8/de/f14 [0,4194304] 0 2024-01-17T23:33:04.184 INFO:tasks.workunit.client.0.smithi067.stdout:0/77: mknod d3/d5/d1a/d1c/c20 0 2024-01-17T23:33:04.184 INFO:tasks.workunit.client.0.smithi067.stdout:5/26: truncate f2 4258673 0 2024-01-17T23:33:04.199 INFO:tasks.workunit.client.0.smithi067.stdout:7/56: sync 2024-01-17T23:33:04.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/43: symlink d3/d6/d11/l12 0 2024-01-17T23:33:04.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/44: dread - d3/f5 zero size 2024-01-17T23:33:04.260 INFO:tasks.workunit.client.0.smithi067.stdout:9/45: dread f0 [4194304,4194304] 0 2024-01-17T23:33:04.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/37: creat d6/f9 x:0 0 0 2024-01-17T23:33:04.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/38: chown c3 1 1 2024-01-17T23:33:04.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/57: symlink d3/d5/l11 0 2024-01-17T23:33:04.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/58: chown d3/ca 1759 1 2024-01-17T23:33:04.668 INFO:tasks.workunit.client.0.smithi067.stdout:2/74: symlink d5/d6/d8/de/d16/l17 0 2024-01-17T23:33:04.668 INFO:tasks.workunit.client.0.smithi067.stdout:2/75: chown d5/d6/d8/de/l15 103 1 2024-01-17T23:33:04.669 INFO:tasks.workunit.client.0.smithi067.stdout:2/76: dread d5/d6/d8/de/f14 [0,4194304] 0 2024-01-17T23:33:04.911 INFO:tasks.workunit.client.0.smithi067.stdout:6/50: rename d6/d9/f12 to d6/f13 0 2024-01-17T23:33:04.911 INFO:tasks.workunit.client.0.smithi067.stdout:6/51: chown d6/f8 32391 1 2024-01-17T23:33:04.911 INFO:tasks.workunit.client.0.smithi067.stdout:6/52: creat d6/d9/f14 x:0 0 0 2024-01-17T23:33:05.106 INFO:tasks.workunit.client.0.smithi067.stdout:0/78: creat d3/d5/d1a/d1c/d1d/f21 x:0 0 0 2024-01-17T23:33:05.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/46: creat d3/f13 x:0 0 0 2024-01-17T23:33:05.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/47: truncate d3/d6/fe 834830 0 2024-01-17T23:33:05.429 INFO:tasks.workunit.client.0.smithi067.stdout:8/39: symlink d6/la 0 2024-01-17T23:33:05.429 INFO:tasks.workunit.client.0.smithi067.stdout:8/40: write d6/f7 [4056287,61685] 0 2024-01-17T23:33:05.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/56: sync 2024-01-17T23:33:05.507 INFO:tasks.workunit.client.0.smithi067.stdout:4/59: link d3/cd d3/c12 0 2024-01-17T23:33:05.507 INFO:tasks.workunit.client.0.smithi067.stdout:4/60: chown d3/d8/cb 598739749 1 2024-01-17T23:33:05.507 INFO:tasks.workunit.client.0.smithi067.stdout:4/61: write d3/f7 [1374570,12541] 0 2024-01-17T23:33:05.657 INFO:tasks.workunit.client.0.smithi067.stdout:2/77: symlink d5/d6/d8/de/d16/l18 0 2024-01-17T23:33:06.353 INFO:tasks.workunit.client.0.smithi067.stdout:7/57: getdents d4 0 2024-01-17T23:33:06.353 INFO:tasks.workunit.client.0.smithi067.stdout:7/58: chown d4/f6 204 1 2024-01-17T23:33:06.453 INFO:tasks.workunit.client.0.smithi067.stdout:9/48: symlink d3/da/l14 0 2024-01-17T23:33:06.466 INFO:tasks.workunit.client.0.smithi067.stdout:9/49: dread f2 [4194304,4194304] 0 2024-01-17T23:33:06.602 INFO:tasks.workunit.client.0.smithi067.stdout:8/41: mkdir d6/db 0 2024-01-17T23:33:06.602 INFO:tasks.workunit.client.0.smithi067.stdout:8/42: getdents d6/db 0 2024-01-17T23:33:06.602 INFO:tasks.workunit.client.0.smithi067.stdout:8/43: write f4 [4558322,7834] 0 2024-01-17T23:33:06.602 INFO:tasks.workunit.client.0.smithi067.stdout:8/44: read f4 [1736239,75356] 0 2024-01-17T23:33:06.746 INFO:tasks.workunit.client.0.smithi067.stdout:3/57: mknod d0/c10 0 2024-01-17T23:33:06.765 INFO:tasks.workunit.client.0.smithi067.stdout:3/58: read d0/fd [311558,64987] 0 2024-01-17T23:33:06.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/59: chown d0/fd 696375980 1 2024-01-17T23:33:06.924 INFO:tasks.workunit.client.0.smithi067.stdout:5/27: write f2 [1120311,93852] 0 2024-01-17T23:33:06.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/62: creat d3/d8/f13 x:0 0 0 2024-01-17T23:33:06.965 INFO:tasks.workunit.client.0.smithi067.stdout:5/28: dwrite f2 [0,4194304] 0 2024-01-17T23:33:06.990 INFO:tasks.workunit.client.0.smithi067.stdout:5/29: dwrite f2 [4194304,4194304] 0 2024-01-17T23:33:07.009 INFO:tasks.workunit.client.0.smithi067.stdout:5/30: write f2 [4110038,42268] 0 2024-01-17T23:33:07.031 INFO:tasks.workunit.client.0.smithi067.stdout:2/78: mknod d5/d6/c19 0 2024-01-17T23:33:07.031 INFO:tasks.workunit.client.0.smithi067.stdout:2/79: chown d5/d6/d8/de/d16/l17 124982471 1 2024-01-17T23:33:07.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/59: creat d4/f10 x:0 0 0 2024-01-17T23:33:07.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/60: write d4/f10 [517047,111228] 0 2024-01-17T23:33:07.125 INFO:tasks.workunit.client.0.smithi067.stdout:7/61: fsync f1 0 2024-01-17T23:33:07.290 INFO:tasks.workunit.client.0.smithi067.stdout:9/50: mkdir d3/d15 0 2024-01-17T23:33:07.383 INFO:tasks.workunit.client.0.smithi067.stdout:8/45: mkdir d6/db/dc 0 2024-01-17T23:33:07.548 INFO:tasks.workunit.client.0.smithi067.stdout:3/60: rename d0/f2 to d0/f11 0 2024-01-17T23:33:07.682 INFO:tasks.workunit.client.0.smithi067.stdout:4/63: creat d3/d8/de/f14 x:0 0 0 2024-01-17T23:33:07.683 INFO:tasks.workunit.client.0.smithi067.stdout:4/64: chown d3/c12 220 1 2024-01-17T23:33:07.683 INFO:tasks.workunit.client.0.smithi067.stdout:4/65: dread - d3/d8/f13 zero size 2024-01-17T23:33:07.710 INFO:tasks.workunit.client.0.smithi067.stdout:4/66: dwrite d3/d5/fc [0,4194304] 0 2024-01-17T23:33:07.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/67: write d3/d5/fc [594111,11514] 0 2024-01-17T23:33:07.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/68: chown d3/c12 385840 1 2024-01-17T23:33:07.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/69: chown d3/d8/de/cf 1478860120 1 2024-01-17T23:33:07.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/70: chown d3/d8 3 1 2024-01-17T23:33:07.732 INFO:tasks.workunit.client.0.smithi067.stdout:4/71: chown d3/d5/fc 1097 1 2024-01-17T23:33:07.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/31: unlink f2 0 2024-01-17T23:33:07.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/32: chown c4 0 1 2024-01-17T23:33:07.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/33: creat f5 x:0 0 0 2024-01-17T23:33:07.824 INFO:tasks.workunit.client.0.smithi067.stdout:5/34: chown c4 1 1 2024-01-17T23:33:07.854 INFO:tasks.workunit.client.0.smithi067.stdout:5/35: dwrite f5 [0,4194304] 0 2024-01-17T23:33:08.125 INFO:tasks.workunit.client.0.smithi067.stdout:2/80: link f4 d5/d6/f1a 0 2024-01-17T23:33:08.125 INFO:tasks.workunit.client.0.smithi067.stdout:2/81: write f4 [4027115,21119] 0 2024-01-17T23:33:08.155 INFO:tasks.workunit.client.0.smithi067.stdout:2/82: dwrite f4 [0,4194304] 0 2024-01-17T23:33:08.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/83: dwrite d5/d6/d8/de/f14 [0,4194304] 0 2024-01-17T23:33:08.294 INFO:tasks.workunit.client.0.smithi067.stdout:7/62: getdents d4/de 0 2024-01-17T23:33:08.742 INFO:tasks.workunit.client.0.smithi067.stdout:8/46: mknod d6/cd 0 2024-01-17T23:33:08.775 INFO:tasks.workunit.client.0.smithi067.stdout:8/47: dwrite d6/f7 [0,4194304] 0 2024-01-17T23:33:08.904 INFO:tasks.workunit.client.0.smithi067.stdout:3/61: mkdir d0/d12 0 2024-01-17T23:33:08.931 INFO:tasks.workunit.client.0.smithi067.stdout:3/62: write d0/f11 [1791806,42385] 0 2024-01-17T23:33:08.931 INFO:tasks.workunit.client.0.smithi067.stdout:3/63: fsync d0/fc 0 2024-01-17T23:33:08.931 INFO:tasks.workunit.client.0.smithi067.stdout:3/64: getdents d0/d12 0 2024-01-17T23:33:08.932 INFO:tasks.workunit.client.0.smithi067.stdout:3/65: fdatasync d0/fa 0 2024-01-17T23:33:08.932 INFO:tasks.workunit.client.0.smithi067.stdout:3/66: fdatasync d0/f3 0 2024-01-17T23:33:08.954 INFO:tasks.workunit.client.0.smithi067.stdout:3/67: read d0/f5 [2692926,53276] 0 2024-01-17T23:33:08.989 INFO:tasks.workunit.client.0.smithi067.stdout:3/68: dwrite d0/fd [0,4194304] 0 2024-01-17T23:33:09.886 INFO:tasks.workunit.client.0.smithi067.stdout:7/63: creat d4/f11 x:0 0 0 2024-01-17T23:33:10.299 INFO:tasks.workunit.client.0.smithi067.stdout:2/84: mknod d5/c1b 0 2024-01-17T23:33:10.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/69: mkdir d0/d13 0 2024-01-17T23:33:10.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/70: chown d0/d13 380 1 2024-01-17T23:33:10.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/71: fdatasync d0/fa 0 2024-01-17T23:33:10.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/67: rmdir d0 39 2024-01-17T23:33:10.523 INFO:tasks.workunit.client.0.smithi067.stdout:6/53: sync 2024-01-17T23:33:10.523 INFO:tasks.workunit.client.0.smithi067.stdout:0/79: sync 2024-01-17T23:33:10.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/80: chown d3/f1b 11047 1 2024-01-17T23:33:10.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/54: read - d6/d9/f10 zero size 2024-01-17T23:33:10.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/81: dread - d3/f11 zero size 2024-01-17T23:33:10.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/55: rename d6 to d6/d9/d15 22 2024-01-17T23:33:10.524 INFO:tasks.workunit.client.0.smithi067.stdout:0/82: write d3/d5/f9 [5124377,94646] 0 2024-01-17T23:33:10.554 INFO:tasks.workunit.client.0.smithi067.stdout:1/68: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:10.567 INFO:tasks.workunit.client.0.smithi067.stdout:1/69: write d0/f5 [6931,104979] 0 2024-01-17T23:33:10.572 INFO:tasks.workunit.client.0.smithi067.stdout:1/70: fsync d0/f5 0 2024-01-17T23:33:10.580 INFO:tasks.workunit.client.0.smithi067.stdout:1/71: dread d0/f5 [0,4194304] 0 2024-01-17T23:33:10.581 INFO:tasks.workunit.client.0.smithi067.stdout:1/72: write d0/f5 [3740662,1361] 0 2024-01-17T23:33:10.593 INFO:tasks.workunit.client.0.smithi067.stdout:1/73: dread d0/f5 [0,4194304] 0 2024-01-17T23:33:10.593 INFO:tasks.workunit.client.0.smithi067.stdout:1/74: write d0/f5 [952259,120260] 0 2024-01-17T23:33:10.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/64: symlink d4/de/l12 0 2024-01-17T23:33:10.895 INFO:tasks.workunit.client.0.smithi067.stdout:2/85: symlink d5/l1c 0 2024-01-17T23:33:10.895 INFO:tasks.workunit.client.0.smithi067.stdout:2/86: stat d5 0 2024-01-17T23:33:10.895 INFO:tasks.workunit.client.0.smithi067.stdout:8/48: truncate f4 1563668 0 2024-01-17T23:33:10.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/51: sync 2024-01-17T23:33:10.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/52: write d3/d6/ff [683146,45867] 0 2024-01-17T23:33:10.966 INFO:tasks.workunit.client.0.smithi067.stdout:9/53: write d3/f13 [703199,104078] 0 2024-01-17T23:33:11.043 INFO:tasks.workunit.client.0.smithi067.stdout:3/72: creat d0/f14 x:0 0 0 2024-01-17T23:33:11.043 INFO:tasks.workunit.client.0.smithi067.stdout:3/73: write d0/f14 [165744,24020] 0 2024-01-17T23:33:11.043 INFO:tasks.workunit.client.0.smithi067.stdout:3/74: read - d0/fc zero size 2024-01-17T23:33:11.043 INFO:tasks.workunit.client.0.smithi067.stdout:3/75: write d0/fc [15283,87932] 0 2024-01-17T23:33:11.047 INFO:tasks.workunit.client.0.smithi067.stdout:3/76: fsync d0/fc 0 2024-01-17T23:33:11.047 INFO:tasks.workunit.client.0.smithi067.stdout:3/77: write d0/f11 [443097,88921] 0 2024-01-17T23:33:11.047 INFO:tasks.workunit.client.0.smithi067.stdout:3/78: write d0/f14 [1032651,53333] 0 2024-01-17T23:33:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/56: mknod d6/c16 0 2024-01-17T23:33:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/57: stat d6 0 2024-01-17T23:33:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/58: write d6/d9/f14 [274777,75913] 0 2024-01-17T23:33:11.297 INFO:tasks.workunit.client.0.smithi067.stdout:0/83: creat d3/d5/d1a/f22 x:0 0 0 2024-01-17T23:33:11.416 INFO:tasks.workunit.client.0.smithi067.stdout:1/75: getdents d0/d7 0 2024-01-17T23:33:11.444 INFO:tasks.workunit.client.0.smithi067.stdout:5/36: fsync f5 0 2024-01-17T23:33:11.445 INFO:tasks.workunit.client.0.smithi067.stdout:4/72: sync 2024-01-17T23:33:11.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/76: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:11.458 INFO:tasks.workunit.client.0.smithi067.stdout:1/77: dread d0/f5 [0,4194304] 0 2024-01-17T23:33:11.525 INFO:tasks.workunit.client.0.smithi067.stdout:7/65: dwrite d4/f8 [0,4194304] 0 2024-01-17T23:33:11.585 INFO:tasks.workunit.client.0.smithi067.stdout:2/87: getdents d5/d6/d8/de/d16 0 2024-01-17T23:33:11.593 INFO:tasks.workunit.client.0.smithi067.stdout:2/88: dread d5/fa [0,4194304] 0 2024-01-17T23:33:12.009 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:12.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:12.245 INFO:tasks.workunit.client.0.smithi067.stdout:9/54: mknod d3/d6/c16 0 2024-01-17T23:33:12.250 INFO:tasks.workunit.client.0.smithi067.stdout:9/55: read d3/d6/f9 [267109,86625] 0 2024-01-17T23:33:12.250 INFO:tasks.workunit.client.0.smithi067.stdout:9/56: truncate d3/f13 1841904 0 2024-01-17T23:33:12.250 INFO:tasks.workunit.client.0.smithi067.stdout:9/57: write d3/d6/ff [1012021,78614] 0 2024-01-17T23:33:12.479 INFO:tasks.workunit.client.0.smithi067.stdout:3/79: symlink d0/d13/l15 0 2024-01-17T23:33:12.923 INFO:tasks.workunit.client.0.smithi067.stdout:6/59: link d6/d9/f14 d6/f17 0 2024-01-17T23:33:13.171 INFO:tasks.workunit.client.0.smithi067.stdout:0/84: mknod d3/d5/d1a/d1c/c23 0 2024-01-17T23:33:13.215 INFO:tasks.workunit.client.0.smithi067.stdout:0/85: creat d3/d5/d1a/f24 x:0 0 0 2024-01-17T23:33:13.463 INFO:tasks.workunit.client.0.smithi067.stdout:1/78: symlink d0/l11 0 2024-01-17T23:33:13.764 INFO:tasks.workunit.client.0.smithi067.stdout:2/89: mknod d5/d6/d8/de/d16/c1d 0 2024-01-17T23:33:13.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/58: truncate d3/d6/fe 61296 0 2024-01-17T23:33:13.923 INFO:tasks.workunit.client.0.smithi067.stdout:3/80: creat d0/d13/f16 x:0 0 0 2024-01-17T23:33:14.064 INFO:tasks.workunit.client.0.smithi067.stdout:0/86: symlink d3/l25 0 2024-01-17T23:33:14.064 INFO:tasks.workunit.client.0.smithi067.stdout:0/87: dread - d3/d5/d1a/f22 zero size 2024-01-17T23:33:14.100 INFO:tasks.workunit.client.0.smithi067.stdout:0/88: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:33:14.100 INFO:tasks.workunit.client.0.smithi067.stdout:0/89: chown d3/f11 3 1 2024-01-17T23:33:14.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/37: getdents . 0 2024-01-17T23:33:14.603 INFO:tasks.workunit.client.0.smithi067.stdout:1/79: mknod d0/d7/c12 0 2024-01-17T23:33:14.628 INFO:tasks.workunit.client.0.smithi067.stdout:1/80: dwrite d0/f5 [4194304,4194304] 0 2024-01-17T23:33:14.669 INFO:tasks.workunit.client.0.smithi067.stdout:7/66: unlink d4/f11 0 2024-01-17T23:33:14.727 INFO:tasks.workunit.client.0.smithi067.stdout:9/59: symlink d3/da/l17 0 2024-01-17T23:33:14.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/60: getdents d6/d9 0 2024-01-17T23:33:14.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/61: chown d6/d9/f14 81476 1 2024-01-17T23:33:14.929 INFO:tasks.workunit.client.0.smithi067.stdout:3/81: mkdir d0/d17 0 2024-01-17T23:33:15.176 INFO:tasks.workunit.client.0.smithi067.stdout:0/90: creat d3/d5/f26 x:0 0 0 2024-01-17T23:33:15.176 INFO:tasks.workunit.client.0.smithi067.stdout:0/91: write d3/d6/ff [377306,53626] 0 2024-01-17T23:33:15.217 INFO:tasks.workunit.client.0.smithi067.stdout:0/92: dwrite d3/d6/ff [0,4194304] 0 2024-01-17T23:33:15.218 INFO:tasks.workunit.client.0.smithi067.stdout:0/93: dread - d3/d5/d1a/f24 zero size 2024-01-17T23:33:15.262 INFO:tasks.workunit.client.0.smithi067.stdout:8/49: sync 2024-01-17T23:33:15.354 INFO:tasks.workunit.client.0.smithi067.stdout:5/38: mknod c6 0 2024-01-17T23:33:15.366 INFO:tasks.workunit.client.0.smithi067.stdout:5/39: write f5 [3412314,49281] 0 2024-01-17T23:33:15.411 INFO:tasks.workunit.client.0.smithi067.stdout:5/40: dwrite f5 [4194304,4194304] 0 2024-01-17T23:33:15.411 INFO:tasks.workunit.client.0.smithi067.stdout:5/41: rmdir - no directory 2024-01-17T23:33:15.592 INFO:tasks.workunit.client.0.smithi067.stdout:1/81: mkdir d0/d7/d13 0 2024-01-17T23:33:15.611 INFO:tasks.workunit.client.0.smithi067.stdout:1/82: write d0/f5 [6971725,2846] 0 2024-01-17T23:33:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:1/83: dread d0/f5 [4194304,4194304] 0 2024-01-17T23:33:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:1/84: fsync d0/f5 0 2024-01-17T23:33:15.657 INFO:tasks.workunit.client.0.smithi067.stdout:1/85: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:16.020 INFO:tasks.workunit.client.0.smithi067.stdout:0/94: mknod d3/d6/c27 0 2024-01-17T23:33:16.033 INFO:tasks.workunit.client.0.smithi067.stdout:0/95: write d3/f1b [1447596,127796] 0 2024-01-17T23:33:16.342 INFO:tasks.workunit.client.0.smithi067.stdout:5/42: creat f7 x:0 0 0 2024-01-17T23:33:16.433 INFO:tasks.workunit.client.0.smithi067.stdout:1/86: link d0/ce d0/c14 0 2024-01-17T23:33:16.444 INFO:tasks.workunit.client.0.smithi067.stdout:1/87: dread d0/f5 [0,4194304] 0 2024-01-17T23:33:16.572 INFO:tasks.workunit.client.0.smithi067.stdout:7/67: truncate f1 2779437 0 2024-01-17T23:33:16.707 INFO:tasks.workunit.client.0.smithi067.stdout:3/82: rmdir d0/d13 39 2024-01-17T23:33:17.031 INFO:tasks.workunit.client.0.smithi067.stdout:0/96: mknod d3/d5/d1a/c28 0 2024-01-17T23:33:17.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/50: creat d6/fe x:0 0 0 2024-01-17T23:33:17.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/51: stat d6/db/dc 0 2024-01-17T23:33:17.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/97: dread d3/f4 [0,4194304] 0 2024-01-17T23:33:17.048 INFO:tasks.workunit.client.0.smithi067.stdout:8/52: dread f5 [0,4194304] 0 2024-01-17T23:33:17.048 INFO:tasks.workunit.client.0.smithi067.stdout:8/53: chown c3 104975717 1 2024-01-17T23:33:17.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/43: mknod c8 0 2024-01-17T23:33:17.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/44: dwrite f5 [4194304,4194304] 0 2024-01-17T23:33:17.796 INFO:tasks.workunit.client.0.smithi067.stdout:1/88: link d0/ce d0/d7/d13/c15 0 2024-01-17T23:33:17.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/68: rmdir d4/de 39 2024-01-17T23:33:18.193 INFO:tasks.workunit.client.0.smithi067.stdout:3/83: mknod d0/d12/c18 0 2024-01-17T23:33:18.193 INFO:tasks.workunit.client.0.smithi067.stdout:3/84: fsync d0/f9 0 2024-01-17T23:33:18.461 INFO:tasks.workunit.client.0.smithi067.stdout:0/98: creat d3/d6/dd/f29 x:0 0 0 2024-01-17T23:33:18.461 INFO:tasks.workunit.client.0.smithi067.stdout:0/99: readlink d3/d6/l10 0 2024-01-17T23:33:18.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/54: mkdir d6/db/dc/df 0 2024-01-17T23:33:18.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/55: write d6/f7 [4574729,88081] 0 2024-01-17T23:33:18.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/73: rename d3/ca to d3/d5/c15 0 2024-01-17T23:33:18.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/89: mkdir d0/d16 0 2024-01-17T23:33:19.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/90: creat d5/d6/d8/de/f1e x:0 0 0 2024-01-17T23:33:19.213 INFO:tasks.workunit.client.0.smithi067.stdout:7/69: write d4/fd [345150,87465] 0 2024-01-17T23:33:19.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/85: creat d0/d13/f19 x:0 0 0 2024-01-17T23:33:19.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/86: chown d0/lf 2865 1 2024-01-17T23:33:19.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/87: chown d0/f14 60421 1 2024-01-17T23:33:19.432 INFO:tasks.workunit.client.0.smithi067.stdout:0/100: symlink d3/d6/dd/l2a 0 2024-01-17T23:33:19.433 INFO:tasks.workunit.client.0.smithi067.stdout:0/101: chown d3 2987267 1 2024-01-17T23:33:19.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/102: read d3/d5/f9 [879121,58168] 0 2024-01-17T23:33:19.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/103: creat d3/d5/f2b x:0 0 0 2024-01-17T23:33:19.486 INFO:tasks.workunit.client.0.smithi067.stdout:0/104: dwrite d3/d5/fa [0,4194304] 0 2024-01-17T23:33:19.547 INFO:tasks.workunit.client.0.smithi067.stdout:8/56: rmdir d6/db/dc/df 0 2024-01-17T23:33:19.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/57: dread f5 [0,4194304] 0 2024-01-17T23:33:19.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/74: symlink d3/d8/l16 0 2024-01-17T23:33:19.721 INFO:tasks.workunit.client.0.smithi067.stdout:4/75: dread d3/f7 [0,4194304] 0 2024-01-17T23:33:19.750 INFO:tasks.workunit.client.0.smithi067.stdout:4/76: dwrite f1 [0,4194304] 0 2024-01-17T23:33:19.769 INFO:tasks.workunit.client.0.smithi067.stdout:4/77: write f1 [760456,124032] 0 2024-01-17T23:33:19.769 INFO:tasks.workunit.client.0.smithi067.stdout:4/78: chown d3/d8 2049868858 1 2024-01-17T23:33:19.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/90: link d0/l11 d0/d7/d13/l17 0 2024-01-17T23:33:19.908 INFO:tasks.workunit.client.0.smithi067.stdout:1/91: dread d0/f5 [0,4194304] 0 2024-01-17T23:33:19.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/92: write d0/f5 [2697022,97405] 0 2024-01-17T23:33:19.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/93: stat d0/d7/d13 0 2024-01-17T23:33:20.143 INFO:tasks.workunit.client.0.smithi067.stdout:7/70: rmdir d4 39 2024-01-17T23:33:20.143 INFO:tasks.workunit.client.0.smithi067.stdout:3/88: mkdir d0/d13/d1a 0 2024-01-17T23:33:20.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/58: mkdir d6/db/d10 0 2024-01-17T23:33:20.860 INFO:tasks.workunit.client.0.smithi067.stdout:5/45: getdents . 0 2024-01-17T23:33:20.889 INFO:tasks.workunit.client.0.smithi067.stdout:5/46: dwrite f5 [0,4194304] 0 2024-01-17T23:33:20.927 INFO:tasks.workunit.client.0.smithi067.stdout:5/47: dwrite f5 [4194304,4194304] 0 2024-01-17T23:33:21.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/71: dread d4/f7 [0,4194304] 0 2024-01-17T23:33:21.158 INFO:tasks.workunit.client.0.smithi067.stdout:3/89: mkdir d0/d12/d1b 0 2024-01-17T23:33:21.371 INFO:tasks.workunit.client.0.smithi067.stdout:9/60: mknod d3/d6/c18 0 2024-01-17T23:33:21.589 INFO:tasks.workunit.client.0.smithi067.stdout:6/62: mkdir d6/d18 0 2024-01-17T23:33:21.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/63: dread d6/d9/f14 [0,4194304] 0 2024-01-17T23:33:21.620 INFO:tasks.workunit.client.0.smithi067.stdout:6/64: dwrite d6/f8 [0,4194304] 0 2024-01-17T23:33:21.672 INFO:tasks.workunit.client.0.smithi067.stdout:8/59: mknod d6/db/c11 0 2024-01-17T23:33:21.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/48: link f7 f9 0 2024-01-17T23:33:21.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/49: truncate f9 303275 0 2024-01-17T23:33:21.857 INFO:tasks.workunit.client.0.smithi067.stdout:7/72: truncate d4/fa 385708 0 2024-01-17T23:33:21.967 INFO:tasks.workunit.client.0.smithi067.stdout:3/90: creat d0/d12/f1c x:0 0 0 2024-01-17T23:33:21.967 INFO:tasks.workunit.client.0.smithi067.stdout:3/91: getdents d0/d13/d1a 0 2024-01-17T23:33:22.037 INFO:tasks.workunit.client.0.smithi067.stdout:9/61: mknod d3/d6/d10/c19 0 2024-01-17T23:33:22.038 INFO:tasks.workunit.client.0.smithi067.stdout:9/62: chown d3/f5 27453423 1 2024-01-17T23:33:22.043 INFO:tasks.workunit.client.0.smithi067.stdout:9/63: dread d3/d6/ff [0,4194304] 0 2024-01-17T23:33:22.073 INFO:tasks.workunit.client.0.smithi067.stdout:9/64: dwrite d3/f5 [0,4194304] 0 2024-01-17T23:33:22.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/79: link d3/d5/c15 d3/d5/c17 0 2024-01-17T23:33:22.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/80: dread - d3/d8/f13 zero size 2024-01-17T23:33:22.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/81: write f1 [3632508,80232] 0 2024-01-17T23:33:22.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/60: rename d6/c8 to d6/c12 0 2024-01-17T23:33:22.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/50: creat fa x:0 0 0 2024-01-17T23:33:22.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/51: dread f9 [0,4194304] 0 2024-01-17T23:33:22.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/52: fdatasync f5 0 2024-01-17T23:33:22.696 INFO:tasks.workunit.client.0.smithi067.stdout:5/53: dwrite fa [0,4194304] 0 2024-01-17T23:33:22.696 INFO:tasks.workunit.client.0.smithi067.stdout:5/54: chown c6 16 1 2024-01-17T23:33:22.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/73: dread d4/fb [0,4194304] 0 2024-01-17T23:33:22.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/92: creat d0/d12/d1b/f1d x:0 0 0 2024-01-17T23:33:22.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/93: chown d0/f11 0 1 2024-01-17T23:33:22.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/94: readlink d0/d13/l15 0 2024-01-17T23:33:23.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/91: rename d5/d6/d8/de to d5/d1f 0 2024-01-17T23:33:23.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/92: write d5/d6/f11 [1237853,73573] 0 2024-01-17T23:33:23.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/93: chown d5/d6/f11 6 1 2024-01-17T23:33:23.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/94: stat d5/l1c 0 2024-01-17T23:33:23.143 INFO:tasks.workunit.client.0.smithi067.stdout:2/95: readlink d5/d1f/l12 0 2024-01-17T23:33:23.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/82: mknod d3/d8/c18 0 2024-01-17T23:33:23.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/83: readlink d3/l10 0 2024-01-17T23:33:23.267 INFO:tasks.workunit.client.0.smithi067.stdout:4/84: readlink d3/l10 0 2024-01-17T23:33:23.267 INFO:tasks.workunit.client.0.smithi067.stdout:4/85: chown d3/d8/f13 19 1 2024-01-17T23:33:23.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/61: link d6/fe d6/db/dc/f13 0 2024-01-17T23:33:23.389 INFO:tasks.workunit.client.0.smithi067.stdout:8/62: write f5 [689147,77384] 0 2024-01-17T23:33:23.820 INFO:tasks.workunit.client.0.smithi067.stdout:0/105: getdents d3/d5 0 2024-01-17T23:33:24.157 INFO:tasks.workunit.client.0.smithi067.stdout:2/96: creat d5/d1f/d16/f20 x:0 0 0 2024-01-17T23:33:24.158 INFO:tasks.workunit.client.0.smithi067.stdout:2/97: write d5/d6/f11 [1112155,57374] 0 2024-01-17T23:33:24.158 INFO:tasks.workunit.client.0.smithi067.stdout:2/98: readlink d5/d1f/d16/l17 0 2024-01-17T23:33:24.358 INFO:tasks.workunit.client.0.smithi067.stdout:9/65: rename d3/d6/c16 to d3/d15/c1a 0 2024-01-17T23:33:24.376 INFO:tasks.workunit.client.0.smithi067.stdout:9/66: write d3/f5 [2976572,54721] 0 2024-01-17T23:33:24.428 INFO:tasks.workunit.client.0.smithi067.stdout:4/86: symlink d3/l19 0 2024-01-17T23:33:24.645 INFO:tasks.workunit.client.0.smithi067.stdout:8/63: creat d6/db/d10/f14 x:0 0 0 2024-01-17T23:33:24.673 INFO:tasks.workunit.client.0.smithi067.stdout:8/64: dwrite d6/f9 [0,4194304] 0 2024-01-17T23:33:24.692 INFO:tasks.workunit.client.0.smithi067.stdout:8/65: write d6/f9 [2227136,118217] 0 2024-01-17T23:33:24.711 INFO:tasks.workunit.client.0.smithi067.stdout:8/66: dread d6/f9 [0,4194304] 0 2024-01-17T23:33:25.017 INFO:tasks.workunit.client.0.smithi067.stdout:0/106: link d3/d6/f1e d3/d5/d1a/f2c 0 2024-01-17T23:33:25.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/107: dwrite d3/d5/f26 [0,4194304] 0 2024-01-17T23:33:25.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/108: chown d3 1442 1 2024-01-17T23:33:25.307 INFO:tasks.workunit.client.0.smithi067.stdout:2/99: truncate d5/d6/d8/ff 1603981 0 2024-01-17T23:33:25.578 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:34:13.794 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.580 INFO:tasks.workunit.client.0.smithi067.stdout:9/67: link d3/d6/fe d3/d6/d11/f1b 0 2024-01-17T23:33:25.583 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:34:13.800 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.612 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:34:13.923 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.613 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:34:13.924 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.618 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:34:13.929 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.619 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:34:13.930 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.631 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:34:13.847 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.695 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:34:14.006 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.696 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:34:14.007 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:33:25.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/87: rename d3/d8/de/cf to d3/d8/c1a 0 2024-01-17T23:33:25.953 INFO:tasks.workunit.client.0.smithi067.stdout:8/67: mknod d6/db/dc/c15 0 2024-01-17T23:33:25.953 INFO:tasks.workunit.client.0.smithi067.stdout:8/68: write f5 [2398328,125853] 0 2024-01-17T23:33:25.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/69: write f5 [3343355,104314] 0 2024-01-17T23:33:25.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/70: write f4 [2273126,78057] 0 2024-01-17T23:33:26.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/100: unlink d5/d1f/d16/c1d 0 2024-01-17T23:33:26.183 INFO:tasks.workunit.client.0.smithi067.stdout:9/68: dread d3/f13 [0,4194304] 0 2024-01-17T23:33:26.183 INFO:tasks.workunit.client.0.smithi067.stdout:9/69: stat d3/d6/f9 0 2024-01-17T23:33:26.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/70: chown d3/d6/fe 128288 1 2024-01-17T23:33:26.292 INFO:tasks.workunit.client.0.smithi067.stdout:4/88: symlink d3/d5/l1b 0 2024-01-17T23:33:26.425 INFO:tasks.workunit.client.0.smithi067.stdout:2/101: rmdir d5/d6/d8 39 2024-01-17T23:33:26.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/71: mknod d3/da/c1c 0 2024-01-17T23:33:26.685 INFO:tasks.workunit.client.0.smithi067.stdout:1/94: sync 2024-01-17T23:33:26.685 INFO:tasks.workunit.client.0.smithi067.stdout:6/65: sync 2024-01-17T23:33:26.686 INFO:tasks.workunit.client.0.smithi067.stdout:5/55: sync 2024-01-17T23:33:26.686 INFO:tasks.workunit.client.0.smithi067.stdout:5/56: chown c4 14 1 2024-01-17T23:33:26.698 INFO:tasks.workunit.client.0.smithi067.stdout:1/95: dread d0/f5 [4194304,4194304] 0 2024-01-17T23:33:26.698 INFO:tasks.workunit.client.0.smithi067.stdout:1/96: chown d0 47362311 1 2024-01-17T23:33:26.729 INFO:tasks.workunit.client.0.smithi067.stdout:6/66: dwrite d6/fa [0,4194304] 0 2024-01-17T23:33:26.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/97: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:26.953 INFO:tasks.workunit.client.0.smithi067.stdout:7/74: dwrite d4/f6 [0,4194304] 0 2024-01-17T23:33:26.971 INFO:tasks.workunit.client.0.smithi067.stdout:3/95: creat d0/f1e x:0 0 0 2024-01-17T23:33:27.112 INFO:tasks.workunit.client.0.smithi067.stdout:5/57: truncate f5 6184168 0 2024-01-17T23:33:27.274 INFO:tasks.workunit.client.0.smithi067.stdout:6/67: symlink d6/l19 0 2024-01-17T23:33:27.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/68: dread d6/fb [0,4194304] 0 2024-01-17T23:33:27.399 INFO:tasks.workunit.client.0.smithi067.stdout:1/98: link d0/c10 d0/c18 0 2024-01-17T23:33:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/96: link d0/f11 d0/d12/d1b/f1f 0 2024-01-17T23:33:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/97: read d0/f5 [1316270,42528] 0 2024-01-17T23:33:27.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/98: dread d0/f9 [0,4194304] 0 2024-01-17T23:33:28.024 INFO:tasks.workunit.client.0.smithi067.stdout:4/89: getdents d3/d5 0 2024-01-17T23:33:28.127 INFO:tasks.workunit.client.0.smithi067.stdout:6/69: mknod d6/d9/c1a 0 2024-01-17T23:33:28.130 INFO:tasks.workunit.client.0.smithi067.stdout:0/109: rename d3/d5/fa to d3/f2d 0 2024-01-17T23:33:28.143 INFO:tasks.workunit.client.0.smithi067.stdout:5/58: write f5 [5388729,15335] 0 2024-01-17T23:33:28.155 INFO:tasks.workunit.client.0.smithi067.stdout:6/70: read d6/fa [3751234,73215] 0 2024-01-17T23:33:28.155 INFO:tasks.workunit.client.0.smithi067.stdout:6/71: write d6/ff [60631,76649] 0 2024-01-17T23:33:28.161 INFO:tasks.workunit.client.0.smithi067.stdout:5/59: dread fa [0,4194304] 0 2024-01-17T23:33:28.161 INFO:tasks.workunit.client.0.smithi067.stdout:5/60: creat fb x:0 0 0 2024-01-17T23:33:28.161 INFO:tasks.workunit.client.0.smithi067.stdout:5/61: creat fc x:0 0 0 2024-01-17T23:33:28.202 INFO:tasks.workunit.client.0.smithi067.stdout:7/75: symlink d4/l13 0 2024-01-17T23:33:28.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/99: getdents d0 0 2024-01-17T23:33:28.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/100: readlink d0/l11 0 2024-01-17T23:33:28.692 INFO:tasks.workunit.client.0.smithi067.stdout:1/101: write d0/f5 [1830571,7367] 0 2024-01-17T23:33:28.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/90: symlink d3/l1c 0 2024-01-17T23:33:28.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/91: stat d3/l1c 0 2024-01-17T23:33:28.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/92: truncate d3/d8/f13 822509 0 2024-01-17T23:33:28.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/93: getdents d3/d5 0 2024-01-17T23:33:28.877 INFO:tasks.workunit.client.0.smithi067.stdout:4/94: dread d3/d8/f13 [0,4194304] 0 2024-01-17T23:33:28.936 INFO:tasks.workunit.client.0.smithi067.stdout:8/71: rename d6/db/dc/f13 to d6/db/d10/f16 0 2024-01-17T23:33:29.091 INFO:tasks.workunit.client.0.smithi067.stdout:0/110: mkdir d3/d5/d1a/d1c/d1d/d2e 0 2024-01-17T23:33:29.091 INFO:tasks.workunit.client.0.smithi067.stdout:6/72: symlink d6/d18/l1b 0 2024-01-17T23:33:29.091 INFO:tasks.workunit.client.0.smithi067.stdout:6/73: dread - d6/fd zero size 2024-01-17T23:33:29.091 INFO:tasks.workunit.client.0.smithi067.stdout:6/74: fsync d6/f17 0 2024-01-17T23:33:29.316 INFO:tasks.workunit.client.0.smithi067.stdout:5/62: rename f5 to fd 0 2024-01-17T23:33:29.486 INFO:tasks.workunit.client.0.smithi067.stdout:7/76: creat d4/de/f14 x:0 0 0 2024-01-17T23:33:30.230 INFO:tasks.workunit.client.0.smithi067.stdout:1/102: rmdir d0/d16 0 2024-01-17T23:33:30.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/95: symlink d3/d8/l1d 0 2024-01-17T23:33:30.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/96: dread - d3/d8/de/f14 zero size 2024-01-17T23:33:30.857 INFO:tasks.workunit.client.0.smithi067.stdout:0/111: creat d3/d6/f2f x:0 0 0 2024-01-17T23:33:30.937 INFO:tasks.workunit.client.0.smithi067.stdout:6/75: mkdir d6/d9/d1c 0 2024-01-17T23:33:30.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/76: read d6/f17 [18542,66190] 0 2024-01-17T23:33:30.945 INFO:tasks.workunit.client.0.smithi067.stdout:6/77: dread d6/d9/fe [0,4194304] 0 2024-01-17T23:33:31.209 INFO:tasks.workunit.client.0.smithi067.stdout:7/77: mkdir d4/de/d15 0 2024-01-17T23:33:31.209 INFO:tasks.workunit.client.0.smithi067.stdout:7/78: fdatasync d4/fa 0 2024-01-17T23:33:31.286 INFO:tasks.workunit.client.0.smithi067.stdout:3/99: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-01-17T23:33:31.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/100: write d0/d12/d1b/f1f [3751763,22125] 0 2024-01-17T23:33:31.307 INFO:tasks.workunit.client.0.smithi067.stdout:1/103: fdatasync d0/f5 0 2024-01-17T23:33:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:1/104: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:1/105: fdatasync d0/f5 0 2024-01-17T23:33:31.334 INFO:tasks.workunit.client.0.smithi067.stdout:1/106: fsync d0/f5 0 2024-01-17T23:33:31.428 INFO:tasks.workunit.client.0.smithi067.stdout:0/112: mknod d3/d5/d1a/d1c/d1d/c30 0 2024-01-17T23:33:31.459 INFO:tasks.workunit.client.0.smithi067.stdout:6/78: creat d6/d18/f1d x:0 0 0 2024-01-17T23:33:31.459 INFO:tasks.workunit.client.0.smithi067.stdout:6/79: write f2 [3217958,129551] 0 2024-01-17T23:33:31.459 INFO:tasks.workunit.client.0.smithi067.stdout:6/80: write d6/f13 [669648,73718] 0 2024-01-17T23:33:31.461 INFO:tasks.workunit.client.0.smithi067.stdout:6/81: dread d6/f17 [0,4194304] 0 2024-01-17T23:33:31.552 INFO:tasks.workunit.client.0.smithi067.stdout:5/63: rename fb to fe 0 2024-01-17T23:33:31.901 INFO:tasks.workunit.client.0.smithi067.stdout:1/107: chown d0/d7/d13/l17 14 1 2024-01-17T23:33:31.919 INFO:tasks.workunit.client.0.smithi067.stdout:1/108: dread d0/f5 [4194304,4194304] 0 2024-01-17T23:33:31.995 INFO:tasks.workunit.client.0.smithi067.stdout:0/113: mknod d3/d5/c31 0 2024-01-17T23:33:32.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/82: mkdir d6/d9/d1c/d1e 0 2024-01-17T23:33:32.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/64: unlink c4 0 2024-01-17T23:33:32.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/65: dread - fe zero size 2024-01-17T23:33:32.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/66: creat ff x:0 0 0 2024-01-17T23:33:32.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/97: getdents d3/d8 0 2024-01-17T23:33:32.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/114: mkdir d3/d5/d32 0 2024-01-17T23:33:32.721 INFO:tasks.workunit.client.0.smithi067.stdout:3/101: creat d0/d12/f20 x:0 0 0 2024-01-17T23:33:32.721 INFO:tasks.workunit.client.0.smithi067.stdout:3/102: chown d0/f14 0 1 2024-01-17T23:33:32.740 INFO:tasks.workunit.client.0.smithi067.stdout:2/102: rename d5/d6/c19 to d5/d1f/d16/c21 0 2024-01-17T23:33:32.741 INFO:tasks.workunit.client.0.smithi067.stdout:2/103: readlink d5/d1f/d16/l18 0 2024-01-17T23:33:33.133 INFO:tasks.workunit.client.0.smithi067.stdout:5/67: mkdir d10 0 2024-01-17T23:33:33.133 INFO:tasks.workunit.client.0.smithi067.stdout:5/68: truncate f9 604681 0 2024-01-17T23:33:33.133 INFO:tasks.workunit.client.0.smithi067.stdout:7/79: write d4/fa [1030512,76310] 0 2024-01-17T23:33:33.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/115: link d3/d6/f1e d3/d5/d1a/d1c/d1d/d2e/f33 0 2024-01-17T23:33:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/103: link d0/d12/d1b/f1f d0/d12/f21 0 2024-01-17T23:33:33.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/104: stat d0/d13/f19 0 2024-01-17T23:33:33.522 INFO:tasks.workunit.client.0.smithi067.stdout:9/72: rename d3/d6/ff to d3/d6/d10/f1d 0 2024-01-17T23:33:33.599 INFO:tasks.workunit.client.0.smithi067.stdout:2/104: mknod d5/d6/d8/c22 0 2024-01-17T23:33:33.885 INFO:tasks.workunit.client.0.smithi067.stdout:5/69: creat d10/f11 x:0 0 0 2024-01-17T23:33:33.900 INFO:tasks.workunit.client.0.smithi067.stdout:5/70: dread fd [0,4194304] 0 2024-01-17T23:33:33.910 INFO:tasks.workunit.client.0.smithi067.stdout:5/71: write fd [1666610,47718] 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/72: dwrite d10/f11 [0,4194304] 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/73: creat d10/f12 x:0 0 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/74: creat d10/f13 x:0 0 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/75: fsync fc 0 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/76: read - d10/f13 zero size 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/77: chown d10/f13 1990840538 1 2024-01-17T23:33:33.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/78: readlink - no filename 2024-01-17T23:33:33.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/79: dread - fc zero size 2024-01-17T23:33:34.456 INFO:tasks.workunit.client.0.smithi067.stdout:8/72: rename d6/f7 to d6/db/d10/f17 0 2024-01-17T23:33:34.456 INFO:tasks.workunit.client.0.smithi067.stdout:8/73: fdatasync d6/fe 0 2024-01-17T23:33:34.456 INFO:tasks.workunit.client.0.smithi067.stdout:8/74: stat d6/db/c11 0 2024-01-17T23:33:34.523 INFO:tasks.workunit.client.0.smithi067.stdout:9/73: dread d3/d6/d11/f1b [0,4194304] 0 2024-01-17T23:33:34.523 INFO:tasks.workunit.client.0.smithi067.stdout:9/74: write d3/f5 [2405192,76146] 0 2024-01-17T23:33:34.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/105: mkdir d5/d1f/d23 0 2024-01-17T23:33:34.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/116: fsync d3/d6/f1e 0 2024-01-17T23:33:35.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/80: getdents d4/de 0 2024-01-17T23:33:36.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/75: rename d6/db/dc to d6/db/d18 0 2024-01-17T23:33:36.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/76: write f5 [5276819,67178] 0 2024-01-17T23:33:36.573 INFO:tasks.workunit.client.0.smithi067.stdout:2/106: truncate d5/d1f/f14 376301 0 2024-01-17T23:33:36.739 INFO:tasks.workunit.client.0.smithi067.stdout:7/81: getdents d4 0 2024-01-17T23:33:36.968 INFO:tasks.workunit.client.0.smithi067.stdout:1/109: rename d0/d7/d13/c15 to d0/c19 0 2024-01-17T23:33:37.016 INFO:tasks.workunit.client.0.smithi067.stdout:1/110: dwrite d0/f5 [4194304,4194304] 0 2024-01-17T23:33:37.040 INFO:tasks.workunit.client.0.smithi067.stdout:1/111: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:33:37.096 INFO:tasks.workunit.client.0.smithi067.stdout:8/77: mkdir d6/d19 0 2024-01-17T23:33:37.096 INFO:tasks.workunit.client.0.smithi067.stdout:8/78: write d6/fe [877849,64779] 0 2024-01-17T23:33:37.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/107: creat d5/d6/f24 x:0 0 0 2024-01-17T23:33:37.294 INFO:tasks.workunit.client.0.smithi067.stdout:0/117: getdents d3/d6 0 2024-01-17T23:33:37.306 INFO:tasks.workunit.client.0.smithi067.stdout:0/118: dread d3/d5/f26 [0,4194304] 0 2024-01-17T23:33:37.397 INFO:tasks.workunit.client.0.smithi067.stdout:7/82: mkdir d4/d16 0 2024-01-17T23:33:37.687 INFO:tasks.workunit.client.0.smithi067.stdout:6/83: rename f2 to d6/f1f 0 2024-01-17T23:33:37.687 INFO:tasks.workunit.client.0.smithi067.stdout:8/79: creat d6/f1a x:0 0 0 2024-01-17T23:33:37.813 INFO:tasks.workunit.client.0.smithi067.stdout:2/108: rmdir d5/d1f/d23 0 2024-01-17T23:33:37.813 INFO:tasks.workunit.client.0.smithi067.stdout:2/109: chown d5/d6 10650 1 2024-01-17T23:33:37.813 INFO:tasks.workunit.client.0.smithi067.stdout:2/110: write d5/fa [2472691,114401] 0 2024-01-17T23:33:37.813 INFO:tasks.workunit.client.0.smithi067.stdout:2/111: fdatasync d5/d1f/f14 0 2024-01-17T23:33:37.952 INFO:tasks.workunit.client.0.smithi067.stdout:0/119: symlink d3/d5/d1a/d1c/d1d/d2e/l34 0 2024-01-17T23:33:38.018 INFO:tasks.workunit.client.0.smithi067.stdout:7/83: dwrite d4/f7 [0,4194304] 0 2024-01-17T23:33:38.115 INFO:tasks.workunit.client.0.smithi067.stdout:4/98: rename d3/d5/c17 to d3/c1e 0 2024-01-17T23:33:38.115 INFO:tasks.workunit.client.0.smithi067.stdout:9/75: rename d3/da to d3/da/d1e 22 2024-01-17T23:33:38.247 INFO:tasks.workunit.client.0.smithi067.stdout:6/84: creat d6/f20 x:0 0 0 2024-01-17T23:33:38.336 INFO:tasks.workunit.client.0.smithi067.stdout:8/80: creat d6/db/f1b x:0 0 0 2024-01-17T23:33:38.354 INFO:tasks.workunit.client.0.smithi067.stdout:8/81: dread d6/db/d10/f16 [0,4194304] 0 2024-01-17T23:33:38.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/112: getdents d5/d1f/d16 0 2024-01-17T23:33:38.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/113: write d5/d1f/d16/f20 [711841,72802] 0 2024-01-17T23:33:38.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/114: write d5/d1f/f1e [930166,72843] 0 2024-01-17T23:33:38.610 INFO:tasks.workunit.client.0.smithi067.stdout:0/120: unlink d3/d6/c27 0 2024-01-17T23:33:39.029 INFO:tasks.workunit.client.0.smithi067.stdout:7/84: dread d4/fd [0,4194304] 0 2024-01-17T23:33:39.101 INFO:tasks.workunit.client.0.smithi067.stdout:4/99: creat d3/d8/f1f x:0 0 0 2024-01-17T23:33:39.172 INFO:tasks.workunit.client.0.smithi067.stdout:3/105: symlink d0/l22 0 2024-01-17T23:33:39.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/76: symlink d3/d15/l1f 0 2024-01-17T23:33:39.347 INFO:tasks.workunit.client.0.smithi067.stdout:9/77: dwrite f0 [0,4194304] 0 2024-01-17T23:33:39.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/78: dread d3/f5 [0,4194304] 0 2024-01-17T23:33:39.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/79: chown d3/d6/d10 2041 1 2024-01-17T23:33:39.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/85: unlink d6/d9/fe 0 2024-01-17T23:33:39.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/86: dread d6/fa [0,4194304] 0 2024-01-17T23:33:39.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/87: readlink d6/l19 0 2024-01-17T23:33:39.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/88: truncate d6/f17 1144056 0 2024-01-17T23:33:39.478 INFO:tasks.workunit.client.0.smithi067.stdout:6/89: dwrite d6/d9/f14 [0,4194304] 0 2024-01-17T23:33:39.500 INFO:tasks.workunit.client.0.smithi067.stdout:8/82: symlink d6/l1c 0 2024-01-17T23:33:39.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/85: stat d4/ff 0 2024-01-17T23:33:39.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/86: getdents d4/d16 0 2024-01-17T23:33:40.156 INFO:tasks.workunit.client.0.smithi067.stdout:4/100: mkdir d3/d8/de/d20 0 2024-01-17T23:33:40.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/112: rename d0/c18 to d0/d7/c1a 0 2024-01-17T23:33:40.464 INFO:tasks.workunit.client.0.smithi067.stdout:1/113: dwrite d0/f5 [4194304,4194304] 0 2024-01-17T23:33:40.651 INFO:tasks.workunit.client.0.smithi067.stdout:9/80: link d3/l4 d3/d15/l20 0 2024-01-17T23:33:40.651 INFO:tasks.workunit.client.0.smithi067.stdout:6/90: getdents d6/d9/d1c 0 2024-01-17T23:33:40.660 INFO:tasks.workunit.client.0.smithi067.stdout:6/91: dread d6/fb [0,4194304] 0 2024-01-17T23:33:40.855 INFO:tasks.workunit.client.0.smithi067.stdout:8/83: unlink f5 0 2024-01-17T23:33:40.855 INFO:tasks.workunit.client.0.smithi067.stdout:8/84: readlink d6/l1c 0 2024-01-17T23:33:40.855 INFO:tasks.workunit.client.0.smithi067.stdout:4/101: symlink d3/l21 0 2024-01-17T23:33:40.855 INFO:tasks.workunit.client.0.smithi067.stdout:8/85: stat d6/db/d10/f14 0 2024-01-17T23:33:41.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/80: sync 2024-01-17T23:33:41.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/106: rmdir d0/d12 39 2024-01-17T23:33:41.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/107: chown d0/d17 19 1 2024-01-17T23:33:41.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/108: chown d0/c10 62 1 2024-01-17T23:33:41.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/109: write d0/d12/f20 [833307,17705] 0 2024-01-17T23:33:41.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/110: write d0/d13/f16 [299295,65656] 0 2024-01-17T23:33:41.470 INFO:tasks.workunit.client.0.smithi067.stdout:9/81: mknod d3/d15/c21 0 2024-01-17T23:33:41.488 INFO:tasks.workunit.client.0.smithi067.stdout:9/82: dread d3/f5 [0,4194304] 0 2024-01-17T23:33:41.639 INFO:tasks.workunit.client.0.smithi067.stdout:6/92: unlink d6/d18/l1b 0 2024-01-17T23:33:41.639 INFO:tasks.workunit.client.0.smithi067.stdout:6/93: truncate d6/d18/f1d 811385 0 2024-01-17T23:33:41.639 INFO:tasks.workunit.client.0.smithi067.stdout:6/94: dread - d6/d9/f10 zero size 2024-01-17T23:33:41.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/115: dwrite d5/d6/d8/ff [0,4194304] 0 2024-01-17T23:33:41.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/116: write d5/d6/f24 [731077,103395] 0 2024-01-17T23:33:41.642 INFO:tasks.workunit.client.0.smithi067.stdout:2/117: write d5/d1f/d16/f20 [934552,75285] 0 2024-01-17T23:33:41.676 INFO:tasks.workunit.client.0.smithi067.stdout:2/118: dwrite d5/fa [0,4194304] 0 2024-01-17T23:33:41.691 INFO:tasks.workunit.client.0.smithi067.stdout:2/119: dread d5/d1f/d16/f20 [0,4194304] 0 2024-01-17T23:33:41.944 INFO:tasks.workunit.client.0.smithi067.stdout:0/121: symlink d3/d5/l35 0 2024-01-17T23:33:41.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/86: dread d6/f9 [0,4194304] 0 2024-01-17T23:33:41.978 INFO:tasks.workunit.client.0.smithi067.stdout:0/122: dwrite d3/d5/d1a/f22 [0,4194304] 0 2024-01-17T23:33:42.088 INFO:tasks.workunit.client.0.smithi067.stdout:5/81: unlink fe 0 2024-01-17T23:33:42.089 INFO:tasks.workunit.client.0.smithi067.stdout:5/82: readlink - no filename 2024-01-17T23:33:42.089 INFO:tasks.workunit.client.0.smithi067.stdout:5/83: stat d10/f11 0 2024-01-17T23:33:42.089 INFO:tasks.workunit.client.0.smithi067.stdout:5/84: creat d10/f14 x:0 0 0 2024-01-17T23:33:42.228 INFO:tasks.workunit.client.0.smithi067.stdout:3/111: creat d0/d17/f23 x:0 0 0 2024-01-17T23:33:42.228 INFO:tasks.workunit.client.0.smithi067.stdout:3/112: write d0/f1e [412688,86080] 0 2024-01-17T23:33:42.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/113: write d0/f1e [676212,91138] 0 2024-01-17T23:33:42.269 INFO:tasks.workunit.client.0.smithi067.stdout:3/114: dwrite d0/d12/f21 [0,4194304] 0 2024-01-17T23:33:42.306 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:42.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:33:42.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/83: symlink d3/d6/d10/l22 0 2024-01-17T23:33:42.821 INFO:tasks.workunit.client.0.smithi067.stdout:6/95: creat d6/d9/d1c/d1e/f21 x:0 0 0 2024-01-17T23:33:43.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/87: write f1 [3006449,130563] 0 2024-01-17T23:33:43.187 INFO:tasks.workunit.client.0.smithi067.stdout:4/102: rmdir d3/d8/de 39 2024-01-17T23:33:43.187 INFO:tasks.workunit.client.0.smithi067.stdout:8/87: symlink d6/d19/l1d 0 2024-01-17T23:33:43.392 INFO:tasks.workunit.client.0.smithi067.stdout:0/123: creat d3/d5/f36 x:0 0 0 2024-01-17T23:33:43.425 INFO:tasks.workunit.client.0.smithi067.stdout:0/124: dwrite d3/f1b [4194304,4194304] 0 2024-01-17T23:33:43.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/85: symlink d10/l15 0 2024-01-17T23:33:43.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/86: creat d10/f16 x:0 0 0 2024-01-17T23:33:43.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/87: write fd [3192375,5364] 0 2024-01-17T23:33:43.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/88: write d10/f14 [694377,85437] 0 2024-01-17T23:33:43.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/89: chown fc 26 1 2024-01-17T23:33:43.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/120: mkdir d5/d6/d25 0 2024-01-17T23:33:43.891 INFO:tasks.workunit.client.0.smithi067.stdout:3/115: link d0/d13/l15 d0/l24 0 2024-01-17T23:33:44.135 INFO:tasks.workunit.client.0.smithi067.stdout:1/114: rename d0/c10 to d0/c1b 0 2024-01-17T23:33:44.444 INFO:tasks.workunit.client.0.smithi067.stdout:6/96: unlink d6/f20 0 2024-01-17T23:33:44.444 INFO:tasks.workunit.client.0.smithi067.stdout:9/84: creat d3/d6/d11/f23 x:0 0 0 2024-01-17T23:33:44.444 INFO:tasks.workunit.client.0.smithi067.stdout:9/85: write d3/fd [824684,104370] 0 2024-01-17T23:33:45.359 INFO:tasks.workunit.client.0.smithi067.stdout:4/103: symlink d3/d8/l22 0 2024-01-17T23:33:45.396 INFO:tasks.workunit.client.0.smithi067.stdout:4/104: dwrite d3/f7 [0,4194304] 0 2024-01-17T23:33:45.401 INFO:tasks.workunit.client.0.smithi067.stdout:8/88: symlink d6/db/l1e 0 2024-01-17T23:33:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:4/105: dwrite d3/f7 [4194304,4194304] 0 2024-01-17T23:33:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:4/106: fsync d3/f7 0 2024-01-17T23:33:45.994 INFO:tasks.workunit.client.0.smithi067.stdout:3/116: creat d0/d13/d1a/f25 x:0 0 0 2024-01-17T23:33:45.994 INFO:tasks.workunit.client.0.smithi067.stdout:3/117: chown d0/d12/f20 3603621 1 2024-01-17T23:33:46.930 INFO:tasks.workunit.client.0.smithi067.stdout:6/97: symlink d6/d9/l22 0 2024-01-17T23:33:46.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/98: dwrite d6/f17 [0,4194304] 0 2024-01-17T23:33:46.984 INFO:tasks.workunit.client.0.smithi067.stdout:4/107: mknod d3/d8/de/c23 0 2024-01-17T23:33:46.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/118: creat d0/d12/d1b/f26 x:0 0 0 2024-01-17T23:33:46.994 INFO:tasks.workunit.client.0.smithi067.stdout:6/99: dwrite d6/fd [0,4194304] 0 2024-01-17T23:33:47.024 INFO:tasks.workunit.client.0.smithi067.stdout:7/88: sync 2024-01-17T23:33:47.717 INFO:tasks.workunit.client.0.smithi067.stdout:4/108: creat d3/d5/f24 x:0 0 0 2024-01-17T23:33:47.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/119: mkdir d0/d17/d27 0 2024-01-17T23:33:47.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/120: dread - d0/d12/d1b/f1d zero size 2024-01-17T23:33:47.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/121: dread - d0/d17/f23 zero size 2024-01-17T23:33:47.718 INFO:tasks.workunit.client.0.smithi067.stdout:6/100: link d6/ff d6/d9/d1c/f23 0 2024-01-17T23:33:47.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/89: fdatasync d4/de/f14 0 2024-01-17T23:33:47.718 INFO:tasks.workunit.client.0.smithi067.stdout:6/101: read d6/f1f [2039062,23038] 0 2024-01-17T23:33:47.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/122: read d0/d12/f20 [383015,65524] 0 2024-01-17T23:33:47.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/123: getdents d0/d17/d27 0 2024-01-17T23:33:47.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/124: write d0/d13/f19 [854726,29472] 0 2024-01-17T23:33:47.746 INFO:tasks.workunit.client.0.smithi067.stdout:6/102: dwrite d6/f13 [0,4194304] 0 2024-01-17T23:33:47.787 INFO:tasks.workunit.client.0.smithi067.stdout:6/103: dwrite d6/fa [0,4194304] 0 2024-01-17T23:33:47.922 INFO:tasks.workunit.client.0.smithi067.stdout:2/121: rename d5/d1f/d16/c21 to d5/c26 0 2024-01-17T23:33:47.922 INFO:tasks.workunit.client.0.smithi067.stdout:2/122: write d5/d6/f1a [4509620,77238] 0 2024-01-17T23:33:48.011 INFO:tasks.workunit.client.0.smithi067.stdout:0/125: rmdir d3/d6 39 2024-01-17T23:33:48.140 INFO:tasks.workunit.client.0.smithi067.stdout:7/90: chown d4/fb 1010 1 2024-01-17T23:33:48.397 INFO:tasks.workunit.client.0.smithi067.stdout:9/86: write d3/d6/fe [373230,42698] 0 2024-01-17T23:33:48.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/104: creat d6/d9/d1c/f24 x:0 0 0 2024-01-17T23:33:48.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/105: creat d6/d18/f25 x:0 0 0 2024-01-17T23:33:48.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/106: creat d6/d9/d1c/f26 x:0 0 0 2024-01-17T23:33:48.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/123: symlink d5/d6/d8/l27 0 2024-01-17T23:33:49.025 INFO:tasks.workunit.client.0.smithi067.stdout:0/126: creat d3/d5/d32/f37 x:0 0 0 2024-01-17T23:33:49.025 INFO:tasks.workunit.client.0.smithi067.stdout:0/127: chown d3/d6/l15 0 1 2024-01-17T23:33:49.060 INFO:tasks.workunit.client.0.smithi067.stdout:0/128: dwrite d3/d5/d1a/d1c/d1d/d2e/f33 [0,4194304] 0 2024-01-17T23:33:49.105 INFO:tasks.workunit.client.0.smithi067.stdout:5/90: rmdir d10 39 2024-01-17T23:33:49.106 INFO:tasks.workunit.client.0.smithi067.stdout:1/115: sync 2024-01-17T23:33:49.106 INFO:tasks.workunit.client.0.smithi067.stdout:8/89: sync 2024-01-17T23:33:49.139 INFO:tasks.workunit.client.0.smithi067.stdout:5/91: dwrite fc [0,4194304] 0 2024-01-17T23:33:49.352 INFO:tasks.workunit.client.0.smithi067.stdout:7/91: dread d4/fa [0,4194304] 0 2024-01-17T23:33:49.447 INFO:tasks.workunit.client.0.smithi067.stdout:3/125: rmdir d0/d12/d1b 39 2024-01-17T23:33:49.447 INFO:tasks.workunit.client.0.smithi067.stdout:3/126: creat d0/d17/f28 x:0 0 0 2024-01-17T23:33:49.491 INFO:tasks.workunit.client.0.smithi067.stdout:9/87: symlink d3/d6/d10/l24 0 2024-01-17T23:33:49.648 INFO:tasks.workunit.client.0.smithi067.stdout:6/107: rename d6/d9/d1c/f24 to d6/d9/f27 0 2024-01-17T23:33:49.649 INFO:tasks.workunit.client.0.smithi067.stdout:6/108: creat d6/d18/f28 x:0 0 0 2024-01-17T23:33:49.680 INFO:tasks.workunit.client.0.smithi067.stdout:6/109: dwrite d6/f1f [0,4194304] 0 2024-01-17T23:33:49.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/110: dwrite d6/d9/d1c/f26 [0,4194304] 0 2024-01-17T23:33:49.888 INFO:tasks.workunit.client.0.smithi067.stdout:4/109: sync 2024-01-17T23:33:49.889 INFO:tasks.workunit.client.0.smithi067.stdout:4/110: readlink d3/l19 0 2024-01-17T23:33:49.899 INFO:tasks.workunit.client.0.smithi067.stdout:4/111: dread d3/d5/fc [0,4194304] 0 2024-01-17T23:33:50.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/129: truncate d3/f4 3398694 0 2024-01-17T23:33:50.265 INFO:tasks.workunit.client.0.smithi067.stdout:0/130: write d3/f11 [3556371,47494] 0 2024-01-17T23:33:50.410 INFO:tasks.workunit.client.0.smithi067.stdout:1/116: getdents d0 0 2024-01-17T23:33:50.434 INFO:tasks.workunit.client.0.smithi067.stdout:1/117: write d0/f5 [8168148,30239] 0 2024-01-17T23:33:50.795 INFO:tasks.workunit.client.0.smithi067.stdout:5/92: link c6 d10/c17 0 2024-01-17T23:33:51.092 INFO:tasks.workunit.client.0.smithi067.stdout:2/124: sync 2024-01-17T23:33:51.129 INFO:tasks.workunit.client.0.smithi067.stdout:2/125: dwrite f4 [0,4194304] 0 2024-01-17T23:33:51.129 INFO:tasks.workunit.client.0.smithi067.stdout:2/126: fsync d5/d6/f1a 0 2024-01-17T23:33:51.326 INFO:tasks.workunit.client.0.smithi067.stdout:7/92: unlink d4/f7 0 2024-01-17T23:33:51.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/111: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:33:51.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/112: truncate d6/d9/f10 920548 0 2024-01-17T23:33:51.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/113: write d6/ff [82312,57677] 0 2024-01-17T23:33:51.901 INFO:tasks.workunit.client.0.smithi067.stdout:6/114: dread d6/fd [0,4194304] 0 2024-01-17T23:33:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:4/112: stat d3/d8/c1a 0 2024-01-17T23:33:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:4/113: write d3/d5/fc [4481886,55011] 0 2024-01-17T23:33:52.198 INFO:tasks.workunit.client.0.smithi067.stdout:8/90: rename d6/db/l1e to d6/db/l1f 0 2024-01-17T23:33:52.198 INFO:tasks.workunit.client.0.smithi067.stdout:8/91: fsync d6/f9 0 2024-01-17T23:33:52.198 INFO:tasks.workunit.client.0.smithi067.stdout:8/92: chown d6/db/d10/f16 231272 1 2024-01-17T23:33:52.395 INFO:tasks.workunit.client.0.smithi067.stdout:0/131: creat d3/d5/f38 x:0 0 0 2024-01-17T23:33:52.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/118: mkdir d0/d7/d1c 0 2024-01-17T23:33:52.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/93: mknod d10/c18 0 2024-01-17T23:33:52.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/94: truncate ff 281193 0 2024-01-17T23:33:52.759 INFO:tasks.workunit.client.0.smithi067.stdout:5/95: dwrite d10/f13 [0,4194304] 0 2024-01-17T23:33:52.788 INFO:tasks.workunit.client.0.smithi067.stdout:5/96: dwrite fd [0,4194304] 0 2024-01-17T23:33:52.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/127: stat d5/c26 0 2024-01-17T23:33:52.869 INFO:tasks.workunit.client.0.smithi067.stdout:2/128: dread d5/d1f/f1e [0,4194304] 0 2024-01-17T23:33:52.979 INFO:tasks.workunit.client.0.smithi067.stdout:7/93: dwrite d4/f6 [0,4194304] 0 2024-01-17T23:33:52.979 INFO:tasks.workunit.client.0.smithi067.stdout:7/94: stat d4/ff 0 2024-01-17T23:33:53.224 INFO:tasks.workunit.client.0.smithi067.stdout:6/115: mknod d6/d9/c29 0 2024-01-17T23:33:53.224 INFO:tasks.workunit.client.0.smithi067.stdout:6/116: creat d6/d18/f2a x:0 0 0 2024-01-17T23:33:53.280 INFO:tasks.workunit.client.0.smithi067.stdout:3/127: sync 2024-01-17T23:33:53.281 INFO:tasks.workunit.client.0.smithi067.stdout:9/88: sync 2024-01-17T23:33:53.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/128: write d0/d12/f21 [2628792,130004] 0 2024-01-17T23:33:53.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/129: creat d0/d17/f29 x:0 0 0 2024-01-17T23:33:53.310 INFO:tasks.workunit.client.0.smithi067.stdout:9/89: read f0 [3862769,112832] 0 2024-01-17T23:33:53.373 INFO:tasks.workunit.client.0.smithi067.stdout:4/114: rename d3/d8/l16 to d3/d8/l25 0 2024-01-17T23:33:53.373 INFO:tasks.workunit.client.0.smithi067.stdout:4/115: dread - d3/d8/f1f zero size 2024-01-17T23:33:53.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/116: dwrite d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:33:53.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/117: fsync d3/d5/f24 0 2024-01-17T23:33:53.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/118: write d3/f7 [9196549,10617] 0 2024-01-17T23:33:53.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/119: chown d3/d8/de 923188266 1 2024-01-17T23:33:53.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/120: dread d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:33:53.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/121: write d3/d5/f24 [347011,104682] 0 2024-01-17T23:33:53.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/132: symlink d3/d5/d1a/d1c/d1d/l39 0 2024-01-17T23:33:53.702 INFO:tasks.workunit.client.0.smithi067.stdout:0/133: dread d3/d5/f26 [0,4194304] 0 2024-01-17T23:33:53.867 INFO:tasks.workunit.client.0.smithi067.stdout:1/119: link d0/d7/d13/l17 d0/d7/d13/l1d 0 2024-01-17T23:33:53.882 INFO:tasks.workunit.client.0.smithi067.stdout:1/120: write d0/f5 [588150,102435] 0 2024-01-17T23:33:53.882 INFO:tasks.workunit.client.0.smithi067.stdout:1/121: write d0/f5 [3676632,126711] 0 2024-01-17T23:33:53.882 INFO:tasks.workunit.client.0.smithi067.stdout:1/122: chown d0/d7/d1c 3782773 1 2024-01-17T23:33:54.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/97: rename f7 to d10/f19 0 2024-01-17T23:33:54.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/129: symlink d5/d1f/l28 0 2024-01-17T23:33:54.457 INFO:tasks.workunit.client.0.smithi067.stdout:7/95: readlink d4/l13 0 2024-01-17T23:33:54.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/96: dread d4/f6 [0,4194304] 0 2024-01-17T23:33:54.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/117: unlink d6/f13 0 2024-01-17T23:33:54.860 INFO:tasks.workunit.client.0.smithi067.stdout:8/93: dwrite d6/db/d10/f16 [0,4194304] 0 2024-01-17T23:33:54.860 INFO:tasks.workunit.client.0.smithi067.stdout:8/94: fdatasync d6/db/d10/f16 0 2024-01-17T23:33:54.860 INFO:tasks.workunit.client.0.smithi067.stdout:8/95: write d6/f9 [4756199,69648] 0 2024-01-17T23:33:54.961 INFO:tasks.workunit.client.0.smithi067.stdout:3/130: link d0/f14 d0/f2a 0 2024-01-17T23:33:55.100 INFO:tasks.workunit.client.0.smithi067.stdout:9/90: mkdir d3/d25 0 2024-01-17T23:33:55.581 INFO:tasks.workunit.client.0.smithi067.stdout:4/122: unlink d3/l1c 0 2024-01-17T23:33:55.581 INFO:tasks.workunit.client.0.smithi067.stdout:0/134: symlink d3/d5/d1a/l3a 0 2024-01-17T23:33:55.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/123: write d3/d8/de/f14 [1025830,43819] 0 2024-01-17T23:33:55.625 INFO:tasks.workunit.client.0.smithi067.stdout:4/124: dwrite f1 [0,4194304] 0 2024-01-17T23:33:55.647 INFO:tasks.workunit.client.0.smithi067.stdout:4/125: dwrite d3/f7 [0,4194304] 0 2024-01-17T23:33:55.648 INFO:tasks.workunit.client.0.smithi067.stdout:4/126: chown d3/l19 1612858 1 2024-01-17T23:33:55.648 INFO:tasks.workunit.client.0.smithi067.stdout:4/127: chown f1 865101 1 2024-01-17T23:33:55.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/98: creat d10/f1a x:0 0 0 2024-01-17T23:33:55.944 INFO:tasks.workunit.client.0.smithi067.stdout:2/130: unlink d5/d1f/f14 0 2024-01-17T23:33:56.192 INFO:tasks.workunit.client.0.smithi067.stdout:7/97: creat d4/de/f17 x:0 0 0 2024-01-17T23:33:57.265 INFO:tasks.workunit.client.0.smithi067.stdout:3/131: symlink d0/l2b 0 2024-01-17T23:33:57.265 INFO:tasks.workunit.client.0.smithi067.stdout:8/96: creat d6/db/f20 x:0 0 0 2024-01-17T23:33:57.294 INFO:tasks.workunit.client.0.smithi067.stdout:3/132: dwrite d0/f1e [0,4194304] 0 2024-01-17T23:33:57.294 INFO:tasks.workunit.client.0.smithi067.stdout:3/133: dread - d0/d12/d1b/f26 zero size 2024-01-17T23:33:57.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/134: creat d0/d13/f2c x:0 0 0 2024-01-17T23:33:57.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/135: write d0/d12/f20 [877396,6879] 0 2024-01-17T23:33:57.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/136: dread - d0/d12/f1c zero size 2024-01-17T23:33:57.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/137: dwrite d0/d17/f28 [0,4194304] 0 2024-01-17T23:33:57.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/138: dwrite d0/d12/d1b/f26 [0,4194304] 0 2024-01-17T23:33:57.612 INFO:tasks.workunit.client.0.smithi067.stdout:0/135: truncate d3/d5/d1a/d1c/d1d/d2e/f33 1023852 0 2024-01-17T23:33:57.612 INFO:tasks.workunit.client.0.smithi067.stdout:4/128: mkdir d3/d26 0 2024-01-17T23:33:57.794 INFO:tasks.workunit.client.0.smithi067.stdout:5/99: truncate fa 1265343 0 2024-01-17T23:33:58.065 INFO:tasks.workunit.client.0.smithi067.stdout:2/131: mknod d5/c29 0 2024-01-17T23:33:58.065 INFO:tasks.workunit.client.0.smithi067.stdout:7/98: rmdir d4/de/d15 0 2024-01-17T23:33:58.065 INFO:tasks.workunit.client.0.smithi067.stdout:2/132: truncate d5/d6/f24 1450332 0 2024-01-17T23:33:58.086 INFO:tasks.workunit.client.0.smithi067.stdout:2/133: dwrite d5/d1f/f1e [0,4194304] 0 2024-01-17T23:33:58.117 INFO:tasks.workunit.client.0.smithi067.stdout:2/134: dwrite d5/fa [0,4194304] 0 2024-01-17T23:33:58.118 INFO:tasks.workunit.client.0.smithi067.stdout:2/135: fdatasync d5/fa 0 2024-01-17T23:33:58.134 INFO:tasks.workunit.client.0.smithi067.stdout:2/136: dread d5/fa [0,4194304] 0 2024-01-17T23:33:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:6/118: getdents d6/d9/d1c/d1e 0 2024-01-17T23:33:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:6/119: write d6/d9/d1c/f23 [750768,106700] 0 2024-01-17T23:33:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:6/120: chown d6/f1f 158065049 1 2024-01-17T23:33:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:6/121: write d6/d9/d1c/f26 [4211172,13593] 0 2024-01-17T23:33:58.293 INFO:tasks.workunit.client.0.smithi067.stdout:8/97: symlink d6/db/l21 0 2024-01-17T23:33:58.541 INFO:tasks.workunit.client.0.smithi067.stdout:1/123: truncate d0/f5 4054429 0 2024-01-17T23:33:59.116 INFO:tasks.workunit.client.0.smithi067.stdout:3/139: creat d0/d12/d1b/f2d x:0 0 0 2024-01-17T23:33:59.116 INFO:tasks.workunit.client.0.smithi067.stdout:3/140: creat d0/d13/d1a/f2e x:0 0 0 2024-01-17T23:33:59.142 INFO:tasks.workunit.client.0.smithi067.stdout:3/141: dwrite d0/d12/d1b/f1d [0,4194304] 0 2024-01-17T23:33:59.143 INFO:tasks.workunit.client.0.smithi067.stdout:3/142: creat d0/d13/f2f x:0 0 0 2024-01-17T23:33:59.143 INFO:tasks.workunit.client.0.smithi067.stdout:3/143: truncate d0/d13/f2c 96340 0 2024-01-17T23:33:59.177 INFO:tasks.workunit.client.0.smithi067.stdout:3/144: dwrite d0/d12/f21 [0,4194304] 0 2024-01-17T23:33:59.225 INFO:tasks.workunit.client.0.smithi067.stdout:4/129: rmdir d3/d8/de 39 2024-01-17T23:33:59.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/136: rename d3/f2d to d3/d6/dd/f3b 0 2024-01-17T23:33:59.235 INFO:tasks.workunit.client.0.smithi067.stdout:4/130: dread d3/d5/fc [0,4194304] 0 2024-01-17T23:33:59.432 INFO:tasks.workunit.client.0.smithi067.stdout:5/100: mkdir d10/d1b 0 2024-01-17T23:33:59.464 INFO:tasks.workunit.client.0.smithi067.stdout:5/101: dwrite d10/f1a [0,4194304] 0 2024-01-17T23:33:59.808 INFO:tasks.workunit.client.0.smithi067.stdout:2/137: mkdir d5/d1f/d2a 0 2024-01-17T23:33:59.821 INFO:tasks.workunit.client.0.smithi067.stdout:2/138: dread f4 [0,4194304] 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/122: truncate d6/fb 15523 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/123: chown d6/f8 2 1 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/124: fdatasync d6/f1f 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/98: mkdir d6/d19/d22 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/125: readlink d6/l19 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/99: write d6/db/d10/f16 [4869287,101848] 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/100: chown d6/d19 5578 1 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/101: dread - d6/db/f1b zero size 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/102: write d6/db/d10/f14 [834608,49739] 0 2024-01-17T23:34:00.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/103: dread - d6/db/f1b zero size 2024-01-17T23:34:00.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/126: fsync d6/d9/d1c/f26 0 2024-01-17T23:34:00.038 INFO:tasks.workunit.client.0.smithi067.stdout:6/127: write d6/d9/d1c/f26 [1258009,11540] 0 2024-01-17T23:34:00.070 INFO:tasks.workunit.client.0.smithi067.stdout:6/128: dwrite d6/d18/f2a [0,4194304] 0 2024-01-17T23:34:00.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/124: stat d0/c19 0 2024-01-17T23:34:00.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/125: rename d0/d7/d13 to d0/d7/d13/d1e 22 2024-01-17T23:34:00.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/145: symlink d0/l30 0 2024-01-17T23:34:00.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/146: chown d0/d12/f20 4115 1 2024-01-17T23:34:00.823 INFO:tasks.workunit.client.0.smithi067.stdout:4/131: unlink f1 0 2024-01-17T23:34:00.823 INFO:tasks.workunit.client.0.smithi067.stdout:4/132: read d3/d8/de/f14 [1893855,19594] 0 2024-01-17T23:34:00.824 INFO:tasks.workunit.client.0.smithi067.stdout:4/133: stat d3 0 2024-01-17T23:34:00.824 INFO:tasks.workunit.client.0.smithi067.stdout:4/134: truncate d3/d8/f1f 945931 0 2024-01-17T23:34:01.136 INFO:tasks.workunit.client.0.smithi067.stdout:1/126: write d0/f5 [811100,75626] 0 2024-01-17T23:34:01.139 INFO:tasks.workunit.client.0.smithi067.stdout:9/91: sync 2024-01-17T23:34:01.429 INFO:tasks.workunit.client.0.smithi067.stdout:7/99: link d4/fb d4/f18 0 2024-01-17T23:34:01.429 INFO:tasks.workunit.client.0.smithi067.stdout:7/100: write d4/ff [410823,129547] 0 2024-01-17T23:34:01.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/101: write d4/fb [3254098,28873] 0 2024-01-17T23:34:01.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/102: dread - d4/de/f14 zero size 2024-01-17T23:34:01.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/103: getdents d4/d16 0 2024-01-17T23:34:01.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/104: write d4/ff [414980,20317] 0 2024-01-17T23:34:01.453 INFO:tasks.workunit.client.0.smithi067.stdout:7/105: fdatasync d4/fb 0 2024-01-17T23:34:01.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/106: dwrite d4/ff [0,4194304] 0 2024-01-17T23:34:01.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/139: mknod d5/d6/c2b 0 2024-01-17T23:34:01.765 INFO:tasks.workunit.client.0.smithi067.stdout:8/104: creat d6/db/d18/f23 x:0 0 0 2024-01-17T23:34:03.116 INFO:tasks.workunit.client.0.smithi067.stdout:3/147: symlink d0/d17/d27/l31 0 2024-01-17T23:34:03.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/137: getdents d3/d5/d1a/d1c/d1d 0 2024-01-17T23:34:03.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/138: truncate d3/d5/f38 983539 0 2024-01-17T23:34:03.261 INFO:tasks.workunit.client.0.smithi067.stdout:4/135: symlink d3/d26/l27 0 2024-01-17T23:34:03.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/136: dwrite d3/d8/de/f14 [4194304,4194304] 0 2024-01-17T23:34:03.575 INFO:tasks.workunit.client.0.smithi067.stdout:9/92: rename d3/fd to d3/f26 0 2024-01-17T23:34:03.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/102: truncate d10/f19 1616026 0 2024-01-17T23:34:03.978 INFO:tasks.workunit.client.0.smithi067.stdout:1/127: symlink d0/l1f 0 2024-01-17T23:34:04.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/107: dread d4/f10 [0,4194304] 0 2024-01-17T23:34:04.241 INFO:tasks.workunit.client.0.smithi067.stdout:2/140: symlink d5/d6/l2c 0 2024-01-17T23:34:04.856 INFO:tasks.workunit.client.0.smithi067.stdout:0/139: symlink d3/d5/d32/l3c 0 2024-01-17T23:34:04.857 INFO:tasks.workunit.client.0.smithi067.stdout:0/140: dread - d3/d6/f17 zero size 2024-01-17T23:34:04.857 INFO:tasks.workunit.client.0.smithi067.stdout:0/141: read - d3/d5/f36 zero size 2024-01-17T23:34:04.884 INFO:tasks.workunit.client.0.smithi067.stdout:0/142: dwrite d3/d5/d32/f37 [0,4194304] 0 2024-01-17T23:34:05.365 INFO:tasks.workunit.client.0.smithi067.stdout:9/93: getdents d3/d6 0 2024-01-17T23:34:05.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/94: dread d3/d6/d11/f1b [0,4194304] 0 2024-01-17T23:34:05.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/95: chown d3/da/c1c 33648 1 2024-01-17T23:34:05.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/96: dwrite d3/d6/d11/f1b [0,4194304] 0 2024-01-17T23:34:05.442 INFO:tasks.workunit.client.0.smithi067.stdout:9/97: dwrite d3/d6/d10/f1d [0,4194304] 0 2024-01-17T23:34:05.447 INFO:tasks.workunit.client.0.smithi067.stdout:9/98: dread d3/d6/f9 [0,4194304] 0 2024-01-17T23:34:05.513 INFO:tasks.workunit.client.0.smithi067.stdout:5/103: rmdir d10/d1b 0 2024-01-17T23:34:05.547 INFO:tasks.workunit.client.0.smithi067.stdout:5/104: dwrite d10/f1a [4194304,4194304] 0 2024-01-17T23:34:05.578 INFO:tasks.workunit.client.0.smithi067.stdout:5/105: dwrite d10/f12 [0,4194304] 0 2024-01-17T23:34:05.630 INFO:tasks.workunit.client.0.smithi067.stdout:1/128: rmdir d0/d7 39 2024-01-17T23:34:05.715 INFO:tasks.workunit.client.0.smithi067.stdout:2/141: unlink d5/d6/l2c 0 2024-01-17T23:34:05.727 INFO:tasks.workunit.client.0.smithi067.stdout:2/142: dread d5/d1f/f1e [0,4194304] 0 2024-01-17T23:34:06.139 INFO:tasks.workunit.client.0.smithi067.stdout:0/143: link d3/d5/f38 d3/d5/d1a/d1c/d1d/d2e/f3d 0 2024-01-17T23:34:06.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/144: write d3/d5/d1a/f22 [3958990,18847] 0 2024-01-17T23:34:06.230 INFO:tasks.workunit.client.0.smithi067.stdout:6/129: sync 2024-01-17T23:34:06.257 INFO:tasks.workunit.client.0.smithi067.stdout:6/130: dwrite d6/fa [4194304,4194304] 0 2024-01-17T23:34:06.920 INFO:tasks.workunit.client.0.smithi067.stdout:8/105: mknod d6/c24 0 2024-01-17T23:34:06.963 INFO:tasks.workunit.client.0.smithi067.stdout:8/106: dwrite d6/f1a [0,4194304] 0 2024-01-17T23:34:06.999 INFO:tasks.workunit.client.0.smithi067.stdout:8/107: dwrite d6/f1a [0,4194304] 0 2024-01-17T23:34:07.140 INFO:tasks.workunit.client.0.smithi067.stdout:1/129: creat d0/d7/f20 x:0 0 0 2024-01-17T23:34:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:0/145: dwrite d3/d5/f38 [0,4194304] 0 2024-01-17T23:34:07.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/131: creat d6/f2b x:0 0 0 2024-01-17T23:34:07.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/132: chown d6/d18/f25 0 1 2024-01-17T23:34:07.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/99: getdents d3/d6/d11 0 2024-01-17T23:34:07.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/133: creat d6/f2c x:0 0 0 2024-01-17T23:34:08.077 INFO:tasks.workunit.client.0.smithi067.stdout:8/108: mkdir d6/d19/d22/d25 0 2024-01-17T23:34:08.170 INFO:tasks.workunit.client.0.smithi067.stdout:1/130: mknod d0/d7/d1c/c21 0 2024-01-17T23:34:08.407 INFO:tasks.workunit.client.0.smithi067.stdout:0/146: creat d3/d5/d1a/d1c/f3e x:0 0 0 2024-01-17T23:34:08.532 INFO:tasks.workunit.client.0.smithi067.stdout:5/106: rename ff to d10/f1c 0 2024-01-17T23:34:08.560 INFO:tasks.workunit.client.0.smithi067.stdout:5/107: dwrite d10/f16 [0,4194304] 0 2024-01-17T23:34:08.601 INFO:tasks.workunit.client.0.smithi067.stdout:5/108: dwrite d10/f16 [0,4194304] 0 2024-01-17T23:34:08.759 INFO:tasks.workunit.client.0.smithi067.stdout:9/100: mknod d3/d6/d11/c27 0 2024-01-17T23:34:08.765 INFO:tasks.workunit.client.0.smithi067.stdout:9/101: dread d3/f26 [0,4194304] 0 2024-01-17T23:34:08.765 INFO:tasks.workunit.client.0.smithi067.stdout:9/102: fsync d3/d6/d10/f1d 0 2024-01-17T23:34:09.040 INFO:tasks.workunit.client.0.smithi067.stdout:4/137: truncate d3/d8/de/f14 83461 0 2024-01-17T23:34:09.121 INFO:tasks.workunit.client.0.smithi067.stdout:8/109: mkdir d6/d26 0 2024-01-17T23:34:09.142 INFO:tasks.workunit.client.0.smithi067.stdout:8/110: dread d6/fe [0,4194304] 0 2024-01-17T23:34:09.330 INFO:tasks.workunit.client.0.smithi067.stdout:0/147: link d3/d5/d1a/d1c/f3e d3/d5/d1a/f3f 0 2024-01-17T23:34:09.511 INFO:tasks.workunit.client.0.smithi067.stdout:2/143: rename d5/c26 to d5/d6/c2d 0 2024-01-17T23:34:10.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/148: sync 2024-01-17T23:34:10.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/149: chown d0/fd 785675 1 2024-01-17T23:34:10.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/144: creat d5/d6/d25/f2e x:0 0 0 2024-01-17T23:34:11.005 INFO:tasks.workunit.client.0.smithi067.stdout:3/150: symlink d0/d13/l32 0 2024-01-17T23:34:11.005 INFO:tasks.workunit.client.0.smithi067.stdout:3/151: creat d0/d13/f33 x:0 0 0 2024-01-17T23:34:11.031 INFO:tasks.workunit.client.0.smithi067.stdout:3/152: dwrite d0/d12/d1b/f26 [0,4194304] 0 2024-01-17T23:34:11.164 INFO:tasks.workunit.client.0.smithi067.stdout:2/145: truncate d5/d6/f1a 3799993 0 2024-01-17T23:34:11.598 INFO:tasks.workunit.client.0.smithi067.stdout:2/146: unlink d5/d6/d25/f2e 0 2024-01-17T23:34:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:1/131: sync 2024-01-17T23:34:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/108: sync 2024-01-17T23:34:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/134: sync 2024-01-17T23:34:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/109: fsync d4/fd 0 2024-01-17T23:34:12.022 INFO:tasks.workunit.client.0.smithi067.stdout:4/138: link d3/d8/cb d3/d8/c28 0 2024-01-17T23:34:12.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/109: write d10/f19 [1857869,107330] 0 2024-01-17T23:34:12.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/110: chown fa 15 1 2024-01-17T23:34:12.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/111: dread d10/f14 [0,4194304] 0 2024-01-17T23:34:12.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/112: chown d10/c18 22880 1 2024-01-17T23:34:12.041 INFO:tasks.workunit.client.0.smithi067.stdout:9/103: sync 2024-01-17T23:34:12.256 INFO:tasks.workunit.client.0.smithi067.stdout:3/153: mkdir d0/d34 0 2024-01-17T23:34:12.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/154: dwrite d0/d17/f29 [0,4194304] 0 2024-01-17T23:34:12.361 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:12.364 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:12.463 INFO:tasks.workunit.client.0.smithi067.stdout:6/135: unlink d6/d9/d1c/f26 0 2024-01-17T23:34:12.568 INFO:tasks.workunit.client.0.smithi067.stdout:8/111: link d6/fe d6/db/f27 0 2024-01-17T23:34:12.643 INFO:tasks.workunit.client.0.smithi067.stdout:1/132: creat d0/d7/d1c/f22 x:0 0 0 2024-01-17T23:34:12.643 INFO:tasks.workunit.client.0.smithi067.stdout:1/133: creat d0/d7/d1c/f23 x:0 0 0 2024-01-17T23:34:12.712 INFO:tasks.workunit.client.0.smithi067.stdout:7/110: creat d4/f19 x:0 0 0 2024-01-17T23:34:12.746 INFO:tasks.workunit.client.0.smithi067.stdout:7/111: dwrite d4/fd [0,4194304] 0 2024-01-17T23:34:12.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/148: dwrite d3/d6/dd/f3b [4194304,4194304] 0 2024-01-17T23:34:12.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/149: dread - d3/d6/f2f zero size 2024-01-17T23:34:12.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/150: chown d3/d5/f9 49798 1 2024-01-17T23:34:12.792 INFO:tasks.workunit.client.0.smithi067.stdout:4/139: mknod d3/d8/de/d20/c29 0 2024-01-17T23:34:13.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/104: stat d3/l4 0 2024-01-17T23:34:13.424 INFO:tasks.workunit.client.0.smithi067.stdout:6/136: unlink d6/d9/d1c/d1e/f21 0 2024-01-17T23:34:13.657 INFO:tasks.workunit.client.0.smithi067.stdout:8/112: link d6/db/f1b d6/db/d18/f28 0 2024-01-17T23:34:13.657 INFO:tasks.workunit.client.0.smithi067.stdout:8/113: stat d6/cd 0 2024-01-17T23:34:13.952 INFO:tasks.workunit.client.0.smithi067.stdout:1/134: unlink d0/d7/c12 0 2024-01-17T23:34:14.239 INFO:tasks.workunit.client.0.smithi067.stdout:7/112: mknod d4/de/c1a 0 2024-01-17T23:34:14.258 INFO:tasks.workunit.client.0.smithi067.stdout:7/113: dread d4/ff [0,4194304] 0 2024-01-17T23:34:14.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/114: dread d4/fb [0,4194304] 0 2024-01-17T23:34:14.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/151: symlink d3/d5/d1a/l40 0 2024-01-17T23:34:14.870 INFO:tasks.workunit.client.0.smithi067.stdout:5/113: getdents d10 0 2024-01-17T23:34:15.193 INFO:tasks.workunit.client.0.smithi067.stdout:9/105: mkdir d3/d25/d28 0 2024-01-17T23:34:15.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/155: rmdir d0/d13/d1a 39 2024-01-17T23:34:15.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/156: chown d0/d13/f16 17 1 2024-01-17T23:34:15.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/137: rename d6/d9/d1c/f23 to d6/d9/f2d 0 2024-01-17T23:34:15.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/138: dread - d6/f2b zero size 2024-01-17T23:34:15.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/139: chown d6 11968 1 2024-01-17T23:34:15.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/114: symlink d6/db/l29 0 2024-01-17T23:34:15.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/135: mknod d0/d7/d1c/c24 0 2024-01-17T23:34:15.738 INFO:tasks.workunit.client.0.smithi067.stdout:8/115: readlink d6/db/l29 0 2024-01-17T23:34:15.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/136: dread - d0/d7/f20 zero size 2024-01-17T23:34:15.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/137: dread - d0/d7/d1c/f22 zero size 2024-01-17T23:34:15.868 INFO:tasks.workunit.client.0.smithi067.stdout:7/115: unlink d4/ff 0 2024-01-17T23:34:16.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/152: link d3/d5/f26 d3/d5/d32/f41 0 2024-01-17T23:34:16.292 INFO:tasks.workunit.client.0.smithi067.stdout:9/106: write d3/d6/d11/f23 [345740,43370] 0 2024-01-17T23:34:16.297 INFO:tasks.workunit.client.0.smithi067.stdout:9/107: dread d3/d6/f9 [0,4194304] 0 2024-01-17T23:34:16.568 INFO:tasks.workunit.client.0.smithi067.stdout:3/157: mkdir d0/d34/d35 0 2024-01-17T23:34:16.568 INFO:tasks.workunit.client.0.smithi067.stdout:2/147: mkdir d5/d2f 0 2024-01-17T23:34:16.568 INFO:tasks.workunit.client.0.smithi067.stdout:2/148: write d5/d6/f11 [916181,59225] 0 2024-01-17T23:34:16.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/158: dwrite d0/f1e [0,4194304] 0 2024-01-17T23:34:16.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/159: fsync d0/d17/f23 0 2024-01-17T23:34:16.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/140: truncate d6/fa 5824861 0 2024-01-17T23:34:16.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/141: fsync d6/f8 0 2024-01-17T23:34:16.662 INFO:tasks.workunit.client.0.smithi067.stdout:8/116: truncate d6/db/d10/f16 2411422 0 2024-01-17T23:34:16.786 INFO:tasks.workunit.client.0.smithi067.stdout:1/138: mknod d0/c25 0 2024-01-17T23:34:17.074 INFO:tasks.workunit.client.0.smithi067.stdout:7/116: symlink d4/de/l1b 0 2024-01-17T23:34:17.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/160: mknod d0/d13/d1a/c36 0 2024-01-17T23:34:17.722 INFO:tasks.workunit.client.0.smithi067.stdout:8/117: rename d6/db/d10/f14 to d6/d19/f2a 0 2024-01-17T23:34:17.722 INFO:tasks.workunit.client.0.smithi067.stdout:8/118: truncate d6/db/d18/f23 946963 0 2024-01-17T23:34:17.723 INFO:tasks.workunit.client.0.smithi067.stdout:8/119: dread - d6/db/f1b zero size 2024-01-17T23:34:17.752 INFO:tasks.workunit.client.0.smithi067.stdout:8/120: dwrite d6/db/d18/f23 [0,4194304] 0 2024-01-17T23:34:17.752 INFO:tasks.workunit.client.0.smithi067.stdout:8/121: write d6/db/f20 [528952,34815] 0 2024-01-17T23:34:18.070 INFO:tasks.workunit.client.0.smithi067.stdout:1/139: mkdir d0/d7/d1c/d26 0 2024-01-17T23:34:18.472 INFO:tasks.workunit.client.0.smithi067.stdout:7/117: mknod d4/de/c1c 0 2024-01-17T23:34:18.472 INFO:tasks.workunit.client.0.smithi067.stdout:9/108: symlink d3/d6/d11/l29 0 2024-01-17T23:34:18.497 INFO:tasks.workunit.client.0.smithi067.stdout:9/109: write d3/d6/fe [2407948,87644] 0 2024-01-17T23:34:18.580 INFO:tasks.workunit.client.0.smithi067.stdout:3/161: mkdir d0/d37 0 2024-01-17T23:34:18.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/140: sync 2024-01-17T23:34:18.928 INFO:tasks.workunit.client.0.smithi067.stdout:8/122: fsync d6/db/d10/f16 0 2024-01-17T23:34:19.059 INFO:tasks.workunit.client.0.smithi067.stdout:1/140: creat d0/f27 x:0 0 0 2024-01-17T23:34:19.089 INFO:tasks.workunit.client.0.smithi067.stdout:1/141: dwrite d0/d7/d1c/f23 [0,4194304] 0 2024-01-17T23:34:19.090 INFO:tasks.workunit.client.0.smithi067.stdout:1/142: chown d0/d7/d13 1374843919 1 2024-01-17T23:34:19.090 INFO:tasks.workunit.client.0.smithi067.stdout:1/143: truncate d0/d7/d1c/f22 816523 0 2024-01-17T23:34:19.111 INFO:tasks.workunit.client.0.smithi067.stdout:7/118: mknod d4/d16/c1d 0 2024-01-17T23:34:19.422 INFO:tasks.workunit.client.0.smithi067.stdout:9/110: getdents d3/d15 0 2024-01-17T23:34:19.422 INFO:tasks.workunit.client.0.smithi067.stdout:9/111: write d3/d6/d10/f1d [4711726,26382] 0 2024-01-17T23:34:19.422 INFO:tasks.workunit.client.0.smithi067.stdout:9/112: readlink d3/d15/l1f 0 2024-01-17T23:34:19.506 INFO:tasks.workunit.client.0.smithi067.stdout:3/162: rename d0/d17/d27 to d0/d13/d1a/d38 0 2024-01-17T23:34:19.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/114: rmdir d10 39 2024-01-17T23:34:19.600 INFO:tasks.workunit.client.0.smithi067.stdout:4/141: truncate d3/f7 7101523 0 2024-01-17T23:34:19.600 INFO:tasks.workunit.client.0.smithi067.stdout:4/142: creat d3/d5/f2a x:0 0 0 2024-01-17T23:34:19.613 INFO:tasks.workunit.client.0.smithi067.stdout:5/115: write d10/f16 [50306,100793] 0 2024-01-17T23:34:19.816 INFO:tasks.workunit.client.0.smithi067.stdout:8/123: creat d6/d26/f2b x:0 0 0 2024-01-17T23:34:19.816 INFO:tasks.workunit.client.0.smithi067.stdout:8/124: read - d6/db/d18/f28 zero size 2024-01-17T23:34:19.901 INFO:tasks.workunit.client.0.smithi067.stdout:2/149: write d5/d6/f24 [318572,31434] 0 2024-01-17T23:34:19.901 INFO:tasks.workunit.client.0.smithi067.stdout:2/150: stat d5/fa 0 2024-01-17T23:34:20.210 INFO:tasks.workunit.client.0.smithi067.stdout:1/144: symlink d0/d7/d13/l28 0 2024-01-17T23:34:20.351 INFO:tasks.workunit.client.0.smithi067.stdout:7/119: link d4/f6 d4/d16/f1e 0 2024-01-17T23:34:20.799 INFO:tasks.workunit.client.0.smithi067.stdout:3/163: dread d0/f2a [0,4194304] 0 2024-01-17T23:34:20.822 INFO:tasks.workunit.client.0.smithi067.stdout:3/164: write d0/d12/d1b/f1f [128739,92549] 0 2024-01-17T23:34:21.402 INFO:tasks.workunit.client.0.smithi067.stdout:8/125: symlink d6/db/d10/l2c 0 2024-01-17T23:34:21.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/126: creat d6/db/d10/f2d x:0 0 0 2024-01-17T23:34:21.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/151: creat d5/f30 x:0 0 0 2024-01-17T23:34:22.125 INFO:tasks.workunit.client.0.smithi067.stdout:1/145: link d0/d7/d1c/f23 d0/d7/f29 0 2024-01-17T23:34:22.125 INFO:tasks.workunit.client.0.smithi067.stdout:1/146: chown d0/c14 923252 1 2024-01-17T23:34:22.222 INFO:tasks.workunit.client.0.smithi067.stdout:0/153: unlink d3/cb 0 2024-01-17T23:34:22.222 INFO:tasks.workunit.client.0.smithi067.stdout:0/154: chown d3/d5/d1a/d1c 798 1 2024-01-17T23:34:22.447 INFO:tasks.workunit.client.0.smithi067.stdout:7/120: dwrite d4/f8 [4194304,4194304] 0 2024-01-17T23:34:22.447 INFO:tasks.workunit.client.0.smithi067.stdout:7/121: write d4/de/f17 [772249,101966] 0 2024-01-17T23:34:22.447 INFO:tasks.workunit.client.0.smithi067.stdout:7/122: truncate d4/de/f17 1102482 0 2024-01-17T23:34:22.451 INFO:tasks.workunit.client.0.smithi067.stdout:7/123: dread d4/fa [0,4194304] 0 2024-01-17T23:34:22.613 INFO:tasks.workunit.client.0.smithi067.stdout:8/127: mknod d6/c2e 0 2024-01-17T23:34:22.613 INFO:tasks.workunit.client.0.smithi067.stdout:8/128: readlink d6/db/l29 0 2024-01-17T23:34:22.828 INFO:tasks.workunit.client.0.smithi067.stdout:1/147: truncate d0/f5 357342 0 2024-01-17T23:34:22.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/155: creat d3/d5/d1a/f42 x:0 0 0 2024-01-17T23:34:22.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/156: read d3/f11 [1345395,86941] 0 2024-01-17T23:34:23.368 INFO:tasks.workunit.client.0.smithi067.stdout:5/116: write fa [193727,48485] 0 2024-01-17T23:34:23.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/117: read fa [537134,126226] 0 2024-01-17T23:34:23.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/152: symlink d5/d6/l31 0 2024-01-17T23:34:23.394 INFO:tasks.workunit.client.0.smithi067.stdout:5/118: dwrite d10/f19 [0,4194304] 0 2024-01-17T23:34:23.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/113: sync 2024-01-17T23:34:23.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/142: sync 2024-01-17T23:34:23.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/114: chown d3/d6 19 1 2024-01-17T23:34:23.624 INFO:tasks.workunit.client.0.smithi067.stdout:4/143: sync 2024-01-17T23:34:23.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/115: dread d3/d6/f9 [0,4194304] 0 2024-01-17T23:34:23.659 INFO:tasks.workunit.client.0.smithi067.stdout:9/116: dwrite d3/d6/fe [0,4194304] 0 2024-01-17T23:34:23.943 INFO:tasks.workunit.client.0.smithi067.stdout:8/129: creat d6/d19/d22/f2f x:0 0 0 2024-01-17T23:34:24.189 INFO:tasks.workunit.client.0.smithi067.stdout:1/148: symlink d0/d7/l2a 0 2024-01-17T23:34:24.358 INFO:tasks.workunit.client.0.smithi067.stdout:0/157: mkdir d3/d6/dd/d43 0 2024-01-17T23:34:24.461 INFO:tasks.workunit.client.0.smithi067.stdout:2/153: truncate d5/fa 99168 0 2024-01-17T23:34:24.710 INFO:tasks.workunit.client.0.smithi067.stdout:5/119: symlink d10/l1d 0 2024-01-17T23:34:24.710 INFO:tasks.workunit.client.0.smithi067.stdout:7/124: rmdir d4 39 2024-01-17T23:34:24.738 INFO:tasks.workunit.client.0.smithi067.stdout:7/125: dwrite d4/f8 [0,4194304] 0 2024-01-17T23:34:24.891 INFO:tasks.workunit.client.0.smithi067.stdout:6/143: unlink d6/c16 0 2024-01-17T23:34:24.909 INFO:tasks.workunit.client.0.smithi067.stdout:6/144: dread d6/f8 [0,4194304] 0 2024-01-17T23:34:24.932 INFO:tasks.workunit.client.0.smithi067.stdout:6/145: dwrite d6/ff [0,4194304] 0 2024-01-17T23:34:25.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/117: truncate f0 3983753 0 2024-01-17T23:34:25.047 INFO:tasks.workunit.client.0.smithi067.stdout:9/118: chown d3/da/l14 0 1 2024-01-17T23:34:25.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/149: mknod d0/d7/d1c/c2b 0 2024-01-17T23:34:25.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/158: link d3/d5/d1a/f22 d3/d5/d1a/f44 0 2024-01-17T23:34:25.704 INFO:tasks.workunit.client.0.smithi067.stdout:5/120: symlink d10/l1e 0 2024-01-17T23:34:25.710 INFO:tasks.workunit.client.0.smithi067.stdout:3/165: write d0/f2a [686506,74067] 0 2024-01-17T23:34:25.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/121: write d10/f13 [336136,59537] 0 2024-01-17T23:34:25.753 INFO:tasks.workunit.client.0.smithi067.stdout:7/126: mkdir d4/de/d1f 0 2024-01-17T23:34:26.164 INFO:tasks.workunit.client.0.smithi067.stdout:6/146: mkdir d6/d18/d2e 0 2024-01-17T23:34:26.165 INFO:tasks.workunit.client.0.smithi067.stdout:6/147: truncate d6/f1f 427737 0 2024-01-17T23:34:26.185 INFO:tasks.workunit.client.0.smithi067.stdout:6/148: dread d6/d18/f2a [0,4194304] 0 2024-01-17T23:34:26.185 INFO:tasks.workunit.client.0.smithi067.stdout:6/149: write d6/d18/f25 [805438,47939] 0 2024-01-17T23:34:26.678 INFO:tasks.workunit.client.0.smithi067.stdout:4/144: dwrite d3/d8/f1f [0,4194304] 0 2024-01-17T23:34:26.679 INFO:tasks.workunit.client.0.smithi067.stdout:4/145: truncate d3/d5/f2a 353291 0 2024-01-17T23:34:27.222 INFO:tasks.workunit.client.0.smithi067.stdout:1/150: rename d0/ld to d0/d7/d13/l2c 0 2024-01-17T23:34:27.376 INFO:tasks.workunit.client.0.smithi067.stdout:0/159: creat d3/d5/f45 x:0 0 0 2024-01-17T23:34:27.506 INFO:tasks.workunit.client.0.smithi067.stdout:2/154: getdents d5/d1f 0 2024-01-17T23:34:27.798 INFO:tasks.workunit.client.0.smithi067.stdout:5/122: link d10/f1a d10/f1f 0 2024-01-17T23:34:27.813 INFO:tasks.workunit.client.0.smithi067.stdout:5/123: write f9 [4193036,107534] 0 2024-01-17T23:34:27.953 INFO:tasks.workunit.client.0.smithi067.stdout:7/127: unlink d4/de/l1b 0 2024-01-17T23:34:28.234 INFO:tasks.workunit.client.0.smithi067.stdout:4/146: symlink d3/d8/l2b 0 2024-01-17T23:34:28.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/147: dwrite d3/d8/f1f [0,4194304] 0 2024-01-17T23:34:28.485 INFO:tasks.workunit.client.0.smithi067.stdout:1/151: rmdir d0/d7/d1c/d26 0 2024-01-17T23:34:28.485 INFO:tasks.workunit.client.0.smithi067.stdout:1/152: stat d0/d7/d1c/f22 0 2024-01-17T23:34:28.568 INFO:tasks.workunit.client.0.smithi067.stdout:3/166: rename d0/d12/c18 to d0/d13/d1a/c39 0 2024-01-17T23:34:28.568 INFO:tasks.workunit.client.0.smithi067.stdout:3/167: getdents d0/d37 0 2024-01-17T23:34:28.568 INFO:tasks.workunit.client.0.smithi067.stdout:3/168: write d0/f11 [2654211,118974] 0 2024-01-17T23:34:28.773 INFO:tasks.workunit.client.0.smithi067.stdout:2/155: truncate d5/d6/f24 1547257 0 2024-01-17T23:34:29.161 INFO:tasks.workunit.client.0.smithi067.stdout:4/148: dread d3/d8/f13 [0,4194304] 0 2024-01-17T23:34:29.268 INFO:tasks.workunit.client.0.smithi067.stdout:1/153: mkdir d0/d2d 0 2024-01-17T23:34:29.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/150: rename d6/d18/f25 to d6/d9/d1c/f2f 0 2024-01-17T23:34:29.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/151: dread - d6/f2b zero size 2024-01-17T23:34:29.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/152: write d6/ff [4272416,44696] 0 2024-01-17T23:34:29.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/153: write d6/fb [1456933,23261] 0 2024-01-17T23:34:29.495 INFO:tasks.workunit.client.0.smithi067.stdout:3/169: mknod d0/c3a 0 2024-01-17T23:34:29.845 INFO:tasks.workunit.client.0.smithi067.stdout:7/128: mknod d4/c20 0 2024-01-17T23:34:30.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/154: mkdir d0/d7/d13/d2e 0 2024-01-17T23:34:30.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/130: rmdir d6/d19 39 2024-01-17T23:34:30.152 INFO:tasks.workunit.client.0.smithi067.stdout:9/119: sync 2024-01-17T23:34:30.240 INFO:tasks.workunit.client.0.smithi067.stdout:0/160: rename d3/c16 to d3/d5/d1a/d1c/d1d/c46 0 2024-01-17T23:34:30.529 INFO:tasks.workunit.client.0.smithi067.stdout:6/154: mkdir d6/d9/d30 0 2024-01-17T23:34:30.650 INFO:tasks.workunit.client.0.smithi067.stdout:7/129: symlink d4/d16/l21 0 2024-01-17T23:34:30.811 INFO:tasks.workunit.client.0.smithi067.stdout:8/131: mknod d6/c30 0 2024-01-17T23:34:30.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/132: dread d6/d19/f2a [0,4194304] 0 2024-01-17T23:34:30.856 INFO:tasks.workunit.client.0.smithi067.stdout:8/133: dwrite d6/db/f20 [0,4194304] 0 2024-01-17T23:34:30.857 INFO:tasks.workunit.client.0.smithi067.stdout:8/134: truncate d6/d26/f2b 852644 0 2024-01-17T23:34:30.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/120: mkdir d3/d6/d2a 0 2024-01-17T23:34:30.944 INFO:tasks.workunit.client.0.smithi067.stdout:9/121: readlink d3/d6/d10/l22 0 2024-01-17T23:34:31.132 INFO:tasks.workunit.client.0.smithi067.stdout:3/170: rename d0/d13/d1a/c36 to d0/d13/d1a/d38/c3b 0 2024-01-17T23:34:31.132 INFO:tasks.workunit.client.0.smithi067.stdout:8/135: rename d6 to d6/d31 22 2024-01-17T23:34:31.133 INFO:tasks.workunit.client.0.smithi067.stdout:8/136: write d6/db/f1b [191584,70172] 0 2024-01-17T23:34:31.133 INFO:tasks.workunit.client.0.smithi067.stdout:8/137: read - d6/db/d10/f2d zero size 2024-01-17T23:34:31.133 INFO:tasks.workunit.client.0.smithi067.stdout:8/138: write d6/db/f1b [301401,95202] 0 2024-01-17T23:34:31.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/171: dwrite d0/fa [4194304,4194304] 0 2024-01-17T23:34:31.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/172: creat d0/d13/f3c x:0 0 0 2024-01-17T23:34:31.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/173: dread - d0/d13/f3c zero size 2024-01-17T23:34:31.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/174: creat d0/d13/f3d x:0 0 0 2024-01-17T23:34:31.323 INFO:tasks.workunit.client.0.smithi067.stdout:6/155: rmdir d6/d9/d1c 39 2024-01-17T23:34:31.472 INFO:tasks.workunit.client.0.smithi067.stdout:7/130: mknod d4/d16/c22 0 2024-01-17T23:34:31.472 INFO:tasks.workunit.client.0.smithi067.stdout:5/124: truncate d10/f19 3679446 0 2024-01-17T23:34:31.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/131: dread d4/de/f17 [0,4194304] 0 2024-01-17T23:34:31.693 INFO:tasks.workunit.client.0.smithi067.stdout:2/156: rmdir d5/d6 39 2024-01-17T23:34:32.545 INFO:tasks.workunit.client.0.smithi067.stdout:8/139: symlink d6/db/l32 0 2024-01-17T23:34:32.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/140: dread d6/db/f27 [0,4194304] 0 2024-01-17T23:34:32.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/141: truncate d6/db/d10/f2d 765863 0 2024-01-17T23:34:32.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/142: readlink d6/db/l1f 0 2024-01-17T23:34:32.663 INFO:tasks.workunit.client.0.smithi067.stdout:4/149: dwrite d3/d8/f13 [0,4194304] 0 2024-01-17T23:34:32.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/150: dread d3/d8/f13 [0,4194304] 0 2024-01-17T23:34:32.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/151: write d3/d5/f24 [991559,40415] 0 2024-01-17T23:34:32.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/175: dwrite d0/f14 [0,4194304] 0 2024-01-17T23:34:32.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/176: write d0/d13/f16 [1276382,128684] 0 2024-01-17T23:34:32.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/177: write d0/fa [708911,53341] 0 2024-01-17T23:34:32.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/178: write d0/d13/f16 [1009952,24957] 0 2024-01-17T23:34:32.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/179: write d0/f3 [635956,112895] 0 2024-01-17T23:34:32.827 INFO:tasks.workunit.client.0.smithi067.stdout:3/180: dwrite d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:34:33.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/132: creat d4/d16/f23 x:0 0 0 2024-01-17T23:34:33.261 INFO:tasks.workunit.client.0.smithi067.stdout:2/157: rmdir d5/d1f/d16 39 2024-01-17T23:34:33.261 INFO:tasks.workunit.client.0.smithi067.stdout:2/158: write d5/d1f/d16/f20 [1718001,36039] 0 2024-01-17T23:34:33.447 INFO:tasks.workunit.client.0.smithi067.stdout:8/143: mkdir d6/d26/d33 0 2024-01-17T23:34:33.455 INFO:tasks.workunit.client.0.smithi067.stdout:9/122: getdents d3/d6 0 2024-01-17T23:34:33.619 INFO:tasks.workunit.client.0.smithi067.stdout:0/161: dwrite d3/f4 [0,4194304] 0 2024-01-17T23:34:33.619 INFO:tasks.workunit.client.0.smithi067.stdout:0/162: write d3/d5/d1a/f24 [750836,75495] 0 2024-01-17T23:34:33.757 INFO:tasks.workunit.client.0.smithi067.stdout:4/152: mknod d3/d5/c2c 0 2024-01-17T23:34:33.807 INFO:tasks.workunit.client.0.smithi067.stdout:5/125: dread d10/f19 [0,4194304] 0 2024-01-17T23:34:33.827 INFO:tasks.workunit.client.0.smithi067.stdout:5/126: dread d10/f11 [0,4194304] 0 2024-01-17T23:34:33.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/127: dread f9 [0,4194304] 0 2024-01-17T23:34:34.082 INFO:tasks.workunit.client.0.smithi067.stdout:3/181: rmdir d0/d34 39 2024-01-17T23:34:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:7/133: mkdir d4/d16/d24 0 2024-01-17T23:34:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:7/134: chown d4/f19 2 1 2024-01-17T23:34:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:7/135: chown d4/de/l12 238660595 1 2024-01-17T23:34:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:7/136: write d4/d16/f23 [425104,5729] 0 2024-01-17T23:34:34.275 INFO:tasks.workunit.client.0.smithi067.stdout:7/137: dread d4/f18 [0,4194304] 0 2024-01-17T23:34:34.275 INFO:tasks.workunit.client.0.smithi067.stdout:7/138: stat d4/f8 0 2024-01-17T23:34:34.362 INFO:tasks.workunit.client.0.smithi067.stdout:2/159: mkdir d5/d6/d8/d32 0 2024-01-17T23:34:34.502 INFO:tasks.workunit.client.0.smithi067.stdout:8/144: creat d6/db/f34 x:0 0 0 2024-01-17T23:34:34.771 INFO:tasks.workunit.client.0.smithi067.stdout:1/155: creat d0/f2f x:0 0 0 2024-01-17T23:34:35.881 INFO:tasks.workunit.client.0.smithi067.stdout:4/153: mknod d3/d8/de/c2d 0 2024-01-17T23:34:35.881 INFO:tasks.workunit.client.0.smithi067.stdout:4/154: creat d3/d5/f2e x:0 0 0 2024-01-17T23:34:36.116 INFO:tasks.workunit.client.0.smithi067.stdout:5/128: creat d10/f20 x:0 0 0 2024-01-17T23:34:36.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/129: dwrite d10/f16 [4194304,4194304] 0 2024-01-17T23:34:36.142 INFO:tasks.workunit.client.0.smithi067.stdout:5/130: chown d10/f11 30819163 1 2024-01-17T23:34:36.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/182: symlink d0/d12/d1b/l3e 0 2024-01-17T23:34:36.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/183: stat d0/c6 0 2024-01-17T23:34:36.332 INFO:tasks.workunit.client.0.smithi067.stdout:6/156: write d6/d18/f1d [492442,97650] 0 2024-01-17T23:34:36.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/157: write d6/fb [272611,32307] 0 2024-01-17T23:34:36.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/158: write d6/f2c [645684,113629] 0 2024-01-17T23:34:36.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/159: stat d6/f2b 0 2024-01-17T23:34:36.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/160: chown d6/d9/f2d 392 1 2024-01-17T23:34:36.453 INFO:tasks.workunit.client.0.smithi067.stdout:2/160: dread d5/fa [0,4194304] 0 2024-01-17T23:34:36.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/145: mknod d6/d19/c35 0 2024-01-17T23:34:36.599 INFO:tasks.workunit.client.0.smithi067.stdout:8/146: dwrite d6/d19/f2a [0,4194304] 0 2024-01-17T23:34:36.599 INFO:tasks.workunit.client.0.smithi067.stdout:8/147: creat d6/d26/f36 x:0 0 0 2024-01-17T23:34:36.599 INFO:tasks.workunit.client.0.smithi067.stdout:8/148: write d6/d19/d22/f2f [956612,122810] 0 2024-01-17T23:34:36.628 INFO:tasks.workunit.client.0.smithi067.stdout:8/149: dwrite d6/db/f20 [0,4194304] 0 2024-01-17T23:34:36.650 INFO:tasks.workunit.client.0.smithi067.stdout:1/156: symlink d0/d7/d13/l30 0 2024-01-17T23:34:36.664 INFO:tasks.workunit.client.0.smithi067.stdout:8/150: dwrite d6/fe [0,4194304] 0 2024-01-17T23:34:36.665 INFO:tasks.workunit.client.0.smithi067.stdout:8/151: creat d6/d19/d22/f37 x:0 0 0 2024-01-17T23:34:37.025 INFO:tasks.workunit.client.0.smithi067.stdout:5/131: rename d10/c17 to d10/c21 0 2024-01-17T23:34:37.025 INFO:tasks.workunit.client.0.smithi067.stdout:5/132: chown fa 201791 1 2024-01-17T23:34:37.025 INFO:tasks.workunit.client.0.smithi067.stdout:5/133: write d10/f19 [4043133,64742] 0 2024-01-17T23:34:37.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/184: getdents d0/d12 0 2024-01-17T23:34:37.141 INFO:tasks.workunit.client.0.smithi067.stdout:3/185: dwrite d0/d17/f23 [0,4194304] 0 2024-01-17T23:34:37.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/161: mkdir d5/d6/d8/d32/d33 0 2024-01-17T23:34:37.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/123: dwrite f2 [0,4194304] 0 2024-01-17T23:34:37.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/124: dread d3/f13 [0,4194304] 0 2024-01-17T23:34:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/157: mkdir d0/d2d/d31 0 2024-01-17T23:34:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/158: dread - d0/d7/f20 zero size 2024-01-17T23:34:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/159: stat d0/d2d 0 2024-01-17T23:34:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/160: write d0/f27 [303612,18827] 0 2024-01-17T23:34:37.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/161: chown d0/c19 3 1 2024-01-17T23:34:38.784 INFO:tasks.workunit.client.0.smithi067.stdout:4/155: rename d3/c1e to d3/c2f 0 2024-01-17T23:34:39.077 INFO:tasks.workunit.client.0.smithi067.stdout:2/162: creat d5/d6/d8/f34 x:0 0 0 2024-01-17T23:34:39.077 INFO:tasks.workunit.client.0.smithi067.stdout:1/162: mkdir d0/d32 0 2024-01-17T23:34:39.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/163: write d0/f27 [274365,24395] 0 2024-01-17T23:34:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:2/163: dread d5/d1f/f1e [0,4194304] 0 2024-01-17T23:34:39.088 INFO:tasks.workunit.client.0.smithi067.stdout:2/164: fsync d5/d1f/f1e 0 2024-01-17T23:34:39.107 INFO:tasks.workunit.client.0.smithi067.stdout:1/164: dwrite d0/d7/d1c/f22 [0,4194304] 0 2024-01-17T23:34:39.107 INFO:tasks.workunit.client.0.smithi067.stdout:1/165: chown d0/d7/d13/l30 3757313 1 2024-01-17T23:34:39.107 INFO:tasks.workunit.client.0.smithi067.stdout:1/166: chown d0/d7/d13/l30 0 1 2024-01-17T23:34:39.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/156: write d3/d5/f2a [627623,84376] 0 2024-01-17T23:34:39.345 INFO:tasks.workunit.client.0.smithi067.stdout:0/163: sync 2024-01-17T23:34:39.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/134: rename d10/c21 to d10/c22 0 2024-01-17T23:34:39.740 INFO:tasks.workunit.client.0.smithi067.stdout:2/165: mkdir d5/d1f/d35 0 2024-01-17T23:34:40.400 INFO:tasks.workunit.client.0.smithi067.stdout:0/164: unlink d3/d5/c31 0 2024-01-17T23:34:40.400 INFO:tasks.workunit.client.0.smithi067.stdout:0/165: fdatasync d3/d5/f36 0 2024-01-17T23:34:40.402 INFO:tasks.workunit.client.0.smithi067.stdout:4/157: dread d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:34:40.429 INFO:tasks.workunit.client.0.smithi067.stdout:4/158: dwrite d3/d5/fc [0,4194304] 0 2024-01-17T23:34:40.494 INFO:tasks.workunit.client.0.smithi067.stdout:5/135: unlink d10/f13 0 2024-01-17T23:34:40.872 INFO:tasks.workunit.client.0.smithi067.stdout:0/166: creat d3/f47 x:0 0 0 2024-01-17T23:34:41.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/136: rename d10/l15 to d10/l23 0 2024-01-17T23:34:41.271 INFO:tasks.workunit.client.0.smithi067.stdout:0/167: mknod d3/d6/c48 0 2024-01-17T23:34:41.272 INFO:tasks.workunit.client.0.smithi067.stdout:0/168: fdatasync d3/d5/f45 0 2024-01-17T23:34:41.278 INFO:tasks.workunit.client.0.smithi067.stdout:0/169: write d3/d5/f9 [5074355,72609] 0 2024-01-17T23:34:41.383 INFO:tasks.workunit.client.0.smithi067.stdout:5/137: mkdir d10/d24 0 2024-01-17T23:34:41.498 INFO:tasks.workunit.client.0.smithi067.stdout:0/170: link d3/d5/d1a/d1c/d1d/l39 d3/d6/dd/d43/l49 0 2024-01-17T23:34:41.507 INFO:tasks.workunit.client.0.smithi067.stdout:0/171: dread d3/d5/d32/f41 [0,4194304] 0 2024-01-17T23:34:41.507 INFO:tasks.workunit.client.0.smithi067.stdout:0/172: stat d3/d5/f26 0 2024-01-17T23:34:41.534 INFO:tasks.workunit.client.0.smithi067.stdout:0/173: dwrite d3/d6/f17 [0,4194304] 0 2024-01-17T23:34:41.534 INFO:tasks.workunit.client.0.smithi067.stdout:0/174: truncate d3/d5/d1a/f42 1012537 0 2024-01-17T23:34:41.566 INFO:tasks.workunit.client.0.smithi067.stdout:5/138: mkdir d10/d24/d25 0 2024-01-17T23:34:41.594 INFO:tasks.workunit.client.0.smithi067.stdout:5/139: dwrite f9 [0,4194304] 0 2024-01-17T23:34:41.601 INFO:tasks.workunit.client.0.smithi067.stdout:5/140: dread fa [0,4194304] 0 2024-01-17T23:34:42.224 INFO:tasks.workunit.client.0.smithi067.stdout:5/141: link d10/c22 d10/d24/c26 0 2024-01-17T23:34:42.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/159: write d3/d8/de/f14 [675507,16529] 0 2024-01-17T23:34:42.311 INFO:tasks.workunit.client.0.smithi067.stdout:2/166: write f4 [1746046,63752] 0 2024-01-17T23:34:42.363 INFO:tasks.workunit.client.0.smithi067.stdout:3/186: symlink d0/l3f 0 2024-01-17T23:34:42.363 INFO:tasks.workunit.client.0.smithi067.stdout:3/187: getdents d0/d34/d35 0 2024-01-17T23:34:42.381 INFO:tasks.workunit.client.0.smithi067.stdout:3/188: dread d0/d17/f23 [0,4194304] 0 2024-01-17T23:34:42.482 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:42.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:34:42.531 INFO:tasks.workunit.client.0.smithi067.stdout:7/139: rename d4/de/d1f to d4/d25 0 2024-01-17T23:34:42.559 INFO:tasks.workunit.client.0.smithi067.stdout:7/140: dwrite d4/f6 [4194304,4194304] 0 2024-01-17T23:34:42.559 INFO:tasks.workunit.client.0.smithi067.stdout:7/141: fsync d4/d16/f1e 0 2024-01-17T23:34:42.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/142: write d4/fa [1484554,59431] 0 2024-01-17T23:34:42.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/143: chown d4/d16/l21 5146 1 2024-01-17T23:34:42.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/144: write d4/f10 [1090002,129786] 0 2024-01-17T23:34:42.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/145: read d4/fb [3749453,100250] 0 2024-01-17T23:34:42.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/146: chown d4/f8 182128513 1 2024-01-17T23:34:42.638 INFO:tasks.workunit.client.0.smithi067.stdout:5/142: symlink d10/d24/l27 0 2024-01-17T23:34:42.704 INFO:tasks.workunit.client.0.smithi067.stdout:4/160: stat d3/c2f 0 2024-01-17T23:34:42.733 INFO:tasks.workunit.client.0.smithi067.stdout:4/161: dwrite d3/d8/f13 [0,4194304] 0 2024-01-17T23:34:43.003 INFO:tasks.workunit.client.0.smithi067.stdout:2/167: link d5/d6/f11 d5/d6/d25/f36 0 2024-01-17T23:34:43.003 INFO:tasks.workunit.client.0.smithi067.stdout:2/168: chown d5/d6/c2d 1911611 1 2024-01-17T23:34:43.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/189: symlink d0/d34/d35/l40 0 2024-01-17T23:34:43.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/161: rename d6/d18/f28 to d6/d9/f31 0 2024-01-17T23:34:43.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/162: readlink d6/d9/l22 0 2024-01-17T23:34:43.348 INFO:tasks.workunit.client.0.smithi067.stdout:7/147: creat d4/f26 x:0 0 0 2024-01-17T23:34:43.355 INFO:tasks.workunit.client.0.smithi067.stdout:6/163: dread d6/f17 [0,4194304] 0 2024-01-17T23:34:43.361 INFO:tasks.workunit.client.0.smithi067.stdout:7/148: write f1 [6025639,33948] 0 2024-01-17T23:34:43.416 INFO:tasks.workunit.client.0.smithi067.stdout:7/149: dwrite d4/f6 [4194304,4194304] 0 2024-01-17T23:34:43.422 INFO:tasks.workunit.client.0.smithi067.stdout:7/150: dread d4/de/f17 [0,4194304] 0 2024-01-17T23:34:43.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/151: write d4/f18 [335026,95763] 0 2024-01-17T23:34:43.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/152: readlink d4/l13 0 2024-01-17T23:34:43.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/153: write d4/fb [1975639,77148] 0 2024-01-17T23:34:43.559 INFO:tasks.workunit.client.0.smithi067.stdout:5/143: link d10/d24/c26 d10/d24/d25/c28 0 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/162: symlink d3/d26/l30 0 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/163: chown d3/d8/l1d 1677 1 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/169: unlink d5/d1f/l28 0 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/170: readlink d5/d1f/d16/l18 0 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/167: sync 2024-01-17T23:34:43.986 INFO:tasks.workunit.client.0.smithi067.stdout:8/152: sync 2024-01-17T23:34:43.997 INFO:tasks.workunit.client.0.smithi067.stdout:4/164: dread d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:34:43.997 INFO:tasks.workunit.client.0.smithi067.stdout:4/165: write d3/d5/f2e [467596,58] 0 2024-01-17T23:34:43.997 INFO:tasks.workunit.client.0.smithi067.stdout:4/166: chown d3/l10 326 1 2024-01-17T23:34:44.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/167: dwrite d3/d5/f2a [0,4194304] 0 2024-01-17T23:34:44.072 INFO:tasks.workunit.client.0.smithi067.stdout:3/190: getdents d0/d13/d1a/d38 0 2024-01-17T23:34:44.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/191: dread d0/d12/f21 [0,4194304] 0 2024-01-17T23:34:44.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/125: rename d3/d6/c7 to d3/d15/c2b 0 2024-01-17T23:34:44.493 INFO:tasks.workunit.client.0.smithi067.stdout:6/164: link d6/d9/f14 d6/d9/d1c/d1e/f32 0 2024-01-17T23:34:44.493 INFO:tasks.workunit.client.0.smithi067.stdout:6/165: truncate d6/f8 4298906 0 2024-01-17T23:34:44.507 INFO:tasks.workunit.client.0.smithi067.stdout:7/154: unlink d4/fa 0 2024-01-17T23:34:44.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/166: write d6/d9/f2d [1003046,78816] 0 2024-01-17T23:34:44.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/167: creat d6/d18/f33 x:0 0 0 2024-01-17T23:34:44.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/144: creat d10/d24/f29 x:0 0 0 2024-01-17T23:34:44.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/171: link d5/d6/lc d5/d6/d8/d32/d33/l37 0 2024-01-17T23:34:45.244 INFO:tasks.workunit.client.0.smithi067.stdout:1/168: symlink d0/d32/l33 0 2024-01-17T23:34:45.244 INFO:tasks.workunit.client.0.smithi067.stdout:8/153: mkdir d6/db/d18/d38 0 2024-01-17T23:34:45.271 INFO:tasks.workunit.client.0.smithi067.stdout:8/154: dwrite d6/d19/d22/f2f [0,4194304] 0 2024-01-17T23:34:45.399 INFO:tasks.workunit.client.0.smithi067.stdout:3/192: symlink d0/d37/l41 0 2024-01-17T23:34:45.412 INFO:tasks.workunit.client.0.smithi067.stdout:0/175: rename d3/f4 to d3/d6/dd/f4a 0 2024-01-17T23:34:45.412 INFO:tasks.workunit.client.0.smithi067.stdout:0/176: write d3/d5/f26 [5093143,9962] 0 2024-01-17T23:34:45.412 INFO:tasks.workunit.client.0.smithi067.stdout:0/177: chown d3/d5/d1a/d1c/c20 1710782423 1 2024-01-17T23:34:45.412 INFO:tasks.workunit.client.0.smithi067.stdout:9/126: mkdir d3/d6/d2c 0 2024-01-17T23:34:45.412 INFO:tasks.workunit.client.0.smithi067.stdout:9/127: chown d3/da 400 1 2024-01-17T23:34:45.413 INFO:tasks.workunit.client.0.smithi067.stdout:9/128: chown d3/d25/d28 0 1 2024-01-17T23:34:45.413 INFO:tasks.workunit.client.0.smithi067.stdout:7/155: unlink d4/d16/c1d 0 2024-01-17T23:34:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:6/168: unlink d6/f2c 0 2024-01-17T23:34:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:6/169: chown d6/d9/d30 63 1 2024-01-17T23:34:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:5/145: creat d10/d24/d25/f2a x:0 0 0 2024-01-17T23:34:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:5/146: stat d10/l1e 0 2024-01-17T23:34:45.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/147: chown d10/f1c 8677 1 2024-01-17T23:34:45.424 INFO:tasks.workunit.client.0.smithi067.stdout:2/172: symlink d5/d6/d8/d32/l38 0 2024-01-17T23:34:45.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/148: creat d10/d24/d25/f2b x:0 0 0 2024-01-17T23:34:45.455 INFO:tasks.workunit.client.0.smithi067.stdout:5/149: dwrite d10/f16 [0,4194304] 0 2024-01-17T23:34:45.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/150: creat d10/f2c x:0 0 0 2024-01-17T23:34:45.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/151: chown d10/l1e 7643518 1 2024-01-17T23:34:46.104 INFO:tasks.workunit.client.0.smithi067.stdout:8/155: creat d6/db/d18/d38/f39 x:0 0 0 2024-01-17T23:34:46.127 INFO:tasks.workunit.client.0.smithi067.stdout:8/156: write d6/db/d18/f23 [73273,68734] 0 2024-01-17T23:34:46.152 INFO:tasks.workunit.client.0.smithi067.stdout:3/193: rmdir d0/d12 39 2024-01-17T23:34:46.171 INFO:tasks.workunit.client.0.smithi067.stdout:3/194: write d0/f2a [3253497,49982] 0 2024-01-17T23:34:46.575 INFO:tasks.workunit.client.0.smithi067.stdout:0/178: link d3/d5/d1a/f42 d3/d6/f4b 0 2024-01-17T23:34:46.583 INFO:tasks.workunit.client.0.smithi067.stdout:9/129: rename d3/d6/d10/l22 to d3/d25/d28/l2d 0 2024-01-17T23:34:46.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/156: creat d4/f27 x:0 0 0 2024-01-17T23:34:46.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/157: fdatasync d4/fd 0 2024-01-17T23:34:46.882 INFO:tasks.workunit.client.0.smithi067.stdout:6/170: creat d6/d9/f34 x:0 0 0 2024-01-17T23:34:47.314 INFO:tasks.workunit.client.0.smithi067.stdout:4/168: dwrite d3/f7 [4194304,4194304] 0 2024-01-17T23:34:47.900 INFO:tasks.workunit.client.0.smithi067.stdout:3/195: mknod d0/d34/c42 0 2024-01-17T23:34:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/130: mkdir d3/d6/d2e 0 2024-01-17T23:34:48.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/169: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:34:48.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/170: chown d0/d7/d13/d2e 116 1 2024-01-17T23:34:48.293 INFO:tasks.workunit.client.0.smithi067.stdout:1/171: write d0/d7/f29 [1593849,58202] 0 2024-01-17T23:34:48.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/172: dread d0/d7/f29 [0,4194304] 0 2024-01-17T23:34:48.316 INFO:tasks.workunit.client.0.smithi067.stdout:1/173: getdents d0/d2d/d31 0 2024-01-17T23:34:48.360 INFO:tasks.workunit.client.0.smithi067.stdout:7/158: mknod d4/d16/d24/c28 0 2024-01-17T23:34:48.361 INFO:tasks.workunit.client.0.smithi067.stdout:7/159: creat d4/d16/f29 x:0 0 0 2024-01-17T23:34:48.361 INFO:tasks.workunit.client.0.smithi067.stdout:7/160: write d4/f27 [253854,99351] 0 2024-01-17T23:34:48.469 INFO:tasks.workunit.client.0.smithi067.stdout:6/171: dread d6/d9/f10 [0,4194304] 0 2024-01-17T23:34:48.496 INFO:tasks.workunit.client.0.smithi067.stdout:6/172: dwrite d6/d9/f34 [0,4194304] 0 2024-01-17T23:34:48.525 INFO:tasks.workunit.client.0.smithi067.stdout:6/173: dwrite d6/f1f [0,4194304] 0 2024-01-17T23:34:48.525 INFO:tasks.workunit.client.0.smithi067.stdout:6/174: stat d6/f8 0 2024-01-17T23:34:48.636 INFO:tasks.workunit.client.0.smithi067.stdout:4/169: symlink d3/d8/de/l31 0 2024-01-17T23:34:48.636 INFO:tasks.workunit.client.0.smithi067.stdout:5/152: getdents d10/d24 0 2024-01-17T23:34:48.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/153: write f9 [2704329,3909] 0 2024-01-17T23:34:48.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/154: chown d10/d24/f29 41502 1 2024-01-17T23:34:48.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/196: mknod d0/d13/d1a/d38/c43 0 2024-01-17T23:34:48.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/197: dread d0/d12/d1b/f1f [0,4194304] 0 2024-01-17T23:34:48.926 INFO:tasks.workunit.client.0.smithi067.stdout:0/179: getdents d3/d5 0 2024-01-17T23:34:49.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/131: symlink d3/d6/d2c/l2f 0 2024-01-17T23:34:49.512 INFO:tasks.workunit.client.0.smithi067.stdout:1/174: creat d0/d7/d13/d2e/f34 x:0 0 0 2024-01-17T23:34:49.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/175: dwrite d0/d7/f29 [0,4194304] 0 2024-01-17T23:34:49.688 INFO:tasks.workunit.client.0.smithi067.stdout:2/173: write d5/d6/f24 [1930601,82810] 0 2024-01-17T23:34:49.727 INFO:tasks.workunit.client.0.smithi067.stdout:7/161: mknod d4/d16/d24/c2a 0 2024-01-17T23:34:49.727 INFO:tasks.workunit.client.0.smithi067.stdout:7/162: truncate d4/f6 8412785 0 2024-01-17T23:34:50.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/175: symlink d6/d18/d2e/l35 0 2024-01-17T23:34:50.356 INFO:tasks.workunit.client.0.smithi067.stdout:4/170: symlink d3/d5/l32 0 2024-01-17T23:34:50.385 INFO:tasks.workunit.client.0.smithi067.stdout:4/171: dwrite d3/d5/f24 [0,4194304] 0 2024-01-17T23:34:50.525 INFO:tasks.workunit.client.0.smithi067.stdout:5/155: creat d10/d24/f2d x:0 0 0 2024-01-17T23:34:50.761 INFO:tasks.workunit.client.0.smithi067.stdout:3/198: mknod d0/d37/c44 0 2024-01-17T23:34:50.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/132: symlink d3/d25/d28/l30 0 2024-01-17T23:34:50.762 INFO:tasks.workunit.client.0.smithi067.stdout:3/199: write d0/d13/d1a/f25 [386433,94569] 0 2024-01-17T23:34:50.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/200: dwrite d0/fd [0,4194304] 0 2024-01-17T23:34:50.863 INFO:tasks.workunit.client.0.smithi067.stdout:1/176: mkdir d0/d32/d35 0 2024-01-17T23:34:50.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/177: dwrite d0/d7/d1c/f22 [0,4194304] 0 2024-01-17T23:34:50.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/178: write d0/f27 [762990,46038] 0 2024-01-17T23:34:51.080 INFO:tasks.workunit.client.0.smithi067.stdout:2/174: mkdir d5/d6/d39 0 2024-01-17T23:34:51.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/163: link d4/f19 d4/de/f2b 0 2024-01-17T23:34:51.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/176: mknod d6/d9/d1c/c36 0 2024-01-17T23:34:51.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/177: chown d6/d9/d1c/c36 119108 1 2024-01-17T23:34:51.576 INFO:tasks.workunit.client.0.smithi067.stdout:4/172: creat d3/d26/f33 x:0 0 0 2024-01-17T23:34:51.576 INFO:tasks.workunit.client.0.smithi067.stdout:4/173: readlink d3/d5/l11 0 2024-01-17T23:34:51.716 INFO:tasks.workunit.client.0.smithi067.stdout:5/156: creat d10/d24/d25/f2e x:0 0 0 2024-01-17T23:34:51.717 INFO:tasks.workunit.client.0.smithi067.stdout:5/157: dread - d10/f20 zero size 2024-01-17T23:34:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/133: mknod d3/d25/c31 0 2024-01-17T23:34:51.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/134: write d3/d6/f9 [1616372,61173] 0 2024-01-17T23:34:51.797 INFO:tasks.workunit.client.0.smithi067.stdout:9/135: write d3/d6/fe [2159043,36273] 0 2024-01-17T23:34:51.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/201: mknod d0/d37/c45 0 2024-01-17T23:34:51.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/202: chown d0/d13/d1a/d38/c3b 556479099 1 2024-01-17T23:34:51.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/203: chown d0/fd 537911063 1 2024-01-17T23:34:51.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/204: read d0/d12/d1b/f1f [1450894,78294] 0 2024-01-17T23:34:51.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/205: creat d0/d13/f46 x:0 0 0 2024-01-17T23:34:52.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/179: creat d0/d7/f36 x:0 0 0 2024-01-17T23:34:52.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/180: chown d0/c14 24817 1 2024-01-17T23:34:52.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/181: chown d0/d7/d13/d2e/f34 1 1 2024-01-17T23:34:52.585 INFO:tasks.workunit.client.0.smithi067.stdout:2/175: rename d5/d1f/l13 to d5/d6/d25/l3a 0 2024-01-17T23:34:52.712 INFO:tasks.workunit.client.0.smithi067.stdout:7/164: creat d4/d25/f2c x:0 0 0 2024-01-17T23:34:53.574 INFO:tasks.workunit.client.0.smithi067.stdout:0/180: mkdir d3/d4c 0 2024-01-17T23:34:53.603 INFO:tasks.workunit.client.0.smithi067.stdout:0/181: dwrite d3/d6/dd/f3b [4194304,4194304] 0 2024-01-17T23:34:54.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/157: link d6/db/d10/f2d d6/d19/f3a 0 2024-01-17T23:34:54.987 INFO:tasks.workunit.client.0.smithi067.stdout:4/174: mkdir d3/d26/d34 0 2024-01-17T23:34:54.987 INFO:tasks.workunit.client.0.smithi067.stdout:4/175: stat d3/l21 0 2024-01-17T23:34:55.368 INFO:tasks.workunit.client.0.smithi067.stdout:9/136: symlink d3/d6/l32 0 2024-01-17T23:34:55.373 INFO:tasks.workunit.client.0.smithi067.stdout:9/137: read d3/f26 [396259,88189] 0 2024-01-17T23:34:55.645 INFO:tasks.workunit.client.0.smithi067.stdout:1/182: symlink d0/d7/d13/l37 0 2024-01-17T23:34:55.645 INFO:tasks.workunit.client.0.smithi067.stdout:1/183: write d0/d7/f36 [72439,44655] 0 2024-01-17T23:34:55.645 INFO:tasks.workunit.client.0.smithi067.stdout:1/184: fdatasync d0/d7/d1c/f23 0 2024-01-17T23:34:55.922 INFO:tasks.workunit.client.0.smithi067.stdout:3/206: rename d0/d13/d1a/f25 to d0/d13/d1a/d38/f47 0 2024-01-17T23:34:55.922 INFO:tasks.workunit.client.0.smithi067.stdout:2/176: creat d5/d1f/d35/f3b x:0 0 0 2024-01-17T23:34:55.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/177: dwrite d5/d6/d8/ff [4194304,4194304] 0 2024-01-17T23:34:55.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/178: fdatasync d5/d6/d8/f34 0 2024-01-17T23:34:55.956 INFO:tasks.workunit.client.0.smithi067.stdout:3/207: dwrite d0/d12/d1b/f26 [0,4194304] 0 2024-01-17T23:34:56.001 INFO:tasks.workunit.client.0.smithi067.stdout:3/208: dwrite d0/f9 [0,4194304] 0 2024-01-17T23:34:56.022 INFO:tasks.workunit.client.0.smithi067.stdout:3/209: dread d0/d17/f28 [0,4194304] 0 2024-01-17T23:34:56.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/182: mkdir d3/d5/d1a/d1c/d4d 0 2024-01-17T23:34:56.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/183: stat d3/d5/d1a/d1c/f3e 0 2024-01-17T23:34:56.304 INFO:tasks.workunit.client.0.smithi067.stdout:8/158: symlink d6/db/d10/l3b 0 2024-01-17T23:34:56.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/184: dread - d3/d5/d1a/d1c/d1d/f21 zero size 2024-01-17T23:34:56.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/185: chown d3/f47 102710726 1 2024-01-17T23:34:56.347 INFO:tasks.workunit.client.0.smithi067.stdout:8/159: dwrite d6/d26/f36 [0,4194304] 0 2024-01-17T23:34:56.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/176: mkdir d3/d8/d35 0 2024-01-17T23:34:56.584 INFO:tasks.workunit.client.0.smithi067.stdout:9/138: readlink d3/d6/d11/l12 0 2024-01-17T23:34:56.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/139: dwrite d3/d6/fe [0,4194304] 0 2024-01-17T23:34:56.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/140: chown d3/d25/c31 2 1 2024-01-17T23:34:56.734 INFO:tasks.workunit.client.0.smithi067.stdout:1/185: mkdir d0/d32/d38 0 2024-01-17T23:34:57.093 INFO:tasks.workunit.client.0.smithi067.stdout:2/179: creat d5/d1f/f3c x:0 0 0 2024-01-17T23:34:57.119 INFO:tasks.workunit.client.0.smithi067.stdout:2/180: dwrite d5/d1f/d16/f20 [0,4194304] 0 2024-01-17T23:34:57.147 INFO:tasks.workunit.client.0.smithi067.stdout:2/181: dwrite d5/d6/f11 [0,4194304] 0 2024-01-17T23:34:57.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/210: write d0/f2a [577651,82194] 0 2024-01-17T23:34:57.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/211: chown d0/l2b 9 1 2024-01-17T23:34:57.657 INFO:tasks.workunit.client.0.smithi067.stdout:0/186: mkdir d3/d5/d1a/d1c/d4e 0 2024-01-17T23:34:57.910 INFO:tasks.workunit.client.0.smithi067.stdout:8/160: rmdir d6/d26/d33 0 2024-01-17T23:34:58.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/141: creat d3/d6/d2c/f33 x:0 0 0 2024-01-17T23:34:58.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/142: chown d3/d6/l32 44 1 2024-01-17T23:34:58.595 INFO:tasks.workunit.client.0.smithi067.stdout:2/182: symlink d5/d6/d39/l3d 0 2024-01-17T23:34:58.604 INFO:tasks.workunit.client.0.smithi067.stdout:2/183: dread d5/d6/f24 [0,4194304] 0 2024-01-17T23:34:58.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/212: truncate d0/d12/f20 694107 0 2024-01-17T23:34:58.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/213: chown d0/d12/d1b/f1f 0 1 2024-01-17T23:34:58.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/214: chown d0/d13/l32 892430545 1 2024-01-17T23:34:58.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/177: truncate d3/d5/fc 4041680 0 2024-01-17T23:34:58.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/187: mknod d3/d5/d32/c4f 0 2024-01-17T23:34:58.811 INFO:tasks.workunit.client.0.smithi067.stdout:0/188: write d3/d6/dd/f29 [285437,22749] 0 2024-01-17T23:34:58.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/189: dwrite d3/d5/d1a/d1c/f3e [0,4194304] 0 2024-01-17T23:34:58.877 INFO:tasks.workunit.client.0.smithi067.stdout:6/178: sync 2024-01-17T23:34:59.028 INFO:tasks.workunit.client.0.smithi067.stdout:9/143: mkdir d3/d6/d2a/d34 0 2024-01-17T23:34:59.261 INFO:tasks.workunit.client.0.smithi067.stdout:2/184: creat d5/d6/d8/f3e x:0 0 0 2024-01-17T23:34:59.261 INFO:tasks.workunit.client.0.smithi067.stdout:7/165: creat d4/f2d x:0 0 0 2024-01-17T23:34:59.261 INFO:tasks.workunit.client.0.smithi067.stdout:2/185: write d5/d6/d8/f3e [528509,46185] 0 2024-01-17T23:34:59.261 INFO:tasks.workunit.client.0.smithi067.stdout:2/186: chown d5/d6 62 1 2024-01-17T23:34:59.262 INFO:tasks.workunit.client.0.smithi067.stdout:2/187: creat d5/d6/d8/f3f x:0 0 0 2024-01-17T23:34:59.271 INFO:tasks.workunit.client.0.smithi067.stdout:2/188: dread d5/d6/d8/f3e [0,4194304] 0 2024-01-17T23:34:59.284 INFO:tasks.workunit.client.0.smithi067.stdout:2/189: dread d5/d6/d25/f36 [0,4194304] 0 2024-01-17T23:34:59.295 INFO:tasks.workunit.client.0.smithi067.stdout:2/190: dread d5/d6/d8/ff [4194304,4194304] 0 2024-01-17T23:34:59.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/158: sync 2024-01-17T23:34:59.566 INFO:tasks.workunit.client.0.smithi067.stdout:1/186: getdents d0/d7/d13 0 2024-01-17T23:34:59.566 INFO:tasks.workunit.client.0.smithi067.stdout:1/187: fsync d0/d7/f29 0 2024-01-17T23:34:59.834 INFO:tasks.workunit.client.0.smithi067.stdout:4/178: getdents d3/d8/de/d20 0 2024-01-17T23:34:59.855 INFO:tasks.workunit.client.0.smithi067.stdout:4/179: read d3/f7 [4247278,95041] 0 2024-01-17T23:35:00.140 INFO:tasks.workunit.client.0.smithi067.stdout:0/190: mknod d3/d5/d1a/d1c/d4e/c50 0 2024-01-17T23:35:00.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/191: dwrite d3/d5/d1a/f3f [0,4194304] 0 2024-01-17T23:35:00.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/192: fsync d3/d5/f36 0 2024-01-17T23:35:00.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/193: stat d3/d5/d1a/f44 0 2024-01-17T23:35:00.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/194: dread - d3/d5/d1a/d1c/d1d/f21 zero size 2024-01-17T23:35:00.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/179: stat d6/fa 0 2024-01-17T23:35:00.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/180: truncate d6/d9/d1c/f2f 1282155 0 2024-01-17T23:35:00.219 INFO:tasks.workunit.client.0.smithi067.stdout:6/181: write d6/d18/f2a [5125588,105919] 0 2024-01-17T23:35:00.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/144: symlink d3/d6/d10/l35 0 2024-01-17T23:35:00.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/166: dread d4/f10 [0,4194304] 0 2024-01-17T23:35:00.691 INFO:tasks.workunit.client.0.smithi067.stdout:2/191: symlink d5/d6/d8/d32/l40 0 2024-01-17T23:35:00.870 INFO:tasks.workunit.client.0.smithi067.stdout:1/188: truncate d0/d7/d1c/f23 83789 0 2024-01-17T23:35:00.990 INFO:tasks.workunit.client.0.smithi067.stdout:4/180: mkdir d3/d8/d35/d36 0 2024-01-17T23:35:00.990 INFO:tasks.workunit.client.0.smithi067.stdout:4/181: chown d3/c12 27854 1 2024-01-17T23:35:00.990 INFO:tasks.workunit.client.0.smithi067.stdout:4/182: chown d3/d8/f1f 3 1 2024-01-17T23:35:01.006 INFO:tasks.workunit.client.0.smithi067.stdout:0/195: dread d3/d5/f9 [0,4194304] 0 2024-01-17T23:35:01.277 INFO:tasks.workunit.client.0.smithi067.stdout:6/182: mknod d6/d9/d1c/d1e/c37 0 2024-01-17T23:35:01.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/183: dwrite d6/d9/f14 [0,4194304] 0 2024-01-17T23:35:01.304 INFO:tasks.workunit.client.0.smithi067.stdout:6/184: stat d6/fd 0 2024-01-17T23:35:01.410 INFO:tasks.workunit.client.0.smithi067.stdout:9/145: unlink d3/d25/c31 0 2024-01-17T23:35:01.439 INFO:tasks.workunit.client.0.smithi067.stdout:9/146: dwrite d3/d6/d10/f1d [0,4194304] 0 2024-01-17T23:35:01.459 INFO:tasks.workunit.client.0.smithi067.stdout:9/147: read f0 [891422,120118] 0 2024-01-17T23:35:01.474 INFO:tasks.workunit.client.0.smithi067.stdout:9/148: dread f2 [0,4194304] 0 2024-01-17T23:35:01.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/149: dread d3/f5 [0,4194304] 0 2024-01-17T23:35:01.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/150: write d3/f5 [1400524,27412] 0 2024-01-17T23:35:01.515 INFO:tasks.workunit.client.0.smithi067.stdout:9/151: dwrite f0 [0,4194304] 0 2024-01-17T23:35:01.616 INFO:tasks.workunit.client.0.smithi067.stdout:2/192: mknod d5/d6/d8/c41 0 2024-01-17T23:35:01.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/193: dread d5/d6/d25/f36 [0,4194304] 0 2024-01-17T23:35:01.643 INFO:tasks.workunit.client.0.smithi067.stdout:2/194: write d5/d1f/d16/f20 [201751,102003] 0 2024-01-17T23:35:01.653 INFO:tasks.workunit.client.0.smithi067.stdout:2/195: read d5/d1f/f1e [741881,74807] 0 2024-01-17T23:35:01.674 INFO:tasks.workunit.client.0.smithi067.stdout:2/196: dwrite d5/d6/d8/f3e [0,4194304] 0 2024-01-17T23:35:01.694 INFO:tasks.workunit.client.0.smithi067.stdout:2/197: write d5/d6/d8/ff [3145464,65522] 0 2024-01-17T23:35:01.695 INFO:tasks.workunit.client.0.smithi067.stdout:2/198: chown d5/d1f/d35/f3b 2013 1 2024-01-17T23:35:01.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/199: dwrite d5/d1f/f1e [0,4194304] 0 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/189: mknod d0/d7/d13/c39 0 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:3/215: rename d0/le to d0/d37/l48 0 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/190: write d0/d7/f20 [337366,68829] 0 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/191: fdatasync d0/f5 0 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/192: chown d0/d7/d13/l30 9 1 2024-01-17T23:35:01.819 INFO:tasks.workunit.client.0.smithi067.stdout:1/193: fsync d0/f27 0 2024-01-17T23:35:01.872 INFO:tasks.workunit.client.0.smithi067.stdout:4/183: dread d3/d8/f1f [0,4194304] 0 2024-01-17T23:35:02.034 INFO:tasks.workunit.client.0.smithi067.stdout:5/159: rmdir d10/d24/d25 39 2024-01-17T23:35:02.035 INFO:tasks.workunit.client.0.smithi067.stdout:5/160: readlink d10/l23 0 2024-01-17T23:35:02.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/167: symlink d4/l2e 0 2024-01-17T23:35:02.982 INFO:tasks.workunit.client.0.smithi067.stdout:0/196: rename d3/d5/d32/f37 to d3/d5/d1a/d1c/d4e/f51 0 2024-01-17T23:35:02.983 INFO:tasks.workunit.client.0.smithi067.stdout:1/194: mkdir d0/d7/d13/d3a 0 2024-01-17T23:35:02.988 INFO:tasks.workunit.client.0.smithi067.stdout:4/184: read d3/d8/de/f14 [152274,109351] 0 2024-01-17T23:35:03.009 INFO:tasks.workunit.client.0.smithi067.stdout:0/197: dwrite d3/d5/f38 [0,4194304] 0 2024-01-17T23:35:03.129 INFO:tasks.workunit.client.0.smithi067.stdout:5/161: mknod d10/c2f 0 2024-01-17T23:35:03.302 INFO:tasks.workunit.client.0.smithi067.stdout:7/168: getdents d4/d16/d24 0 2024-01-17T23:35:03.322 INFO:tasks.workunit.client.0.smithi067.stdout:7/169: read d4/fd [1791383,115853] 0 2024-01-17T23:35:03.582 INFO:tasks.workunit.client.0.smithi067.stdout:2/200: getdents d5/d6/d25 0 2024-01-17T23:35:04.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/198: mknod d3/d6/dd/c52 0 2024-01-17T23:35:04.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/162: rename d10/c22 to d10/c30 0 2024-01-17T23:35:04.585 INFO:tasks.workunit.client.0.smithi067.stdout:9/152: truncate d3/d6/d11/f1b 3112863 0 2024-01-17T23:35:04.668 INFO:tasks.workunit.client.0.smithi067.stdout:2/201: creat d5/d6/d8/d32/f42 x:0 0 0 2024-01-17T23:35:04.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/202: read d5/fa [29395,20331] 0 2024-01-17T23:35:04.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/203: write d5/d1f/f3c [241961,52811] 0 2024-01-17T23:35:04.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/204: readlink d5/d6/d39/l3d 0 2024-01-17T23:35:04.707 INFO:tasks.workunit.client.0.smithi067.stdout:2/205: dwrite d5/d1f/f3c [0,4194304] 0 2024-01-17T23:35:04.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/199: mknod d3/d6/dd/c53 0 2024-01-17T23:35:04.916 INFO:tasks.workunit.client.0.smithi067.stdout:8/161: rmdir d6 39 2024-01-17T23:35:04.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/170: mkdir d4/d2f 0 2024-01-17T23:35:05.161 INFO:tasks.workunit.client.0.smithi067.stdout:9/153: creat d3/d6/d2a/d34/f36 x:0 0 0 2024-01-17T23:35:05.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/206: stat d5/d6/c2d 0 2024-01-17T23:35:05.530 INFO:tasks.workunit.client.0.smithi067.stdout:5/163: rename d10/c18 to d10/d24/c31 0 2024-01-17T23:35:05.555 INFO:tasks.workunit.client.0.smithi067.stdout:1/195: dread d0/d7/f29 [0,4194304] 0 2024-01-17T23:35:05.661 INFO:tasks.workunit.client.0.smithi067.stdout:8/162: mknod d6/d19/d22/c3c 0 2024-01-17T23:35:05.661 INFO:tasks.workunit.client.0.smithi067.stdout:8/163: creat d6/db/d18/d38/f3d x:0 0 0 2024-01-17T23:35:05.689 INFO:tasks.workunit.client.0.smithi067.stdout:8/164: dwrite d6/db/f20 [0,4194304] 0 2024-01-17T23:35:05.689 INFO:tasks.workunit.client.0.smithi067.stdout:8/165: write d6/db/f1b [904571,26956] 0 2024-01-17T23:35:05.788 INFO:tasks.workunit.client.0.smithi067.stdout:7/171: creat d4/d16/d24/f30 x:0 0 0 2024-01-17T23:35:05.871 INFO:tasks.workunit.client.0.smithi067.stdout:9/154: creat d3/d6/d10/f37 x:0 0 0 2024-01-17T23:35:05.990 INFO:tasks.workunit.client.0.smithi067.stdout:0/200: getdents d3/d5/d1a/d1c 0 2024-01-17T23:35:06.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/196: creat d0/d32/f3b x:0 0 0 2024-01-17T23:35:06.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/197: truncate d0/d7/f36 348002 0 2024-01-17T23:35:06.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/198: getdents d0/d32/d38 0 2024-01-17T23:35:06.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/185: write d6/f8 [1834380,74337] 0 2024-01-17T23:35:07.530 INFO:tasks.workunit.client.0.smithi067.stdout:8/166: truncate d6/db/f27 49813 0 2024-01-17T23:35:07.644 INFO:tasks.workunit.client.0.smithi067.stdout:9/155: mknod d3/d6/d2a/d34/c38 0 2024-01-17T23:35:07.835 INFO:tasks.workunit.client.0.smithi067.stdout:3/216: truncate d0/d12/f20 968374 0 2024-01-17T23:35:07.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/201: symlink d3/d5/d1a/d1c/d1d/d2e/l54 0 2024-01-17T23:35:08.333 INFO:tasks.workunit.client.0.smithi067.stdout:1/199: mknod d0/d32/c3c 0 2024-01-17T23:35:08.333 INFO:tasks.workunit.client.0.smithi067.stdout:4/185: write d3/d5/fc [4516077,8052] 0 2024-01-17T23:35:08.333 INFO:tasks.workunit.client.0.smithi067.stdout:4/186: chown d3/d8/c1a 24680689 1 2024-01-17T23:35:08.459 INFO:tasks.workunit.client.0.smithi067.stdout:6/186: symlink d6/d18/d2e/l38 0 2024-01-17T23:35:08.685 INFO:tasks.workunit.client.0.smithi067.stdout:8/167: mkdir d6/d26/d3e 0 2024-01-17T23:35:08.884 INFO:tasks.workunit.client.0.smithi067.stdout:3/217: unlink d0/d12/d1b/l3e 0 2024-01-17T23:35:08.884 INFO:tasks.workunit.client.0.smithi067.stdout:3/218: dread - d0/d13/f3c zero size 2024-01-17T23:35:08.913 INFO:tasks.workunit.client.0.smithi067.stdout:3/219: dwrite d0/d13/d1a/f2e [0,4194304] 0 2024-01-17T23:35:08.914 INFO:tasks.workunit.client.0.smithi067.stdout:3/220: write d0/d12/f21 [3254123,126555] 0 2024-01-17T23:35:09.077 INFO:tasks.workunit.client.0.smithi067.stdout:0/202: rename d3/d6/ff to d3/d6/f55 0 2024-01-17T23:35:09.240 INFO:tasks.workunit.client.0.smithi067.stdout:4/187: mknod d3/d8/d35/d36/c37 0 2024-01-17T23:35:09.654 INFO:tasks.workunit.client.0.smithi067.stdout:6/187: mknod d6/c39 0 2024-01-17T23:35:09.654 INFO:tasks.workunit.client.0.smithi067.stdout:6/188: chown d6/d18 129277 1 2024-01-17T23:35:09.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/168: creat d6/d19/f3f x:0 0 0 2024-01-17T23:35:10.279 INFO:tasks.workunit.client.0.smithi067.stdout:3/221: symlink d0/d12/d1b/l49 0 2024-01-17T23:35:10.556 INFO:tasks.workunit.client.0.smithi067.stdout:6/189: write d6/d18/f2a [3744526,20586] 0 2024-01-17T23:35:10.556 INFO:tasks.workunit.client.0.smithi067.stdout:6/190: fsync d6/fa 0 2024-01-17T23:35:10.830 INFO:tasks.workunit.client.0.smithi067.stdout:6/191: mknod d6/c3a 0 2024-01-17T23:35:11.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/222: mkdir d0/d13/d4a 0 2024-01-17T23:35:11.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/192: mknod d6/c3b 0 2024-01-17T23:35:11.395 INFO:tasks.workunit.client.0.smithi067.stdout:3/223: symlink d0/d13/d1a/l4b 0 2024-01-17T23:35:11.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/224: dread d0/f9 [0,4194304] 0 2024-01-17T23:35:11.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/225: readlink d0/l2b 0 2024-01-17T23:35:11.798 INFO:tasks.workunit.client.0.smithi067.stdout:3/226: truncate d0/d13/f2f 282278 0 2024-01-17T23:35:11.813 INFO:tasks.workunit.client.0.smithi067.stdout:3/227: dread d0/d12/f21 [0,4194304] 0 2024-01-17T23:35:11.827 INFO:tasks.workunit.client.0.smithi067.stdout:3/228: dread d0/d12/f21 [0,4194304] 0 2024-01-17T23:35:11.831 INFO:tasks.workunit.client.0.smithi067.stdout:3/229: dread d0/d13/d1a/d38/f47 [0,4194304] 0 2024-01-17T23:35:11.831 INFO:tasks.workunit.client.0.smithi067.stdout:3/230: readlink d0/lf 0 2024-01-17T23:35:11.879 INFO:tasks.workunit.client.0.smithi067.stdout:3/231: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:35:12.427 INFO:tasks.workunit.client.0.smithi067.stdout:9/156: write d3/d6/fe [2424643,40857] 0 2024-01-17T23:35:12.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/157: dread d3/f13 [0,4194304] 0 2024-01-17T23:35:12.584 INFO:tasks.workunit.client.0.smithi067.stdout:2/207: unlink d5/d6/c2d 0 2024-01-17T23:35:12.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:12.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:12.601 INFO:tasks.workunit.client.0.smithi067.stdout:3/232: getdents d0/d34/d35 0 2024-01-17T23:35:12.601 INFO:tasks.workunit.client.0.smithi067.stdout:7/172: rmdir d4/d2f 0 2024-01-17T23:35:12.623 INFO:tasks.workunit.client.0.smithi067.stdout:2/208: dwrite d5/d6/d8/ff [4194304,4194304] 0 2024-01-17T23:35:12.636 INFO:tasks.workunit.client.0.smithi067.stdout:7/173: dwrite d4/f27 [0,4194304] 0 2024-01-17T23:35:12.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/233: dwrite d0/d13/f16 [0,4194304] 0 2024-01-17T23:35:12.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/234: dread - d0/d13/f3d zero size 2024-01-17T23:35:12.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/235: creat d0/d17/f4c x:0 0 0 2024-01-17T23:35:12.641 INFO:tasks.workunit.client.0.smithi067.stdout:3/236: write d0/d13/f3c [332147,79961] 0 2024-01-17T23:35:12.655 INFO:tasks.workunit.client.0.smithi067.stdout:3/237: read d0/fa [6576530,126200] 0 2024-01-17T23:35:13.165 INFO:tasks.workunit.client.0.smithi067.stdout:7/174: getdents d4/d25 0 2024-01-17T23:35:13.378 INFO:tasks.workunit.client.0.smithi067.stdout:3/238: mkdir d0/d12/d1b/d4d 0 2024-01-17T23:35:13.378 INFO:tasks.workunit.client.0.smithi067.stdout:3/239: chown d0/d17/f23 19314537 1 2024-01-17T23:35:13.625 INFO:tasks.workunit.client.0.smithi067.stdout:3/240: symlink d0/d17/l4e 0 2024-01-17T23:35:13.625 INFO:tasks.workunit.client.0.smithi067.stdout:3/241: write d0/f14 [4003650,2860] 0 2024-01-17T23:35:13.756 INFO:tasks.workunit.client.0.smithi067.stdout:3/242: unlink d0/fc 0 2024-01-17T23:35:13.953 INFO:tasks.workunit.client.0.smithi067.stdout:2/209: creat d5/d1f/f43 x:0 0 0 2024-01-17T23:35:13.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/169: link d6/db/l1f d6/l40 0 2024-01-17T23:35:13.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/188: sync 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:5/164: sync 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:0/203: sync 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:1/200: sync 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:4/189: getdents d3/d8/de/d20 0 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:5/165: write d10/f2c [874702,56037] 0 2024-01-17T23:35:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:4/190: write d3/d26/f33 [276255,53369] 0 2024-01-17T23:35:13.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/166: dread f9 [0,4194304] 0 2024-01-17T23:35:13.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/167: chown d10/f1a 1813065687 1 2024-01-17T23:35:13.999 INFO:tasks.workunit.client.0.smithi067.stdout:1/201: dwrite d0/f27 [0,4194304] 0 2024-01-17T23:35:14.048 INFO:tasks.workunit.client.0.smithi067.stdout:5/168: dwrite d10/f12 [4194304,4194304] 0 2024-01-17T23:35:14.048 INFO:tasks.workunit.client.0.smithi067.stdout:5/169: chown d10/c2f 545936134 1 2024-01-17T23:35:14.188 INFO:tasks.workunit.client.0.smithi067.stdout:3/243: symlink d0/d34/d35/l4f 0 2024-01-17T23:35:14.189 INFO:tasks.workunit.client.0.smithi067.stdout:3/244: write d0/fa [8392054,66912] 0 2024-01-17T23:35:14.189 INFO:tasks.workunit.client.0.smithi067.stdout:3/245: read - d0/d12/f1c zero size 2024-01-17T23:35:14.339 INFO:tasks.workunit.client.0.smithi067.stdout:9/158: symlink d3/l39 0 2024-01-17T23:35:14.486 INFO:tasks.workunit.client.0.smithi067.stdout:8/170: creat d6/db/f41 x:0 0 0 2024-01-17T23:35:14.486 INFO:tasks.workunit.client.0.smithi067.stdout:0/204: creat d3/d6/f56 x:0 0 0 2024-01-17T23:35:15.424 INFO:tasks.workunit.client.0.smithi067.stdout:1/202: mkdir d0/d7/d13/d3d 0 2024-01-17T23:35:15.427 INFO:tasks.workunit.client.0.smithi067.stdout:1/203: dread d0/d7/f29 [0,4194304] 0 2024-01-17T23:35:15.435 INFO:tasks.workunit.client.0.smithi067.stdout:1/204: dread d0/d7/f20 [0,4194304] 0 2024-01-17T23:35:15.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/205: dread d0/d7/d1c/f23 [0,4194304] 0 2024-01-17T23:35:15.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/206: truncate d0/d7/f20 967309 0 2024-01-17T23:35:15.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/207: chown d0/d7/d13/l28 45446 1 2024-01-17T23:35:15.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/208: fsync d0/f27 0 2024-01-17T23:35:15.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/209: fdatasync d0/f2f 0 2024-01-17T23:35:15.441 INFO:tasks.workunit.client.0.smithi067.stdout:7/175: write d4/f6 [7843008,37963] 0 2024-01-17T23:35:15.441 INFO:tasks.workunit.client.0.smithi067.stdout:7/176: chown d4/fd 4 1 2024-01-17T23:35:15.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/170: rename fc to d10/d24/d25/f32 0 2024-01-17T23:35:15.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/171: chown d10/d24/c31 405 1 2024-01-17T23:35:15.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/172: truncate d10/f20 101601 0 2024-01-17T23:35:15.753 INFO:tasks.workunit.client.0.smithi067.stdout:6/193: sync 2024-01-17T23:35:15.753 INFO:tasks.workunit.client.0.smithi067.stdout:6/194: chown d6/c39 55 1 2024-01-17T23:35:15.976 INFO:tasks.workunit.client.0.smithi067.stdout:9/159: creat d3/d6/d2a/f3a x:0 0 0 2024-01-17T23:35:15.976 INFO:tasks.workunit.client.0.smithi067.stdout:3/246: getdents d0/d34/d35 0 2024-01-17T23:35:16.002 INFO:tasks.workunit.client.0.smithi067.stdout:9/160: dwrite d3/f26 [0,4194304] 0 2024-01-17T23:35:16.144 INFO:tasks.workunit.client.0.smithi067.stdout:0/205: mknod d3/d6/dd/c57 0 2024-01-17T23:35:16.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/210: mkdir d0/d7/d13/d3a/d3e 0 2024-01-17T23:35:16.326 INFO:tasks.workunit.client.0.smithi067.stdout:7/177: mknod d4/d25/c31 0 2024-01-17T23:35:16.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/191: dwrite d3/d8/f1f [0,4194304] 0 2024-01-17T23:35:16.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/195: mknod d6/c3c 0 2024-01-17T23:35:17.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/247: creat d0/d34/d35/f50 x:0 0 0 2024-01-17T23:35:17.143 INFO:tasks.workunit.client.0.smithi067.stdout:3/248: dread d0/d17/f28 [0,4194304] 0 2024-01-17T23:35:17.389 INFO:tasks.workunit.client.0.smithi067.stdout:9/161: symlink d3/d6/d2c/l3b 0 2024-01-17T23:35:17.389 INFO:tasks.workunit.client.0.smithi067.stdout:9/162: read - d3/d6/d2a/d34/f36 zero size 2024-01-17T23:35:17.408 INFO:tasks.workunit.client.0.smithi067.stdout:9/163: dread f0 [0,4194304] 0 2024-01-17T23:35:17.408 INFO:tasks.workunit.client.0.smithi067.stdout:9/164: write d3/d6/d2c/f33 [925393,65773] 0 2024-01-17T23:35:17.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/171: rmdir d6/db/d10 39 2024-01-17T23:35:17.616 INFO:tasks.workunit.client.0.smithi067.stdout:0/206: rename d3/d6/c48 to d3/d5/d1a/d1c/c58 0 2024-01-17T23:35:17.619 INFO:tasks.workunit.client.0.smithi067.stdout:8/172: read f4 [1742834,30716] 0 2024-01-17T23:35:17.662 INFO:tasks.workunit.client.0.smithi067.stdout:8/173: dwrite d6/db/d18/f28 [0,4194304] 0 2024-01-17T23:35:17.835 INFO:tasks.workunit.client.0.smithi067.stdout:1/211: unlink d0/d7/d13/l1d 0 2024-01-17T23:35:17.976 INFO:tasks.workunit.client.0.smithi067.stdout:4/192: unlink d3/c12 0 2024-01-17T23:35:18.081 INFO:tasks.workunit.client.0.smithi067.stdout:2/210: sync 2024-01-17T23:35:18.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/196: creat d6/f3d x:0 0 0 2024-01-17T23:35:18.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/249: truncate d0/f14 73882 0 2024-01-17T23:35:18.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/250: write d0/d17/f28 [4393799,117564] 0 2024-01-17T23:35:18.431 INFO:tasks.workunit.client.0.smithi067.stdout:9/165: symlink d3/d6/d2a/d34/l3c 0 2024-01-17T23:35:18.449 INFO:tasks.workunit.client.0.smithi067.stdout:9/166: dread d3/f5 [0,4194304] 0 2024-01-17T23:35:18.736 INFO:tasks.workunit.client.0.smithi067.stdout:7/178: rename d4/c20 to d4/d16/d24/c32 0 2024-01-17T23:35:18.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/207: rmdir d3/d5/d1a/d1c/d1d/d2e 39 2024-01-17T23:35:19.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/174: symlink d6/d19/d22/l42 0 2024-01-17T23:35:19.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/175: stat d6/db/d18/d38/f3d 0 2024-01-17T23:35:19.255 INFO:tasks.workunit.client.0.smithi067.stdout:1/212: unlink d0/d7/d13/c39 0 2024-01-17T23:35:19.318 INFO:tasks.workunit.client.0.smithi067.stdout:4/193: unlink d3/d8/c28 0 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:5/173: sync 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/211: link d5/d6/d8/f34 d5/d6/d8/d32/d33/f44 0 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/212: fsync d5/d6/f24 0 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/213: dread - d5/d1f/f43 zero size 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/214: write d5/d1f/d16/f20 [980962,23980] 0 2024-01-17T23:35:19.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/215: write d5/f30 [317265,108369] 0 2024-01-17T23:35:19.826 INFO:tasks.workunit.client.0.smithi067.stdout:3/251: unlink d0/fa 0 2024-01-17T23:35:19.827 INFO:tasks.workunit.client.0.smithi067.stdout:9/167: creat d3/d6/d2e/f3d x:0 0 0 2024-01-17T23:35:19.827 INFO:tasks.workunit.client.0.smithi067.stdout:9/168: creat d3/d6/d2a/d34/f3e x:0 0 0 2024-01-17T23:35:19.861 INFO:tasks.workunit.client.0.smithi067.stdout:3/252: dwrite d0/d13/d1a/f2e [0,4194304] 0 2024-01-17T23:35:19.861 INFO:tasks.workunit.client.0.smithi067.stdout:3/253: read d0/f5 [2755835,22382] 0 2024-01-17T23:35:19.889 INFO:tasks.workunit.client.0.smithi067.stdout:3/254: dwrite d0/d13/f33 [0,4194304] 0 2024-01-17T23:35:19.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/255: dread d0/d12/d1b/f1d [0,4194304] 0 2024-01-17T23:35:19.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/256: truncate d0/d13/f19 1182164 0 2024-01-17T23:35:19.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/257: write d0/d17/f4c [625572,121005] 0 2024-01-17T23:35:20.009 INFO:tasks.workunit.client.0.smithi067.stdout:7/179: unlink d4/d16/f23 0 2024-01-17T23:35:20.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/208: creat d3/d6/dd/d43/f59 x:0 0 0 2024-01-17T23:35:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:8/176: link d6/d19/f3f d6/db/d18/f43 0 2024-01-17T23:35:20.407 INFO:tasks.workunit.client.0.smithi067.stdout:1/213: link d0/d32/l33 d0/d7/d1c/l3f 0 2024-01-17T23:35:20.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/214: fdatasync d0/f27 0 2024-01-17T23:35:20.461 INFO:tasks.workunit.client.0.smithi067.stdout:4/194: mkdir d3/d8/de/d38 0 2024-01-17T23:35:20.607 INFO:tasks.workunit.client.0.smithi067.stdout:6/197: mkdir d6/d9/d3e 0 2024-01-17T23:35:20.743 INFO:tasks.workunit.client.0.smithi067.stdout:5/174: mknod d10/d24/d25/c33 0 2024-01-17T23:35:21.299 INFO:tasks.workunit.client.0.smithi067.stdout:2/216: creat d5/d6/d8/f45 x:0 0 0 2024-01-17T23:35:21.299 INFO:tasks.workunit.client.0.smithi067.stdout:2/217: chown d5/d6/lc 1884520 1 2024-01-17T23:35:21.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/218: write d5/d1f/f1e [2137754,19150] 0 2024-01-17T23:35:21.344 INFO:tasks.workunit.client.0.smithi067.stdout:2/219: dwrite d5/f30 [0,4194304] 0 2024-01-17T23:35:21.476 INFO:tasks.workunit.client.0.smithi067.stdout:9/169: rename d3/d6/d2a/f3a to d3/d6/d2a/f3f 0 2024-01-17T23:35:21.492 INFO:tasks.workunit.client.0.smithi067.stdout:9/170: dread f2 [0,4194304] 0 2024-01-17T23:35:21.498 INFO:tasks.workunit.client.0.smithi067.stdout:9/171: dread d3/f13 [0,4194304] 0 2024-01-17T23:35:21.498 INFO:tasks.workunit.client.0.smithi067.stdout:9/172: creat d3/d6/d2c/f40 x:0 0 0 2024-01-17T23:35:21.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/173: dwrite d3/f5 [0,4194304] 0 2024-01-17T23:35:21.554 INFO:tasks.workunit.client.0.smithi067.stdout:9/174: dwrite d3/d6/d2c/f33 [0,4194304] 0 2024-01-17T23:35:21.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/175: dread d3/d6/fe [0,4194304] 0 2024-01-17T23:35:21.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/176: chown d3/d6/d2c 832716 1 2024-01-17T23:35:21.606 INFO:tasks.workunit.client.0.smithi067.stdout:9/177: dwrite f0 [0,4194304] 0 2024-01-17T23:35:21.606 INFO:tasks.workunit.client.0.smithi067.stdout:9/178: chown f2 62517768 1 2024-01-17T23:35:21.636 INFO:tasks.workunit.client.0.smithi067.stdout:9/179: dwrite f0 [4194304,4194304] 0 2024-01-17T23:35:22.503 INFO:tasks.workunit.client.0.smithi067.stdout:0/209: mkdir d3/d5/d1a/d1c/d1d/d2e/d5a 0 2024-01-17T23:35:22.503 INFO:tasks.workunit.client.0.smithi067.stdout:8/177: unlink d6/d26/f2b 0 2024-01-17T23:35:22.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/178: dwrite d6/d26/f36 [0,4194304] 0 2024-01-17T23:35:22.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/179: creat d6/db/d18/f44 x:0 0 0 2024-01-17T23:35:22.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/180: fsync d6/fe 0 2024-01-17T23:35:22.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/181: truncate d6/db/d18/f44 857157 0 2024-01-17T23:35:22.695 INFO:tasks.workunit.client.0.smithi067.stdout:4/195: truncate d3/d5/f2e 771359 0 2024-01-17T23:35:22.926 INFO:tasks.workunit.client.0.smithi067.stdout:6/198: creat d6/d9/d3e/f3f x:0 0 0 2024-01-17T23:35:23.212 INFO:tasks.workunit.client.0.smithi067.stdout:2/220: rename d5/d6/d8/d32/l38 to d5/d6/d25/l46 0 2024-01-17T23:35:23.780 INFO:tasks.workunit.client.0.smithi067.stdout:3/258: rmdir d0/d34/d35 39 2024-01-17T23:35:23.960 INFO:tasks.workunit.client.0.smithi067.stdout:0/210: symlink d3/d4c/l5b 0 2024-01-17T23:35:23.960 INFO:tasks.workunit.client.0.smithi067.stdout:0/211: write d3/f11 [4028945,20600] 0 2024-01-17T23:35:24.415 INFO:tasks.workunit.client.0.smithi067.stdout:8/182: mknod d6/d19/c45 0 2024-01-17T23:35:24.700 INFO:tasks.workunit.client.0.smithi067.stdout:4/196: creat d3/d8/de/d20/f39 x:0 0 0 2024-01-17T23:35:24.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/199: creat d6/d18/d2e/f40 x:0 0 0 2024-01-17T23:35:24.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/200: stat d6/d18/f2a 0 2024-01-17T23:35:24.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/201: creat d6/d18/f41 x:0 0 0 2024-01-17T23:35:24.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/202: chown d6/d9/d1c/d1e/c37 1607 1 2024-01-17T23:35:24.945 INFO:tasks.workunit.client.0.smithi067.stdout:9/180: rename d3/d6/d10/f1d to d3/da/f41 0 2024-01-17T23:35:24.949 INFO:tasks.workunit.client.0.smithi067.stdout:6/203: dread d6/f17 [0,4194304] 0 2024-01-17T23:35:24.959 INFO:tasks.workunit.client.0.smithi067.stdout:6/204: dread d6/d9/f14 [0,4194304] 0 2024-01-17T23:35:25.117 INFO:tasks.workunit.client.0.smithi067.stdout:3/259: symlink d0/d13/d1a/l51 0 2024-01-17T23:35:25.282 INFO:tasks.workunit.client.0.smithi067.stdout:0/212: truncate d3/d6/f17 1229590 0 2024-01-17T23:35:25.284 INFO:tasks.workunit.client.0.smithi067.stdout:7/180: sync 2024-01-17T23:35:25.402 INFO:tasks.workunit.client.0.smithi067.stdout:4/197: mkdir d3/d26/d34/d3a 0 2024-01-17T23:35:25.439 INFO:tasks.workunit.client.0.smithi067.stdout:4/198: dwrite d3/d26/f33 [0,4194304] 0 2024-01-17T23:35:25.439 INFO:tasks.workunit.client.0.smithi067.stdout:4/199: fdatasync d3/d8/de/d20/f39 0 2024-01-17T23:35:25.457 INFO:tasks.workunit.client.0.smithi067.stdout:4/200: write d3/d5/fc [2244640,70256] 0 2024-01-17T23:35:25.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/201: dread d3/d8/f13 [0,4194304] 0 2024-01-17T23:35:25.798 INFO:tasks.workunit.client.0.smithi067.stdout:6/205: mknod d6/c42 0 2024-01-17T23:35:25.813 INFO:tasks.workunit.client.0.smithi067.stdout:6/206: dread d6/f8 [0,4194304] 0 2024-01-17T23:35:25.941 INFO:tasks.workunit.client.0.smithi067.stdout:3/260: truncate d0/d17/f4c 249338 0 2024-01-17T23:35:25.954 INFO:tasks.workunit.client.0.smithi067.stdout:3/261: write d0/d12/d1b/f1d [3447417,14738] 0 2024-01-17T23:35:26.037 INFO:tasks.workunit.client.0.smithi067.stdout:8/183: getdents d6/db 0 2024-01-17T23:35:26.084 INFO:tasks.workunit.client.0.smithi067.stdout:8/184: dwrite d6/db/f41 [0,4194304] 0 2024-01-17T23:35:26.084 INFO:tasks.workunit.client.0.smithi067.stdout:8/185: write d6/d19/f3f [1004836,2533] 0 2024-01-17T23:35:26.084 INFO:tasks.workunit.client.0.smithi067.stdout:8/186: fsync d6/d19/d22/f37 0 2024-01-17T23:35:26.126 INFO:tasks.workunit.client.0.smithi067.stdout:8/187: dwrite d6/db/f20 [4194304,4194304] 0 2024-01-17T23:35:26.192 INFO:tasks.workunit.client.0.smithi067.stdout:0/213: symlink d3/d5/d1a/d1c/l5c 0 2024-01-17T23:35:26.944 INFO:tasks.workunit.client.0.smithi067.stdout:6/207: truncate d6/d9/f14 3755333 0 2024-01-17T23:35:26.944 INFO:tasks.workunit.client.0.smithi067.stdout:6/208: stat d6/d9/d3e/f3f 0 2024-01-17T23:35:27.089 INFO:tasks.workunit.client.0.smithi067.stdout:1/215: creat d0/d7/d13/f40 x:0 0 0 2024-01-17T23:35:27.119 INFO:tasks.workunit.client.0.smithi067.stdout:1/216: dwrite d0/d7/d13/f40 [0,4194304] 0 2024-01-17T23:35:27.793 INFO:tasks.workunit.client.0.smithi067.stdout:8/188: dwrite d6/db/d10/f17 [4194304,4194304] 0 2024-01-17T23:35:27.793 INFO:tasks.workunit.client.0.smithi067.stdout:8/189: stat d6/d19/d22 0 2024-01-17T23:35:27.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/190: truncate d6/db/f41 4278004 0 2024-01-17T23:35:27.858 INFO:tasks.workunit.client.0.smithi067.stdout:0/214: creat d3/d6/dd/f5d x:0 0 0 2024-01-17T23:35:28.601 INFO:tasks.workunit.client.0.smithi067.stdout:9/181: rmdir d3/d6/d10 39 2024-01-17T23:35:28.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/209: mkdir d6/d9/d1c/d1e/d43 0 2024-01-17T23:35:28.601 INFO:tasks.workunit.client.0.smithi067.stdout:2/221: write d5/fa [177928,23996] 0 2024-01-17T23:35:28.630 INFO:tasks.workunit.client.0.smithi067.stdout:6/210: dwrite d6/d18/f33 [0,4194304] 0 2024-01-17T23:35:28.630 INFO:tasks.workunit.client.0.smithi067.stdout:6/211: chown d6/d9/d1c/f2f 28633237 1 2024-01-17T23:35:28.661 INFO:tasks.workunit.client.0.smithi067.stdout:6/212: dwrite d6/d9/f27 [0,4194304] 0 2024-01-17T23:35:28.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/213: dwrite d6/fa [4194304,4194304] 0 2024-01-17T23:35:28.886 INFO:tasks.workunit.client.0.smithi067.stdout:1/217: getdents d0/d2d 0 2024-01-17T23:35:28.899 INFO:tasks.workunit.client.0.smithi067.stdout:1/218: dread d0/f5 [0,4194304] 0 2024-01-17T23:35:28.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/219: getdents d0/d32/d38 0 2024-01-17T23:35:28.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/220: fsync d0/f27 0 2024-01-17T23:35:28.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/221: readlink d0/d7/d13/l17 0 2024-01-17T23:35:28.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/222: dread - d0/d7/d13/d2e/f34 zero size 2024-01-17T23:35:29.113 INFO:tasks.workunit.client.0.smithi067.stdout:8/191: link d6/d19/d22/l42 d6/d26/d3e/l46 0 2024-01-17T23:35:29.213 INFO:tasks.workunit.client.0.smithi067.stdout:9/182: mkdir d3/d6/d2a/d34/d42 0 2024-01-17T23:35:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:9/183: dwrite d3/d6/d11/f23 [0,4194304] 0 2024-01-17T23:35:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:9/184: write d3/d6/d11/f1b [2476115,18419] 0 2024-01-17T23:35:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:9/185: readlink d3/da/l17 0 2024-01-17T23:35:29.254 INFO:tasks.workunit.client.0.smithi067.stdout:9/186: dread d3/f26 [0,4194304] 0 2024-01-17T23:35:29.278 INFO:tasks.workunit.client.0.smithi067.stdout:9/187: dwrite d3/d6/f9 [0,4194304] 0 2024-01-17T23:35:29.295 INFO:tasks.workunit.client.0.smithi067.stdout:2/222: symlink d5/d2f/l47 0 2024-01-17T23:35:29.296 INFO:tasks.workunit.client.0.smithi067.stdout:2/223: readlink d5/d2f/l47 0 2024-01-17T23:35:29.749 INFO:tasks.workunit.client.0.smithi067.stdout:0/215: rename d3/cc to d3/d5/d1a/c5e 0 2024-01-17T23:35:29.938 INFO:tasks.workunit.client.0.smithi067.stdout:6/214: dread d6/ff [0,4194304] 0 2024-01-17T23:35:29.938 INFO:tasks.workunit.client.0.smithi067.stdout:6/215: chown d6/d9 0 1 2024-01-17T23:35:30.119 INFO:tasks.workunit.client.0.smithi067.stdout:8/192: link d6/cd d6/c47 0 2024-01-17T23:35:30.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/181: write d4/f10 [706333,39982] 0 2024-01-17T23:35:30.135 INFO:tasks.workunit.client.0.smithi067.stdout:7/182: dread d4/fd [0,4194304] 0 2024-01-17T23:35:30.450 INFO:tasks.workunit.client.0.smithi067.stdout:4/202: write d3/d5/f2e [1120640,112911] 0 2024-01-17T23:35:30.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/224: symlink d5/d6/d8/d32/d33/l48 0 2024-01-17T23:35:30.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/225: chown d5/d6/lc 142 1 2024-01-17T23:35:30.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/226: write d5/d6/d8/f3f [669032,69363] 0 2024-01-17T23:35:30.782 INFO:tasks.workunit.client.0.smithi067.stdout:1/223: rename d0/c1b to d0/d2d/d31/c41 0 2024-01-17T23:35:30.860 INFO:tasks.workunit.client.0.smithi067.stdout:0/216: dread d3/d6/dd/f29 [0,4194304] 0 2024-01-17T23:35:31.063 INFO:tasks.workunit.client.0.smithi067.stdout:5/175: rmdir d10 39 2024-01-17T23:35:31.064 INFO:tasks.workunit.client.0.smithi067.stdout:6/216: mkdir d6/d18/d44 0 2024-01-17T23:35:31.064 INFO:tasks.workunit.client.0.smithi067.stdout:8/193: mkdir d6/db/d10/d48 0 2024-01-17T23:35:31.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/217: dwrite d6/d9/f34 [4194304,4194304] 0 2024-01-17T23:35:31.135 INFO:tasks.workunit.client.0.smithi067.stdout:7/183: creat d4/d25/f33 x:0 0 0 2024-01-17T23:35:31.135 INFO:tasks.workunit.client.0.smithi067.stdout:7/184: chown d4/d16/d24/c32 50051702 1 2024-01-17T23:35:31.154 INFO:tasks.workunit.client.0.smithi067.stdout:7/185: write d4/f27 [1846419,77509] 0 2024-01-17T23:35:31.154 INFO:tasks.workunit.client.0.smithi067.stdout:7/186: read - d4/f2d zero size 2024-01-17T23:35:31.188 INFO:tasks.workunit.client.0.smithi067.stdout:7/187: dwrite d4/f10 [0,4194304] 0 2024-01-17T23:35:31.292 INFO:tasks.workunit.client.0.smithi067.stdout:4/203: mkdir d3/d8/de/d20/d3b 0 2024-01-17T23:35:31.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/204: dread d3/d5/fc [0,4194304] 0 2024-01-17T23:35:31.302 INFO:tasks.workunit.client.0.smithi067.stdout:4/205: fsync d3/d8/f1f 0 2024-01-17T23:35:31.313 INFO:tasks.workunit.client.0.smithi067.stdout:4/206: dread d3/d5/f24 [0,4194304] 0 2024-01-17T23:35:31.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/227: mknod d5/d2f/c49 0 2024-01-17T23:35:31.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/228: write d5/d6/d8/f34 [989020,86265] 0 2024-01-17T23:35:31.550 INFO:tasks.workunit.client.0.smithi067.stdout:1/224: mknod d0/d32/d35/c42 0 2024-01-17T23:35:31.550 INFO:tasks.workunit.client.0.smithi067.stdout:1/225: fsync d0/d7/d13/d2e/f34 0 2024-01-17T23:35:31.550 INFO:tasks.workunit.client.0.smithi067.stdout:1/226: read - d0/d32/f3b zero size 2024-01-17T23:35:31.672 INFO:tasks.workunit.client.0.smithi067.stdout:0/217: mknod d3/d5/d1a/d1c/d1d/d2e/c5f 0 2024-01-17T23:35:31.941 INFO:tasks.workunit.client.0.smithi067.stdout:8/194: mknod d6/d19/d22/d25/c49 0 2024-01-17T23:35:31.941 INFO:tasks.workunit.client.0.smithi067.stdout:8/195: creat d6/d19/f4a x:0 0 0 2024-01-17T23:35:32.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/262: unlink d0/l3f 0 2024-01-17T23:35:32.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/263: dwrite d0/d13/d1a/d38/f47 [0,4194304] 0 2024-01-17T23:35:32.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/264: write d0/f14 [37754,20362] 0 2024-01-17T23:35:32.651 INFO:tasks.workunit.client.0.smithi067.stdout:7/188: truncate d4/fb 835660 0 2024-01-17T23:35:33.352 INFO:tasks.workunit.client.0.smithi067.stdout:4/207: rmdir d3/d8/d35/d36 39 2024-01-17T23:35:33.539 INFO:tasks.workunit.client.0.smithi067.stdout:2/229: creat d5/d1f/d2a/f4a x:0 0 0 2024-01-17T23:35:33.788 INFO:tasks.workunit.client.0.smithi067.stdout:1/227: mknod d0/d7/c43 0 2024-01-17T23:35:33.803 INFO:tasks.workunit.client.0.smithi067.stdout:0/218: symlink d3/d5/l60 0 2024-01-17T23:35:33.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/219: chown d3/d5/d1a/d1c/d1d/f21 408912582 1 2024-01-17T23:35:33.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/176: rename d10/c30 to d10/d24/c34 0 2024-01-17T23:35:33.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/220: dwrite d3/d5/f2b [0,4194304] 0 2024-01-17T23:35:34.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/196: unlink d6/db/d18/c15 0 2024-01-17T23:35:34.562 INFO:tasks.workunit.client.0.smithi067.stdout:1/228: rmdir d0 39 2024-01-17T23:35:34.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/265: rename d0/d34/c42 to d0/c52 0 2024-01-17T23:35:34.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/266: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:35:34.859 INFO:tasks.workunit.client.0.smithi067.stdout:0/221: mkdir d3/d6/dd/d61 0 2024-01-17T23:35:34.859 INFO:tasks.workunit.client.0.smithi067.stdout:0/222: truncate d3/f1b 8588856 0 2024-01-17T23:35:34.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/223: read d3/d6/dd/f4a [1771239,75878] 0 2024-01-17T23:35:35.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/197: dwrite d6/db/d18/f44 [0,4194304] 0 2024-01-17T23:35:35.052 INFO:tasks.workunit.client.0.smithi067.stdout:8/198: write d6/d26/f36 [3162037,120916] 0 2024-01-17T23:35:35.077 INFO:tasks.workunit.client.0.smithi067.stdout:8/199: dwrite d6/db/f20 [4194304,4194304] 0 2024-01-17T23:35:35.222 INFO:tasks.workunit.client.0.smithi067.stdout:1/229: mknod d0/d7/c44 0 2024-01-17T23:35:35.222 INFO:tasks.workunit.client.0.smithi067.stdout:1/230: readlink d0/d32/l33 0 2024-01-17T23:35:35.329 INFO:tasks.workunit.client.0.smithi067.stdout:7/189: rename d4/de/f17 to d4/d16/d24/f34 0 2024-01-17T23:35:35.329 INFO:tasks.workunit.client.0.smithi067.stdout:7/190: write d4/d25/f33 [484685,70057] 0 2024-01-17T23:35:35.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/191: write d4/f8 [2910675,15332] 0 2024-01-17T23:35:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/192: dread - d4/d16/d24/f30 zero size 2024-01-17T23:35:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/193: creat d4/d16/d24/f35 x:0 0 0 2024-01-17T23:35:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/194: readlink d4/d16/l21 0 2024-01-17T23:35:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/195: write f1 [8114181,37125] 0 2024-01-17T23:35:35.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/196: chown d4/d16/d24/c28 6 1 2024-01-17T23:35:35.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/188: truncate f2 2906617 0 2024-01-17T23:35:35.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/189: fsync d3/d6/d2a/d34/f36 0 2024-01-17T23:35:35.479 INFO:tasks.workunit.client.0.smithi067.stdout:3/267: creat d0/d13/d1a/d38/f53 x:0 0 0 2024-01-17T23:35:35.479 INFO:tasks.workunit.client.0.smithi067.stdout:3/268: creat d0/d12/d1b/f54 x:0 0 0 2024-01-17T23:35:35.512 INFO:tasks.workunit.client.0.smithi067.stdout:0/224: symlink d3/d6/dd/d61/l62 0 2024-01-17T23:35:35.814 INFO:tasks.workunit.client.0.smithi067.stdout:8/200: dread d6/db/d18/f23 [0,4194304] 0 2024-01-17T23:35:35.834 INFO:tasks.workunit.client.0.smithi067.stdout:8/201: dread d6/d19/d22/f2f [0,4194304] 0 2024-01-17T23:35:35.839 INFO:tasks.workunit.client.0.smithi067.stdout:8/202: dread d6/d19/f3f [0,4194304] 0 2024-01-17T23:35:35.975 INFO:tasks.workunit.client.0.smithi067.stdout:1/231: mkdir d0/d7/d13/d3a/d45 0 2024-01-17T23:35:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/197: symlink d4/d25/l36 0 2024-01-17T23:35:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/198: fsync d4/f8 0 2024-01-17T23:35:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/199: creat d4/d16/d24/f37 x:0 0 0 2024-01-17T23:35:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/200: creat d4/d25/f38 x:0 0 0 2024-01-17T23:35:36.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/201: read d4/f6 [6172404,117731] 0 2024-01-17T23:35:36.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/269: mkdir d0/d13/d4a/d55 0 2024-01-17T23:35:36.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/225: rename d3/d5/d1a/d1c/d1d/d2e/f3d to d3/d5/d1a/d1c/f63 0 2024-01-17T23:35:36.724 INFO:tasks.workunit.client.0.smithi067.stdout:8/203: unlink d6/c2e 0 2024-01-17T23:35:36.725 INFO:tasks.workunit.client.0.smithi067.stdout:8/204: readlink d6/l1c 0 2024-01-17T23:35:36.725 INFO:tasks.workunit.client.0.smithi067.stdout:8/205: chown d6/db/d18/f43 67 1 2024-01-17T23:35:38.197 INFO:tasks.workunit.client.0.smithi067.stdout:8/206: getdents d6/d26 0 2024-01-17T23:35:38.211 INFO:tasks.workunit.client.0.smithi067.stdout:8/207: dread d6/f1a [0,4194304] 0 2024-01-17T23:35:38.211 INFO:tasks.workunit.client.0.smithi067.stdout:5/177: getdents d10 0 2024-01-17T23:35:38.530 INFO:tasks.workunit.client.0.smithi067.stdout:2/230: write f4 [310248,6324] 0 2024-01-17T23:35:38.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/218: sync 2024-01-17T23:35:38.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/208: sync 2024-01-17T23:35:38.795 INFO:tasks.workunit.client.0.smithi067.stdout:8/208: mknod d6/db/d18/d38/c4b 0 2024-01-17T23:35:38.795 INFO:tasks.workunit.client.0.smithi067.stdout:8/209: chown d6/d19/d22/d25 30574360 1 2024-01-17T23:35:38.897 INFO:tasks.workunit.client.0.smithi067.stdout:5/178: creat d10/d24/d25/f35 x:0 0 0 2024-01-17T23:35:39.157 INFO:tasks.workunit.client.0.smithi067.stdout:2/231: creat d5/d2f/f4b x:0 0 0 2024-01-17T23:35:39.157 INFO:tasks.workunit.client.0.smithi067.stdout:2/232: write d5/d6/f11 [4728773,42667] 0 2024-01-17T23:35:39.219 INFO:tasks.workunit.client.0.smithi067.stdout:4/209: truncate d3/d8/f13 3374999 0 2024-01-17T23:35:39.659 INFO:tasks.workunit.client.0.smithi067.stdout:8/210: mknod d6/db/c4c 0 2024-01-17T23:35:39.719 INFO:tasks.workunit.client.0.smithi067.stdout:5/179: creat d10/d24/f36 x:0 0 0 2024-01-17T23:35:40.078 INFO:tasks.workunit.client.0.smithi067.stdout:2/233: mkdir d5/d6/d8/d4c 0 2024-01-17T23:35:40.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/232: sync 2024-01-17T23:35:40.078 INFO:tasks.workunit.client.0.smithi067.stdout:2/234: read d5/d6/d8/ff [3994482,12255] 0 2024-01-17T23:35:40.120 INFO:tasks.workunit.client.0.smithi067.stdout:2/235: dwrite d5/d6/d8/d32/d33/f44 [0,4194304] 0 2024-01-17T23:35:40.121 INFO:tasks.workunit.client.0.smithi067.stdout:2/236: fdatasync d5/d1f/f43 0 2024-01-17T23:35:40.121 INFO:tasks.workunit.client.0.smithi067.stdout:2/237: fdatasync d5/d1f/f3c 0 2024-01-17T23:35:40.123 INFO:tasks.workunit.client.0.smithi067.stdout:1/233: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:35:40.123 INFO:tasks.workunit.client.0.smithi067.stdout:1/234: truncate d0/f2f 125075 0 2024-01-17T23:35:40.123 INFO:tasks.workunit.client.0.smithi067.stdout:1/235: creat d0/d7/d13/d2e/f46 x:0 0 0 2024-01-17T23:35:40.202 INFO:tasks.workunit.client.0.smithi067.stdout:4/210: getdents d3/d8/d35 0 2024-01-17T23:35:40.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/211: mknod d6/db/d18/c4d 0 2024-01-17T23:35:40.381 INFO:tasks.workunit.client.0.smithi067.stdout:0/226: write d3/d5/d1a/d1c/d1d/d2e/f33 [1742111,92723] 0 2024-01-17T23:35:40.704 INFO:tasks.workunit.client.0.smithi067.stdout:2/238: link d5/d1f/l12 d5/d1f/l4d 0 2024-01-17T23:35:40.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/219: symlink d6/l45 0 2024-01-17T23:35:40.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/236: mknod d0/d7/d13/c47 0 2024-01-17T23:35:41.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/211: creat d3/d8/d35/f3c x:0 0 0 2024-01-17T23:35:41.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/190: truncate f0 684961 0 2024-01-17T23:35:41.377 INFO:tasks.workunit.client.0.smithi067.stdout:7/202: rename d4/d16/d24 to d4/d25/d39 0 2024-01-17T23:35:41.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/191: fdatasync d3/d6/d2e/f3d 0 2024-01-17T23:35:41.377 INFO:tasks.workunit.client.0.smithi067.stdout:7/203: creat d4/de/f3a x:0 0 0 2024-01-17T23:35:41.392 INFO:tasks.workunit.client.0.smithi067.stdout:8/212: link d6/db/c4c d6/d19/d22/c4e 0 2024-01-17T23:35:41.392 INFO:tasks.workunit.client.0.smithi067.stdout:8/213: creat d6/d19/d22/f4f x:0 0 0 2024-01-17T23:35:41.777 INFO:tasks.workunit.client.0.smithi067.stdout:0/227: truncate d3/d6/dd/f3b 6981476 0 2024-01-17T23:35:41.777 INFO:tasks.workunit.client.0.smithi067.stdout:2/239: creat d5/d6/d8/d4c/f4e x:0 0 0 2024-01-17T23:35:41.785 INFO:tasks.workunit.client.0.smithi067.stdout:2/240: fsync d5/d6/f11 0 2024-01-17T23:35:41.785 INFO:tasks.workunit.client.0.smithi067.stdout:2/241: chown d5/d6/d25/l3a 89954 1 2024-01-17T23:35:41.790 INFO:tasks.workunit.client.0.smithi067.stdout:2/242: write d5/d6/f24 [1926768,52893] 0 2024-01-17T23:35:41.807 INFO:tasks.workunit.client.0.smithi067.stdout:4/212: mknod d3/d26/d34/d3a/c3d 0 2024-01-17T23:35:41.807 INFO:tasks.workunit.client.0.smithi067.stdout:6/220: creat d6/d9/d30/f46 x:0 0 0 2024-01-17T23:35:41.807 INFO:tasks.workunit.client.0.smithi067.stdout:6/221: read - d6/d9/d3e/f3f zero size 2024-01-17T23:35:41.862 INFO:tasks.workunit.client.0.smithi067.stdout:6/222: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:35:41.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/223: dwrite d6/f17 [0,4194304] 0 2024-01-17T23:35:41.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/224: read - d6/d18/d2e/f40 zero size 2024-01-17T23:35:41.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/225: write d6/d9/d3e/f3f [43186,25440] 0 2024-01-17T23:35:41.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/226: fsync d6/d18/d2e/f40 0 2024-01-17T23:35:41.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/227: write d6/d9/d30/f46 [790626,749] 0 2024-01-17T23:35:42.265 INFO:tasks.workunit.client.0.smithi067.stdout:1/237: rename d0/d32/d38 to d0/d7/d13/d3d/d48 0 2024-01-17T23:35:42.266 INFO:tasks.workunit.client.0.smithi067.stdout:1/238: chown d0/cc 56666 1 2024-01-17T23:35:42.266 INFO:tasks.workunit.client.0.smithi067.stdout:1/239: creat d0/d7/d13/d2e/f49 x:0 0 0 2024-01-17T23:35:42.266 INFO:tasks.workunit.client.0.smithi067.stdout:1/240: write d0/d7/d1c/f23 [923838,66433] 0 2024-01-17T23:35:42.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/204: dread d4/f18 [0,4194304] 0 2024-01-17T23:35:42.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/205: readlink d4/l13 0 2024-01-17T23:35:42.678 INFO:tasks.workunit.client.0.smithi067.stdout:7/206: fdatasync d4/f19 0 2024-01-17T23:35:42.703 INFO:tasks.workunit.client.0.smithi067.stdout:7/207: dwrite d4/de/f3a [0,4194304] 0 2024-01-17T23:35:42.703 INFO:tasks.workunit.client.0.smithi067.stdout:7/208: fdatasync d4/d25/f33 0 2024-01-17T23:35:42.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:42.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:35:43.141 INFO:tasks.workunit.client.0.smithi067.stdout:8/214: mknod d6/d19/d22/c50 0 2024-01-17T23:35:43.141 INFO:tasks.workunit.client.0.smithi067.stdout:8/215: creat d6/db/d18/d38/f51 x:0 0 0 2024-01-17T23:35:43.141 INFO:tasks.workunit.client.0.smithi067.stdout:8/216: write d6/db/d18/d38/f51 [224041,14196] 0 2024-01-17T23:35:43.141 INFO:tasks.workunit.client.0.smithi067.stdout:0/228: mkdir d3/d64 0 2024-01-17T23:35:43.145 INFO:tasks.workunit.client.0.smithi067.stdout:8/217: dread d6/db/f27 [0,4194304] 0 2024-01-17T23:35:43.156 INFO:tasks.workunit.client.0.smithi067.stdout:2/243: symlink d5/d1f/d16/l4f 0 2024-01-17T23:35:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:8/218: read d6/d19/d22/f2f [1098746,97860] 0 2024-01-17T23:35:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:8/219: stat d6/d19/l1d 0 2024-01-17T23:35:43.605 INFO:tasks.workunit.client.0.smithi067.stdout:6/228: symlink d6/d9/d1c/d1e/d43/l47 0 2024-01-17T23:35:43.814 INFO:tasks.workunit.client.0.smithi067.stdout:5/180: dwrite d10/f20 [0,4194304] 0 2024-01-17T23:35:44.087 INFO:tasks.workunit.client.0.smithi067.stdout:1/241: getdents d0 0 2024-01-17T23:35:44.087 INFO:tasks.workunit.client.0.smithi067.stdout:1/242: write d0/d7/d1c/f23 [1597425,118249] 0 2024-01-17T23:35:44.621 INFO:tasks.workunit.client.0.smithi067.stdout:0/229: link d3/f47 d3/d5/d1a/d1c/d4d/f65 0 2024-01-17T23:35:44.690 INFO:tasks.workunit.client.0.smithi067.stdout:2/244: symlink d5/d6/d39/l50 0 2024-01-17T23:35:44.690 INFO:tasks.workunit.client.0.smithi067.stdout:2/245: creat d5/d6/d8/d4c/f51 x:0 0 0 2024-01-17T23:35:44.690 INFO:tasks.workunit.client.0.smithi067.stdout:2/246: truncate d5/d1f/f43 917806 0 2024-01-17T23:35:44.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/220: stat d6/db/l1f 0 2024-01-17T23:35:44.923 INFO:tasks.workunit.client.0.smithi067.stdout:9/192: write f0 [913707,125559] 0 2024-01-17T23:35:44.923 INFO:tasks.workunit.client.0.smithi067.stdout:9/193: fsync d3/d6/d11/f1b 0 2024-01-17T23:35:45.606 INFO:tasks.workunit.client.0.smithi067.stdout:1/243: creat d0/d7/d13/d3a/d3e/f4a x:0 0 0 2024-01-17T23:35:45.606 INFO:tasks.workunit.client.0.smithi067.stdout:1/244: write d0/d32/f3b [832338,60164] 0 2024-01-17T23:35:46.215 INFO:tasks.workunit.client.0.smithi067.stdout:8/221: mknod d6/d19/d22/c52 0 2024-01-17T23:35:46.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/194: getdents d3/d6/d10 0 2024-01-17T23:35:46.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/270: symlink d0/l56 0 2024-01-17T23:35:46.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/271: chown d0/fd 2 1 2024-01-17T23:35:46.234 INFO:tasks.workunit.client.0.smithi067.stdout:3/272: dread d0/d13/d1a/d38/f47 [0,4194304] 0 2024-01-17T23:35:46.239 INFO:tasks.workunit.client.0.smithi067.stdout:3/273: dread d0/d17/f28 [4194304,4194304] 0 2024-01-17T23:35:46.288 INFO:tasks.workunit.client.0.smithi067.stdout:4/213: dwrite d3/d5/f2a [0,4194304] 0 2024-01-17T23:35:46.304 INFO:tasks.workunit.client.0.smithi067.stdout:4/214: write d3/d5/f2a [3280767,8948] 0 2024-01-17T23:35:46.329 INFO:tasks.workunit.client.0.smithi067.stdout:4/215: dwrite d3/d8/d35/f3c [0,4194304] 0 2024-01-17T23:35:46.643 INFO:tasks.workunit.client.0.smithi067.stdout:1/245: rmdir d0/d7/d1c 39 2024-01-17T23:35:47.124 INFO:tasks.workunit.client.0.smithi067.stdout:9/195: rmdir d3/d6/d2e 39 2024-01-17T23:35:47.153 INFO:tasks.workunit.client.0.smithi067.stdout:9/196: dwrite d3/d6/d2a/d34/f36 [0,4194304] 0 2024-01-17T23:35:47.153 INFO:tasks.workunit.client.0.smithi067.stdout:9/197: dread - d3/d6/d2e/f3d zero size 2024-01-17T23:35:47.185 INFO:tasks.workunit.client.0.smithi067.stdout:9/198: dwrite d3/da/f41 [0,4194304] 0 2024-01-17T23:35:47.185 INFO:tasks.workunit.client.0.smithi067.stdout:9/199: read d3/d6/d11/f1b [1865120,75468] 0 2024-01-17T23:35:47.339 INFO:tasks.workunit.client.0.smithi067.stdout:3/274: mkdir d0/d34/d35/d57 0 2024-01-17T23:35:48.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/200: rename d3/d6/d2c/f33 to d3/d6/d2c/f43 0 2024-01-17T23:35:48.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/275: stat d0/d34/d35/l4f 0 2024-01-17T23:35:48.075 INFO:tasks.workunit.client.0.smithi067.stdout:9/201: dwrite f2 [0,4194304] 0 2024-01-17T23:35:48.075 INFO:tasks.workunit.client.0.smithi067.stdout:9/202: fsync d3/d6/fe 0 2024-01-17T23:35:48.159 INFO:tasks.workunit.client.0.smithi067.stdout:3/276: getdents d0/d13/d1a 0 2024-01-17T23:35:48.159 INFO:tasks.workunit.client.0.smithi067.stdout:3/277: fdatasync d0/f11 0 2024-01-17T23:35:48.159 INFO:tasks.workunit.client.0.smithi067.stdout:3/278: fsync d0/d17/f28 0 2024-01-17T23:35:48.199 INFO:tasks.workunit.client.0.smithi067.stdout:9/203: dread d3/f5 [0,4194304] 0 2024-01-17T23:35:48.446 INFO:tasks.workunit.client.0.smithi067.stdout:5/181: mknod d10/c37 0 2024-01-17T23:35:48.462 INFO:tasks.workunit.client.0.smithi067.stdout:5/182: read fd [1054841,117166] 0 2024-01-17T23:35:48.627 INFO:tasks.workunit.client.0.smithi067.stdout:2/247: unlink d5/c29 0 2024-01-17T23:35:48.627 INFO:tasks.workunit.client.0.smithi067.stdout:2/248: chown d5/d6/d8/d32/l40 14900002 1 2024-01-17T23:35:48.627 INFO:tasks.workunit.client.0.smithi067.stdout:2/249: creat d5/d1f/d2a/f52 x:0 0 0 2024-01-17T23:35:49.265 INFO:tasks.workunit.client.0.smithi067.stdout:7/209: rename d4/f10 to d4/de/f3b 0 2024-01-17T23:35:49.793 INFO:tasks.workunit.client.0.smithi067.stdout:6/229: rename d6/d9/d1c/d1e/f32 to d6/d18/d44/f48 0 2024-01-17T23:35:49.797 INFO:tasks.workunit.client.0.smithi067.stdout:6/230: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:35:49.812 INFO:tasks.workunit.client.0.smithi067.stdout:6/231: dread d6/d9/f14 [0,4194304] 0 2024-01-17T23:35:49.821 INFO:tasks.workunit.client.0.smithi067.stdout:6/232: dread d6/d9/f14 [0,4194304] 0 2024-01-17T23:35:49.847 INFO:tasks.workunit.client.0.smithi067.stdout:6/233: dwrite d6/d9/f34 [4194304,4194304] 0 2024-01-17T23:35:50.039 INFO:tasks.workunit.client.0.smithi067.stdout:9/204: write d3/d6/d2c/f43 [4582334,123047] 0 2024-01-17T23:35:50.043 INFO:tasks.workunit.client.0.smithi067.stdout:1/246: sync 2024-01-17T23:35:50.046 INFO:tasks.workunit.client.0.smithi067.stdout:2/250: dwrite f4 [0,4194304] 0 2024-01-17T23:35:50.318 INFO:tasks.workunit.client.0.smithi067.stdout:0/230: rename d3/d5/d1a/f22 to d3/d5/d1a/d1c/d1d/f66 0 2024-01-17T23:35:50.318 INFO:tasks.workunit.client.0.smithi067.stdout:7/210: mknod d4/c3c 0 2024-01-17T23:35:50.318 INFO:tasks.workunit.client.0.smithi067.stdout:0/231: write d3/d5/d1a/d1c/d4d/f65 [109456,30833] 0 2024-01-17T23:35:50.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/247: dread d0/f2f [0,4194304] 0 2024-01-17T23:35:50.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/248: dwrite d0/f27 [0,4194304] 0 2024-01-17T23:35:50.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/249: stat d0/c25 0 2024-01-17T23:35:50.371 INFO:tasks.workunit.client.0.smithi067.stdout:1/250: getdents d0/d7/d13/d3a/d45 0 2024-01-17T23:35:50.482 INFO:tasks.workunit.client.0.smithi067.stdout:8/222: rename d6/db/d10 to d6/d19/d22/d25/d53 0 2024-01-17T23:35:50.897 INFO:tasks.workunit.client.0.smithi067.stdout:1/251: unlink d0/c19 0 2024-01-17T23:35:51.088 INFO:tasks.workunit.client.0.smithi067.stdout:4/216: rename d3/d8/de/l31 to d3/d8/d35/d36/l3e 0 2024-01-17T23:35:51.167 INFO:tasks.workunit.client.0.smithi067.stdout:8/223: mkdir d6/d19/d22/d25/d53/d54 0 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/279: rename d0/d13/d1a/c39 to d0/c58 0 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/280: chown d0/l30 89 1 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/281: chown d0/l2b 11785 1 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:0/232: write d3/d5/f9 [3068494,68547] 0 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/282: chown d0/d13/d1a/f2e 27397056 1 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/283: chown d0/d37/c45 23920269 1 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:0/233: fsync d3/d5/d1a/f24 0 2024-01-17T23:35:51.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/284: write d0/d12/f1c [157656,101515] 0 2024-01-17T23:35:51.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/251: sync 2024-01-17T23:35:51.430 INFO:tasks.workunit.client.0.smithi067.stdout:9/205: sync 2024-01-17T23:35:51.430 INFO:tasks.workunit.client.0.smithi067.stdout:9/206: dread - d3/d6/d2e/f3d zero size 2024-01-17T23:35:51.648 INFO:tasks.workunit.client.0.smithi067.stdout:8/224: creat d6/db/f55 x:0 0 0 2024-01-17T23:35:51.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/234: rmdir d3/d5/d1a/d1c 39 2024-01-17T23:35:51.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/285: mkdir d0/d12/d59 0 2024-01-17T23:35:51.801 INFO:tasks.workunit.client.0.smithi067.stdout:8/225: mkdir d6/d26/d56 0 2024-01-17T23:35:51.802 INFO:tasks.workunit.client.0.smithi067.stdout:8/226: stat d6/db/f55 0 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/183: rename d10/d24/f29 to d10/f38 0 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/184: chown f9 7 1 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/234: rename d6 to d6/d9/d3e/d49 22 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:7/211: rename d4/d25 to d4/d25/d3d 22 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:7/212: fdatasync f1 0 2024-01-17T23:35:51.939 INFO:tasks.workunit.client.0.smithi067.stdout:7/213: dread - d4/de/f14 zero size 2024-01-17T23:35:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/214: creat d4/de/f3e x:0 0 0 2024-01-17T23:35:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/215: chown d4/de/f3b 480948336 1 2024-01-17T23:35:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/216: chown d4/de/f2b 763 1 2024-01-17T23:35:51.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/217: dread - d4/f19 zero size 2024-01-17T23:35:52.753 INFO:tasks.workunit.client.0.smithi067.stdout:0/235: symlink d3/d5/d1a/d1c/d1d/d2e/l67 0 2024-01-17T23:35:52.753 INFO:tasks.workunit.client.0.smithi067.stdout:0/236: read - d3/d5/f45 zero size 2024-01-17T23:35:52.824 INFO:tasks.workunit.client.0.smithi067.stdout:3/286: symlink d0/l5a 0 2024-01-17T23:35:52.827 INFO:tasks.workunit.client.0.smithi067.stdout:8/227: link d6/d19/f2a d6/d26/d56/f57 0 2024-01-17T23:35:52.828 INFO:tasks.workunit.client.0.smithi067.stdout:8/228: write d6/d19/d22/f2f [3451867,114029] 0 2024-01-17T23:35:52.844 INFO:tasks.workunit.client.0.smithi067.stdout:8/229: dread f4 [0,4194304] 0 2024-01-17T23:35:52.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/252: dwrite d5/d1f/f1e [0,4194304] 0 2024-01-17T23:35:53.077 INFO:tasks.workunit.client.0.smithi067.stdout:1/252: rename d0/d32/f3b to d0/d7/d13/d2e/f4b 0 2024-01-17T23:35:53.121 INFO:tasks.workunit.client.0.smithi067.stdout:6/235: getdents d6/d9/d1c/d1e/d43 0 2024-01-17T23:35:53.124 INFO:tasks.workunit.client.0.smithi067.stdout:6/236: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:35:53.316 INFO:tasks.workunit.client.0.smithi067.stdout:9/207: sync 2024-01-17T23:35:53.343 INFO:tasks.workunit.client.0.smithi067.stdout:9/208: dwrite d3/d6/d2e/f3d [0,4194304] 0 2024-01-17T23:35:53.422 INFO:tasks.workunit.client.0.smithi067.stdout:7/218: truncate d4/d25/d39/f34 618336 0 2024-01-17T23:35:53.646 INFO:tasks.workunit.client.0.smithi067.stdout:0/237: rename d3/d6/dd/c14 to d3/d6/dd/c68 0 2024-01-17T23:35:53.860 INFO:tasks.workunit.client.0.smithi067.stdout:3/287: creat d0/d12/d1b/d4d/f5b x:0 0 0 2024-01-17T23:35:54.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/253: symlink d5/l53 0 2024-01-17T23:35:54.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/254: chown d5/l53 850944 1 2024-01-17T23:35:54.152 INFO:tasks.workunit.client.0.smithi067.stdout:5/185: mknod d10/d24/c39 0 2024-01-17T23:35:54.178 INFO:tasks.workunit.client.0.smithi067.stdout:5/186: dwrite d10/d24/d25/f35 [0,4194304] 0 2024-01-17T23:35:54.546 INFO:tasks.workunit.client.0.smithi067.stdout:4/217: rename d3/d8/de/d20/f39 to d3/d5/f3f 0 2024-01-17T23:35:54.546 INFO:tasks.workunit.client.0.smithi067.stdout:1/253: truncate d0/d7/f36 884367 0 2024-01-17T23:35:54.546 INFO:tasks.workunit.client.0.smithi067.stdout:6/237: mknod d6/d9/d3e/c4a 0 2024-01-17T23:35:54.585 INFO:tasks.workunit.client.0.smithi067.stdout:6/238: dwrite d6/fd [0,4194304] 0 2024-01-17T23:35:54.585 INFO:tasks.workunit.client.0.smithi067.stdout:6/239: fsync d6/d9/d3e/f3f 0 2024-01-17T23:35:54.640 INFO:tasks.workunit.client.0.smithi067.stdout:6/240: dwrite d6/f2b [0,4194304] 0 2024-01-17T23:35:54.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/219: creat d4/d16/f3f x:0 0 0 2024-01-17T23:35:54.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/220: fdatasync d4/de/f14 0 2024-01-17T23:35:54.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/221: chown d4/fd 15 1 2024-01-17T23:35:55.221 INFO:tasks.workunit.client.0.smithi067.stdout:3/288: creat d0/d13/d4a/f5c x:0 0 0 2024-01-17T23:35:55.222 INFO:tasks.workunit.client.0.smithi067.stdout:3/289: dread - d0/d34/d35/f50 zero size 2024-01-17T23:35:55.629 INFO:tasks.workunit.client.0.smithi067.stdout:5/187: mknod d10/d24/d25/c3a 0 2024-01-17T23:35:55.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/218: mkdir d3/d40 0 2024-01-17T23:35:55.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/219: write d3/d5/fc [800740,32081] 0 2024-01-17T23:35:55.849 INFO:tasks.workunit.client.0.smithi067.stdout:4/220: chown d3/d8/de/d20/c29 99 1 2024-01-17T23:35:55.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/221: dwrite d3/d8/d35/f3c [0,4194304] 0 2024-01-17T23:35:55.891 INFO:tasks.workunit.client.0.smithi067.stdout:4/222: write d3/d8/f1f [4174870,59450] 0 2024-01-17T23:35:55.892 INFO:tasks.workunit.client.0.smithi067.stdout:4/223: truncate d3/d5/f2e 2075875 0 2024-01-17T23:35:55.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/241: creat d6/d9/d1c/f4b x:0 0 0 2024-01-17T23:35:56.006 INFO:tasks.workunit.client.0.smithi067.stdout:0/238: getdents d3/d6/dd 0 2024-01-17T23:35:56.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/290: getdents d0/d34 0 2024-01-17T23:35:56.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/291: write d0/d13/f46 [872940,99968] 0 2024-01-17T23:35:56.489 INFO:tasks.workunit.client.0.smithi067.stdout:4/224: creat d3/d40/f41 x:0 0 0 2024-01-17T23:35:56.610 INFO:tasks.workunit.client.0.smithi067.stdout:6/242: mkdir d6/d9/d30/d4c 0 2024-01-17T23:35:56.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/239: creat d3/d6/dd/f69 x:0 0 0 2024-01-17T23:35:56.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/240: chown d3/d5/d1a/d1c/d1d/d2e/f33 1 1 2024-01-17T23:35:56.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/241: read d3/d5/f9 [1970074,28343] 0 2024-01-17T23:35:56.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/242: write d3/d6/dd/d43/f59 [425023,22351] 0 2024-01-17T23:35:56.874 INFO:tasks.workunit.client.0.smithi067.stdout:3/292: mknod d0/d12/d59/c5d 0 2024-01-17T23:35:56.915 INFO:tasks.workunit.client.0.smithi067.stdout:3/293: dwrite d0/d13/f46 [0,4194304] 0 2024-01-17T23:35:56.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/230: rename d6/db/d18/d38 to d6/db/d58 0 2024-01-17T23:35:57.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/225: link d3/d5/l32 d3/d26/d34/l42 0 2024-01-17T23:35:57.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/209: rename d3/da/f41 to d3/d15/f44 0 2024-01-17T23:35:57.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/210: chown d3/d6/d10 11936 1 2024-01-17T23:35:57.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/211: creat d3/d6/d2a/d34/f45 x:0 0 0 2024-01-17T23:35:58.588 INFO:tasks.workunit.client.0.smithi067.stdout:9/212: creat d3/d6/d10/f46 x:0 0 0 2024-01-17T23:35:59.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/254: sync 2024-01-17T23:35:59.094 INFO:tasks.workunit.client.0.smithi067.stdout:7/222: sync 2024-01-17T23:35:59.094 INFO:tasks.workunit.client.0.smithi067.stdout:5/188: sync 2024-01-17T23:35:59.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/255: chown d0/d32/d35/c42 46833277 1 2024-01-17T23:35:59.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/256: truncate d0/d7/d13/d2e/f46 80277 0 2024-01-17T23:35:59.141 INFO:tasks.workunit.client.0.smithi067.stdout:8/231: creat d6/d19/d22/d25/f59 x:0 0 0 2024-01-17T23:35:59.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/232: dwrite f4 [0,4194304] 0 2024-01-17T23:35:59.334 INFO:tasks.workunit.client.0.smithi067.stdout:7/223: mkdir d4/de/d40 0 2024-01-17T23:35:59.519 INFO:tasks.workunit.client.0.smithi067.stdout:5/189: mknod d10/d24/d25/c3b 0 2024-01-17T23:35:59.756 INFO:tasks.workunit.client.0.smithi067.stdout:1/257: truncate d0/d7/d13/f40 588023 0 2024-01-17T23:35:59.756 INFO:tasks.workunit.client.0.smithi067.stdout:8/233: rmdir d6/d26/d56 39 2024-01-17T23:35:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:8/234: dread d6/d19/d22/d25/d53/f16 [0,4194304] 0 2024-01-17T23:35:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:8/235: dread - d6/db/f55 zero size 2024-01-17T23:35:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:8/236: getdents d6/d19/d22/d25/d53/d54 0 2024-01-17T23:35:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:8/237: fdatasync d6/d19/f3a 0 2024-01-17T23:35:59.760 INFO:tasks.workunit.client.0.smithi067.stdout:8/238: fsync d6/d26/d56/f57 0 2024-01-17T23:35:59.765 INFO:tasks.workunit.client.0.smithi067.stdout:1/258: write d0/d7/f29 [1464142,117825] 0 2024-01-17T23:35:59.858 INFO:tasks.workunit.client.0.smithi067.stdout:7/224: dread d4/d25/d39/f34 [0,4194304] 0 2024-01-17T23:35:59.881 INFO:tasks.workunit.client.0.smithi067.stdout:6/243: sync 2024-01-17T23:35:59.905 INFO:tasks.workunit.client.0.smithi067.stdout:6/244: write d6/f2b [2622055,91581] 0 2024-01-17T23:35:59.915 INFO:tasks.workunit.client.0.smithi067.stdout:6/245: dread d6/f17 [0,4194304] 0 2024-01-17T23:35:59.915 INFO:tasks.workunit.client.0.smithi067.stdout:6/246: write d6/f2b [2462255,49320] 0 2024-01-17T23:35:59.971 INFO:tasks.workunit.client.0.smithi067.stdout:5/190: link d10/d24/c39 d10/c3c 0 2024-01-17T23:36:00.451 INFO:tasks.workunit.client.0.smithi067.stdout:8/239: mknod d6/d19/d22/d25/d53/d48/c5a 0 2024-01-17T23:36:00.451 INFO:tasks.workunit.client.0.smithi067.stdout:8/240: chown d6/db/d18/f23 7894 1 2024-01-17T23:36:00.451 INFO:tasks.workunit.client.0.smithi067.stdout:1/259: creat d0/d7/f4c x:0 0 0 2024-01-17T23:36:00.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/225: mkdir d4/de/d41 0 2024-01-17T23:36:00.918 INFO:tasks.workunit.client.0.smithi067.stdout:3/294: sync 2024-01-17T23:36:01.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/241: rmdir d6 39 2024-01-17T23:36:01.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/213: mkdir d3/d6/d47 0 2024-01-17T23:36:01.419 INFO:tasks.workunit.client.0.smithi067.stdout:9/214: dread d3/d6/f9 [0,4194304] 0 2024-01-17T23:36:01.450 INFO:tasks.workunit.client.0.smithi067.stdout:9/215: dwrite d3/d6/d11/f23 [4194304,4194304] 0 2024-01-17T23:36:01.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/255: rename d5/d6 to d5/d1f/d2a/d54 0 2024-01-17T23:36:01.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/256: readlink d5/d1f/d2a/d54/d25/l3a 0 2024-01-17T23:36:01.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/257: fdatasync d5/d1f/d2a/d54/d8/d32/f42 0 2024-01-17T23:36:01.847 INFO:tasks.workunit.client.0.smithi067.stdout:5/191: rmdir d10/d24 39 2024-01-17T23:36:02.089 INFO:tasks.workunit.client.0.smithi067.stdout:3/295: rmdir d0 39 2024-01-17T23:36:02.089 INFO:tasks.workunit.client.0.smithi067.stdout:3/296: creat d0/d17/f5e x:0 0 0 2024-01-17T23:36:02.089 INFO:tasks.workunit.client.0.smithi067.stdout:1/260: getdents d0/d7 0 2024-01-17T23:36:02.161 INFO:tasks.workunit.client.0.smithi067.stdout:0/243: rename d3/d5/d1a/d1c/d1d/f66 to d3/d5/d32/f6a 0 2024-01-17T23:36:02.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/258: mkdir d5/d1f/d2a/d55 0 2024-01-17T23:36:02.293 INFO:tasks.workunit.client.0.smithi067.stdout:2/259: dwrite d5/d2f/f4b [0,4194304] 0 2024-01-17T23:36:02.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/260: dread d5/d1f/f3c [0,4194304] 0 2024-01-17T23:36:02.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/261: write d5/d1f/d2a/d54/d8/d32/f42 [590577,54686] 0 2024-01-17T23:36:02.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/192: creat d10/f3d x:0 0 0 2024-01-17T23:36:02.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/193: chown d10/f14 16761082 1 2024-01-17T23:36:02.865 INFO:tasks.workunit.client.0.smithi067.stdout:3/297: truncate d0/d13/f19 1210122 0 2024-01-17T23:36:03.011 INFO:tasks.workunit.client.0.smithi067.stdout:1/261: mkdir d0/d7/d13/d3d/d48/d4d 0 2024-01-17T23:36:03.351 INFO:tasks.workunit.client.0.smithi067.stdout:4/226: rename d3/d5/f24 to d3/d26/f43 0 2024-01-17T23:36:03.700 INFO:tasks.workunit.client.0.smithi067.stdout:2/262: link d5/d1f/d2a/d54/d25/f36 d5/d1f/d2a/d54/d8/d4c/f56 0 2024-01-17T23:36:03.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/263: dread f4 [0,4194304] 0 2024-01-17T23:36:03.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/226: write d4/de/f3b [3130887,80735] 0 2024-01-17T23:36:03.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/227: read d4/f27 [802736,55944] 0 2024-01-17T23:36:03.872 INFO:tasks.workunit.client.0.smithi067.stdout:9/216: dwrite d3/f5 [0,4194304] 0 2024-01-17T23:36:03.872 INFO:tasks.workunit.client.0.smithi067.stdout:9/217: chown d3/d6/d2c 1 1 2024-01-17T23:36:04.130 INFO:tasks.workunit.client.0.smithi067.stdout:3/298: truncate d0/d12/d1b/f1d 2182189 0 2024-01-17T23:36:04.175 INFO:tasks.workunit.client.0.smithi067.stdout:3/299: dwrite d0/f11 [0,4194304] 0 2024-01-17T23:36:04.175 INFO:tasks.workunit.client.0.smithi067.stdout:3/300: dread - d0/d12/d1b/d4d/f5b zero size 2024-01-17T23:36:04.175 INFO:tasks.workunit.client.0.smithi067.stdout:3/301: creat d0/d17/f5f x:0 0 0 2024-01-17T23:36:04.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/262: symlink d0/d32/d35/l4e 0 2024-01-17T23:36:04.294 INFO:tasks.workunit.client.0.smithi067.stdout:1/263: dwrite d0/d7/d13/d2e/f4b [0,4194304] 0 2024-01-17T23:36:04.862 INFO:tasks.workunit.client.0.smithi067.stdout:2/264: link d5/d1f/l15 d5/d2f/l57 0 2024-01-17T23:36:04.882 INFO:tasks.workunit.client.0.smithi067.stdout:6/247: rename d6/d9/f2d to d6/d9/d30/f4d 0 2024-01-17T23:36:04.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/228: unlink d4/de/c1c 0 2024-01-17T23:36:04.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/229: fdatasync d4/d16/f1e 0 2024-01-17T23:36:04.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/230: dread - d4/d25/f38 zero size 2024-01-17T23:36:04.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/231: dwrite d4/d25/d39/f37 [0,4194304] 0 2024-01-17T23:36:04.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/232: truncate d4/f19 379029 0 2024-01-17T23:36:04.923 INFO:tasks.workunit.client.0.smithi067.stdout:7/233: chown d4/d25/d39/f30 107 1 2024-01-17T23:36:05.217 INFO:tasks.workunit.client.0.smithi067.stdout:3/302: mknod d0/d12/c60 0 2024-01-17T23:36:05.684 INFO:tasks.workunit.client.0.smithi067.stdout:8/242: rename d6/d19/d22/c3c to d6/d26/d56/c5b 0 2024-01-17T23:36:05.684 INFO:tasks.workunit.client.0.smithi067.stdout:8/243: write d6/db/f34 [424111,129773] 0 2024-01-17T23:36:05.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/244: dwrite d3/f1b [8388608,4194304] 0 2024-01-17T23:36:05.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/245: readlink d3/d5/l1f 0 2024-01-17T23:36:05.813 INFO:tasks.workunit.client.0.smithi067.stdout:6/248: creat d6/d18/d44/f4e x:0 0 0 2024-01-17T23:36:06.132 INFO:tasks.workunit.client.0.smithi067.stdout:7/234: creat d4/de/d40/f42 x:0 0 0 2024-01-17T23:36:06.132 INFO:tasks.workunit.client.0.smithi067.stdout:7/235: write d4/d25/d39/f30 [397726,11205] 0 2024-01-17T23:36:06.198 INFO:tasks.workunit.client.0.smithi067.stdout:9/218: mknod d3/d6/d11/c48 0 2024-01-17T23:36:06.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/219: dread d3/f26 [0,4194304] 0 2024-01-17T23:36:06.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/220: fdatasync d3/d6/d11/f1b 0 2024-01-17T23:36:06.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/221: readlink d3/d6/d10/l24 0 2024-01-17T23:36:06.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/222: read - d3/d6/d2a/f3f zero size 2024-01-17T23:36:06.438 INFO:tasks.workunit.client.0.smithi067.stdout:3/303: symlink d0/d13/d4a/d55/l61 0 2024-01-17T23:36:06.881 INFO:tasks.workunit.client.0.smithi067.stdout:8/244: symlink d6/d19/d22/d25/d53/d54/l5c 0 2024-01-17T23:36:06.881 INFO:tasks.workunit.client.0.smithi067.stdout:8/245: chown d6/l40 9304134 1 2024-01-17T23:36:06.895 INFO:tasks.workunit.client.0.smithi067.stdout:4/227: rename d3/c2f to d3/d8/de/d38/c44 0 2024-01-17T23:36:06.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/246: mkdir d3/d5/d1a/d1c/d4e/d6b 0 2024-01-17T23:36:06.912 INFO:tasks.workunit.client.0.smithi067.stdout:4/228: dread d3/f7 [0,4194304] 0 2024-01-17T23:36:08.424 INFO:tasks.workunit.client.0.smithi067.stdout:7/236: symlink d4/d25/d39/l43 0 2024-01-17T23:36:08.424 INFO:tasks.workunit.client.0.smithi067.stdout:7/237: write d4/d25/f33 [868069,50012] 0 2024-01-17T23:36:08.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/238: dwrite d4/de/f3e [0,4194304] 0 2024-01-17T23:36:08.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/239: write d4/f6 [4916434,101909] 0 2024-01-17T23:36:08.454 INFO:tasks.workunit.client.0.smithi067.stdout:7/240: dread d4/f18 [0,4194304] 0 2024-01-17T23:36:08.454 INFO:tasks.workunit.client.0.smithi067.stdout:7/241: stat d4/d16/c22 0 2024-01-17T23:36:08.478 INFO:tasks.workunit.client.0.smithi067.stdout:9/223: symlink d3/d6/d47/l49 0 2024-01-17T23:36:08.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/224: readlink d3/d6/l32 0 2024-01-17T23:36:08.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/225: chown d3/l39 98266 1 2024-01-17T23:36:08.937 INFO:tasks.workunit.client.0.smithi067.stdout:0/247: mknod d3/d5/d1a/d1c/d1d/d2e/c6c 0 2024-01-17T23:36:09.158 INFO:tasks.workunit.client.0.smithi067.stdout:5/194: rmdir d10 39 2024-01-17T23:36:09.159 INFO:tasks.workunit.client.0.smithi067.stdout:5/195: dread - d10/f3d zero size 2024-01-17T23:36:09.159 INFO:tasks.workunit.client.0.smithi067.stdout:5/196: dread - d10/d24/f36 zero size 2024-01-17T23:36:09.372 INFO:tasks.workunit.client.0.smithi067.stdout:1/264: write d0/d7/f36 [1351650,55474] 0 2024-01-17T23:36:09.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/265: dwrite d0/d7/d1c/f22 [0,4194304] 0 2024-01-17T23:36:09.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/266: write d0/d7/f36 [2274293,42642] 0 2024-01-17T23:36:09.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/267: truncate d0/d7/d13/d2e/f49 872508 0 2024-01-17T23:36:09.616 INFO:tasks.workunit.client.0.smithi067.stdout:9/226: creat d3/d25/d28/f4a x:0 0 0 2024-01-17T23:36:09.940 INFO:tasks.workunit.client.0.smithi067.stdout:4/229: rmdir d3/d8/de/d20 39 2024-01-17T23:36:10.191 INFO:tasks.workunit.client.0.smithi067.stdout:1/268: truncate d0/f5 3288765 0 2024-01-17T23:36:10.843 INFO:tasks.workunit.client.0.smithi067.stdout:8/246: rmdir d6/d26 39 2024-01-17T23:36:10.978 INFO:tasks.workunit.client.0.smithi067.stdout:8/247: truncate d6/db/d18/f28 1731999 0 2024-01-17T23:36:10.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/248: creat d6/d19/d22/d25/f5d x:0 0 0 2024-01-17T23:36:10.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/249: chown d6/d26/d56 55 1 2024-01-17T23:36:10.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/250: chown d6/d19/f2a 492 1 2024-01-17T23:36:10.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/251: creat d6/db/f5e x:0 0 0 2024-01-17T23:36:10.984 INFO:tasks.workunit.client.0.smithi067.stdout:8/252: dread d6/db/f34 [0,4194304] 0 2024-01-17T23:36:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/249: sync 2024-01-17T23:36:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/250: chown d6/d9/d3e 456058 1 2024-01-17T23:36:11.353 INFO:tasks.workunit.client.0.smithi067.stdout:7/242: truncate d4/f6 6943698 0 2024-01-17T23:36:11.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/248: dwrite d3/d5/d1a/d1c/f3e [0,4194304] 0 2024-01-17T23:36:11.411 INFO:tasks.workunit.client.0.smithi067.stdout:0/249: dwrite d3/d6/dd/d43/f59 [0,4194304] 0 2024-01-17T23:36:11.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/253: truncate d6/d26/f36 3217701 0 2024-01-17T23:36:11.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/251: truncate d6/f8 3775312 0 2024-01-17T23:36:11.920 INFO:tasks.workunit.client.0.smithi067.stdout:6/252: fsync d6/f17 0 2024-01-17T23:36:11.920 INFO:tasks.workunit.client.0.smithi067.stdout:6/253: creat d6/d18/f4f x:0 0 0 2024-01-17T23:36:12.048 INFO:tasks.workunit.client.0.smithi067.stdout:7/243: rmdir d4/d25/d39 39 2024-01-17T23:36:12.284 INFO:tasks.workunit.client.0.smithi067.stdout:2/265: rename d5/f30 to d5/d1f/d2a/d54/d8/f58 0 2024-01-17T23:36:12.366 INFO:tasks.workunit.client.0.smithi067.stdout:0/250: getdents d3/d6 0 2024-01-17T23:36:12.383 INFO:tasks.workunit.client.0.smithi067.stdout:0/251: dread d3/d5/d32/f6a [0,4194304] 0 2024-01-17T23:36:12.428 INFO:tasks.workunit.client.0.smithi067.stdout:0/252: dwrite d3/d6/dd/f4a [0,4194304] 0 2024-01-17T23:36:12.456 INFO:tasks.workunit.client.0.smithi067.stdout:0/253: dwrite d3/f47 [0,4194304] 0 2024-01-17T23:36:12.456 INFO:tasks.workunit.client.0.smithi067.stdout:0/254: write d3/d6/f2f [102540,90955] 0 2024-01-17T23:36:12.780 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:12.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:12.897 INFO:tasks.workunit.client.0.smithi067.stdout:8/254: mkdir d6/db/d58/d5f 0 2024-01-17T23:36:12.897 INFO:tasks.workunit.client.0.smithi067.stdout:8/255: write d6/db/d58/f3d [759505,89049] 0 2024-01-17T23:36:13.418 INFO:tasks.workunit.client.0.smithi067.stdout:7/244: link d4/d16/c22 d4/de/c44 0 2024-01-17T23:36:13.477 INFO:tasks.workunit.client.0.smithi067.stdout:2/266: creat d5/d1f/d2a/d54/d25/f59 x:0 0 0 2024-01-17T23:36:13.640 INFO:tasks.workunit.client.0.smithi067.stdout:3/304: rename d0/d12/d1b/f1f to d0/d13/d4a/d55/f62 0 2024-01-17T23:36:13.640 INFO:tasks.workunit.client.0.smithi067.stdout:3/305: dread - d0/d17/f5e zero size 2024-01-17T23:36:13.670 INFO:tasks.workunit.client.0.smithi067.stdout:3/306: dwrite d0/d13/d1a/f2e [0,4194304] 0 2024-01-17T23:36:13.901 INFO:tasks.workunit.client.0.smithi067.stdout:4/230: sync 2024-01-17T23:36:14.313 INFO:tasks.workunit.client.0.smithi067.stdout:0/255: creat d3/d6/f6d x:0 0 0 2024-01-17T23:36:14.726 INFO:tasks.workunit.client.0.smithi067.stdout:6/254: dwrite d6/d9/d1c/f2f [0,4194304] 0 2024-01-17T23:36:14.726 INFO:tasks.workunit.client.0.smithi067.stdout:6/255: creat d6/d18/d2e/f50 x:0 0 0 2024-01-17T23:36:14.847 INFO:tasks.workunit.client.0.smithi067.stdout:8/256: rmdir d6/d26 39 2024-01-17T23:36:14.847 INFO:tasks.workunit.client.0.smithi067.stdout:8/257: creat d6/db/d18/f60 x:0 0 0 2024-01-17T23:36:14.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/258: dwrite d6/d19/f2a [4194304,4194304] 0 2024-01-17T23:36:14.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/259: chown f4 276839092 1 2024-01-17T23:36:14.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/260: dread d6/d19/d22/d25/d53/f16 [0,4194304] 0 2024-01-17T23:36:14.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/261: readlink d6/d26/d3e/l46 0 2024-01-17T23:36:15.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/197: rename d10/c37 to d10/d24/d25/c3e 0 2024-01-17T23:36:15.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/307: creat d0/d34/f63 x:0 0 0 2024-01-17T23:36:15.463 INFO:tasks.workunit.client.0.smithi067.stdout:3/308: dwrite d0/d13/f16 [0,4194304] 0 2024-01-17T23:36:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/309: dwrite d0/f2a [0,4194304] 0 2024-01-17T23:36:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/310: chown d0/d13/d4a/f5c 28426312 1 2024-01-17T23:36:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/311: readlink d0/l56 0 2024-01-17T23:36:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/312: stat d0/c10 0 2024-01-17T23:36:15.537 INFO:tasks.workunit.client.0.smithi067.stdout:3/313: dwrite d0/d12/f21 [0,4194304] 0 2024-01-17T23:36:15.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/314: dwrite d0/d13/f33 [0,4194304] 0 2024-01-17T23:36:15.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/315: write d0/d34/d35/f50 [288499,128449] 0 2024-01-17T23:36:15.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/316: dread d0/d13/f33 [0,4194304] 0 2024-01-17T23:36:15.638 INFO:tasks.workunit.client.0.smithi067.stdout:4/231: link d3/d5/f3f d3/d26/d34/d3a/f45 0 2024-01-17T23:36:15.679 INFO:tasks.workunit.client.0.smithi067.stdout:4/232: dwrite d3/d26/f43 [4194304,4194304] 0 2024-01-17T23:36:15.708 INFO:tasks.workunit.client.0.smithi067.stdout:4/233: write d3/d8/d35/f3c [2815596,49774] 0 2024-01-17T23:36:15.708 INFO:tasks.workunit.client.0.smithi067.stdout:4/234: read d3/d8/d35/f3c [2892651,27629] 0 2024-01-17T23:36:15.740 INFO:tasks.workunit.client.0.smithi067.stdout:4/235: dwrite d3/d26/f43 [0,4194304] 0 2024-01-17T23:36:15.744 INFO:tasks.workunit.client.0.smithi067.stdout:0/256: mkdir d3/d6/dd/d61/d6e 0 2024-01-17T23:36:16.064 INFO:tasks.workunit.client.0.smithi067.stdout:6/256: mkdir d6/d18/d44/d51 0 2024-01-17T23:36:16.437 INFO:tasks.workunit.client.0.smithi067.stdout:8/262: link d6/d19/d22/c50 d6/db/d58/c61 0 2024-01-17T23:36:16.437 INFO:tasks.workunit.client.0.smithi067.stdout:8/263: dread - d6/db/d58/f39 zero size 2024-01-17T23:36:16.575 INFO:tasks.workunit.client.0.smithi067.stdout:9/227: rename d3/d6/d11/c48 to d3/d6/d2a/c4b 0 2024-01-17T23:36:16.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/198: stat d10/d24/c31 0 2024-01-17T23:36:16.703 INFO:tasks.workunit.client.0.smithi067.stdout:5/199: write d10/f1a [5397373,122574] 0 2024-01-17T23:36:16.720 INFO:tasks.workunit.client.0.smithi067.stdout:5/200: dread d10/f20 [0,4194304] 0 2024-01-17T23:36:16.749 INFO:tasks.workunit.client.0.smithi067.stdout:5/201: dwrite d10/f11 [0,4194304] 0 2024-01-17T23:36:17.011 INFO:tasks.workunit.client.0.smithi067.stdout:3/317: symlink d0/d13/d1a/d38/l64 0 2024-01-17T23:36:17.525 INFO:tasks.workunit.client.0.smithi067.stdout:7/245: dwrite d4/f18 [0,4194304] 0 2024-01-17T23:36:17.533 INFO:tasks.workunit.client.0.smithi067.stdout:7/246: chown d4/f8 3 1 2024-01-17T23:36:17.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/267: sync 2024-01-17T23:36:18.008 INFO:tasks.workunit.client.0.smithi067.stdout:0/257: creat d3/d5/d1a/d1c/d4e/f6f x:0 0 0 2024-01-17T23:36:18.025 INFO:tasks.workunit.client.0.smithi067.stdout:0/258: dread d3/d5/d1a/f44 [0,4194304] 0 2024-01-17T23:36:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/264: mknod d6/d19/c62 0 2024-01-17T23:36:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:6/257: truncate d6/f2b 4134413 0 2024-01-17T23:36:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/265: creat d6/db/f63 x:0 0 0 2024-01-17T23:36:18.452 INFO:tasks.workunit.client.0.smithi067.stdout:1/269: rename d0/d32/l33 to d0/d7/d13/d3a/d45/l4f 0 2024-01-17T23:36:18.452 INFO:tasks.workunit.client.0.smithi067.stdout:1/270: write d0/d7/f4c [457250,81050] 0 2024-01-17T23:36:18.634 INFO:tasks.workunit.client.0.smithi067.stdout:9/228: getdents d3/d6 0 2024-01-17T23:36:18.655 INFO:tasks.workunit.client.0.smithi067.stdout:9/229: write d3/d6/d2a/d34/f36 [1045502,24768] 0 2024-01-17T23:36:18.952 INFO:tasks.workunit.client.0.smithi067.stdout:5/202: mkdir d10/d3f 0 2024-01-17T23:36:19.204 INFO:tasks.workunit.client.0.smithi067.stdout:7/247: symlink d4/d25/l45 0 2024-01-17T23:36:19.204 INFO:tasks.workunit.client.0.smithi067.stdout:7/248: write d4/f6 [5570,96535] 0 2024-01-17T23:36:19.395 INFO:tasks.workunit.client.0.smithi067.stdout:2/268: symlink d5/d1f/d35/l5a 0 2024-01-17T23:36:19.395 INFO:tasks.workunit.client.0.smithi067.stdout:2/269: rename d5/d1f to d5/d1f/d2a/d55/d5b 22 2024-01-17T23:36:19.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/270: creat d5/d1f/d35/f5c x:0 0 0 2024-01-17T23:36:19.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/271: dread - d5/d1f/d35/f3b zero size 2024-01-17T23:36:19.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/236: mknod d3/d8/d35/c46 0 2024-01-17T23:36:19.653 INFO:tasks.workunit.client.0.smithi067.stdout:0/259: mknod d3/d5/d1a/d1c/d4d/c70 0 2024-01-17T23:36:19.653 INFO:tasks.workunit.client.0.smithi067.stdout:0/260: chown d3/d6/dd/d61/d6e 162 1 2024-01-17T23:36:19.888 INFO:tasks.workunit.client.0.smithi067.stdout:6/258: mknod d6/d9/d3e/c52 0 2024-01-17T23:36:19.888 INFO:tasks.workunit.client.0.smithi067.stdout:6/259: chown d6/d9/d3e/c52 1 1 2024-01-17T23:36:20.613 INFO:tasks.workunit.client.0.smithi067.stdout:1/271: creat d0/d7/d13/f50 x:0 0 0 2024-01-17T23:36:20.613 INFO:tasks.workunit.client.0.smithi067.stdout:1/272: dread - d0/d7/d13/d3a/d3e/f4a zero size 2024-01-17T23:36:20.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/203: mkdir d10/d40 0 2024-01-17T23:36:20.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/204: read - d10/d24/f2d zero size 2024-01-17T23:36:20.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/205: dread f9 [0,4194304] 0 2024-01-17T23:36:20.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/206: stat d10/d3f 0 2024-01-17T23:36:20.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/207: chown d10/f1f 195422677 1 2024-01-17T23:36:20.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/208: chown d10/d24/d25/c33 9086363 1 2024-01-17T23:36:20.973 INFO:tasks.workunit.client.0.smithi067.stdout:5/209: chown d10/f20 3511 1 2024-01-17T23:36:20.994 INFO:tasks.workunit.client.0.smithi067.stdout:5/210: write d10/f11 [2828119,75352] 0 2024-01-17T23:36:20.994 INFO:tasks.workunit.client.0.smithi067.stdout:5/211: write d10/d24/d25/f2b [232892,94375] 0 2024-01-17T23:36:20.994 INFO:tasks.workunit.client.0.smithi067.stdout:5/212: fsync d10/f14 0 2024-01-17T23:36:20.995 INFO:tasks.workunit.client.0.smithi067.stdout:5/213: write d10/f19 [585178,83254] 0 2024-01-17T23:36:20.995 INFO:tasks.workunit.client.0.smithi067.stdout:5/214: write d10/f11 [2743652,52323] 0 2024-01-17T23:36:21.024 INFO:tasks.workunit.client.0.smithi067.stdout:3/318: mkdir d0/d34/d35/d65 0 2024-01-17T23:36:21.183 INFO:tasks.workunit.client.0.smithi067.stdout:7/249: mkdir d4/d25/d39/d46 0 2024-01-17T23:36:21.805 INFO:tasks.workunit.client.0.smithi067.stdout:2/272: getdents d5/d1f 0 2024-01-17T23:36:21.806 INFO:tasks.workunit.client.0.smithi067.stdout:8/266: sync 2024-01-17T23:36:21.818 INFO:tasks.workunit.client.0.smithi067.stdout:2/273: write d5/d1f/d2a/d54/f11 [2278325,94079] 0 2024-01-17T23:36:21.827 INFO:tasks.workunit.client.0.smithi067.stdout:2/274: dread f4 [0,4194304] 0 2024-01-17T23:36:21.963 INFO:tasks.workunit.client.0.smithi067.stdout:4/237: rename d3/d5/f2a to d3/d26/d34/d3a/f47 0 2024-01-17T23:36:21.963 INFO:tasks.workunit.client.0.smithi067.stdout:0/261: link d3/d5/d32/f41 d3/d5/d1a/f71 0 2024-01-17T23:36:22.003 INFO:tasks.workunit.client.0.smithi067.stdout:1/273: truncate d0/d7/d13/d2e/f46 286714 0 2024-01-17T23:36:22.003 INFO:tasks.workunit.client.0.smithi067.stdout:9/230: symlink d3/d6/d11/l4c 0 2024-01-17T23:36:22.004 INFO:tasks.workunit.client.0.smithi067.stdout:7/250: mknod d4/d16/c47 0 2024-01-17T23:36:22.004 INFO:tasks.workunit.client.0.smithi067.stdout:7/251: fsync d4/de/f2b 0 2024-01-17T23:36:22.004 INFO:tasks.workunit.client.0.smithi067.stdout:7/252: write d4/fd [2036579,44626] 0 2024-01-17T23:36:22.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/231: dwrite d3/d6/d2c/f43 [0,4194304] 0 2024-01-17T23:36:22.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/260: sync 2024-01-17T23:36:22.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/275: symlink d5/d1f/d2a/d55/l5d 0 2024-01-17T23:36:22.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/276: chown d5/d2f/l47 107785993 1 2024-01-17T23:36:22.334 INFO:tasks.workunit.client.0.smithi067.stdout:2/277: read d5/d1f/d2a/d54/d8/d4c/f56 [4104816,29769] 0 2024-01-17T23:36:22.363 INFO:tasks.workunit.client.0.smithi067.stdout:2/278: dwrite d5/d1f/d2a/d54/d8/d32/f42 [0,4194304] 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/215: rename d10/d24/d25/f32 to d10/d3f/f41 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:0/262: symlink d3/d5/d1a/d1c/d4d/l72 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:4/238: creat d3/d8/d35/d36/f48 x:0 0 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:0/263: creat d3/d5/d32/f73 x:0 0 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/274: creat d0/d7/d13/d3a/f51 x:0 0 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/275: creat d0/d7/d13/d2e/f52 x:0 0 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:0/264: write d3/d5/d32/f6a [1215016,102717] 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:7/253: mknod d4/de/d41/c48 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:9/232: unlink d3/d6/d2a/d34/l3c 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:7/254: write f1 [4358748,57627] 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:7/255: fdatasync d4/f18 0 2024-01-17T23:36:22.820 INFO:tasks.workunit.client.0.smithi067.stdout:9/233: write d3/d6/d2a/d34/f3e [93813,117962] 0 2024-01-17T23:36:22.859 INFO:tasks.workunit.client.0.smithi067.stdout:4/239: dwrite d3/d40/f41 [0,4194304] 0 2024-01-17T23:36:22.860 INFO:tasks.workunit.client.0.smithi067.stdout:4/240: fdatasync d3/d8/d35/d36/f48 0 2024-01-17T23:36:22.869 INFO:tasks.workunit.client.0.smithi067.stdout:9/234: dwrite d3/d6/d2e/f3d [0,4194304] 0 2024-01-17T23:36:23.167 INFO:tasks.workunit.client.0.smithi067.stdout:2/279: symlink d5/d1f/d2a/d54/d8/d32/d33/l5e 0 2024-01-17T23:36:23.918 INFO:tasks.workunit.client.0.smithi067.stdout:0/265: link d3/d5/d1a/d1c/c23 d3/c74 0 2024-01-17T23:36:24.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/235: creat d3/d6/d2a/d34/d42/f4d x:0 0 0 2024-01-17T23:36:25.144 INFO:tasks.workunit.client.0.smithi067.stdout:2/280: creat d5/d1f/d2a/d54/d8/d4c/f5f x:0 0 0 2024-01-17T23:36:25.144 INFO:tasks.workunit.client.0.smithi067.stdout:2/281: readlink d5/l53 0 2024-01-17T23:36:25.155 INFO:tasks.workunit.client.0.smithi067.stdout:2/282: dread f4 [0,4194304] 0 2024-01-17T23:36:25.155 INFO:tasks.workunit.client.0.smithi067.stdout:2/283: truncate d5/d1f/d2a/d54/d8/d4c/f5f 615309 0 2024-01-17T23:36:25.156 INFO:tasks.workunit.client.0.smithi067.stdout:2/284: dread d5/d1f/f43 [0,4194304] 0 2024-01-17T23:36:25.423 INFO:tasks.workunit.client.0.smithi067.stdout:1/276: truncate d0/d7/d13/d2e/f46 1073240 0 2024-01-17T23:36:25.518 INFO:tasks.workunit.client.0.smithi067.stdout:9/236: mknod d3/d6/d2a/d34/d42/c4e 0 2024-01-17T23:36:25.518 INFO:tasks.workunit.client.0.smithi067.stdout:9/237: truncate d3/d25/d28/f4a 680623 0 2024-01-17T23:36:26.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/319: rename d0/d13/f46 to d0/d12/d59/f66 0 2024-01-17T23:36:26.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/320: write d0/d13/d1a/d38/f53 [1009559,118079] 0 2024-01-17T23:36:26.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/321: write d0/f11 [4502522,50690] 0 2024-01-17T23:36:27.221 INFO:tasks.workunit.client.0.smithi067.stdout:9/238: link f0 d3/d6/d11/f4f 0 2024-01-17T23:36:27.221 INFO:tasks.workunit.client.0.smithi067.stdout:9/239: write d3/d6/d10/f37 [743850,103032] 0 2024-01-17T23:36:27.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/240: dread d3/d6/d2e/f3d [0,4194304] 0 2024-01-17T23:36:27.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/267: rename d6/d26/d3e/l46 to d6/d26/l64 0 2024-01-17T23:36:27.273 INFO:tasks.workunit.client.0.smithi067.stdout:6/261: rename d6/d9 to d6/d9/d1c/d1e/d53 22 2024-01-17T23:36:27.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/268: dread - d6/d19/d22/f4f zero size 2024-01-17T23:36:27.293 INFO:tasks.workunit.client.0.smithi067.stdout:4/241: unlink d3/l19 0 2024-01-17T23:36:27.360 INFO:tasks.workunit.client.0.smithi067.stdout:1/277: dwrite d0/d7/f29 [0,4194304] 0 2024-01-17T23:36:27.394 INFO:tasks.workunit.client.0.smithi067.stdout:1/278: dwrite d0/d7/d13/d2e/f4b [0,4194304] 0 2024-01-17T23:36:27.780 INFO:tasks.workunit.client.0.smithi067.stdout:3/322: mknod d0/c67 0 2024-01-17T23:36:27.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/241: rmdir d3/d6/d2e 39 2024-01-17T23:36:27.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/242: fdatasync d3/d15/f44 0 2024-01-17T23:36:27.787 INFO:tasks.workunit.client.0.smithi067.stdout:5/216: rename d10/d40 to d10/d3f/d42 0 2024-01-17T23:36:27.787 INFO:tasks.workunit.client.0.smithi067.stdout:6/262: creat d6/d9/d30/d4c/f54 x:0 0 0 2024-01-17T23:36:27.787 INFO:tasks.workunit.client.0.smithi067.stdout:6/263: chown d6/d18/f4f 6 1 2024-01-17T23:36:27.796 INFO:tasks.workunit.client.0.smithi067.stdout:1/279: unlink d0/d7/d13/l2c 0 2024-01-17T23:36:27.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/323: dread d0/f14 [0,4194304] 0 2024-01-17T23:36:27.804 INFO:tasks.workunit.client.0.smithi067.stdout:6/264: dread d6/d9/d1c/f2f [0,4194304] 0 2024-01-17T23:36:27.840 INFO:tasks.workunit.client.0.smithi067.stdout:6/265: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:36:27.840 INFO:tasks.workunit.client.0.smithi067.stdout:6/266: chown d6/d9/d1c/d1e/d43/l47 86102 1 2024-01-17T23:36:28.006 INFO:tasks.workunit.client.0.smithi067.stdout:2/285: sync 2024-01-17T23:36:28.027 INFO:tasks.workunit.client.0.smithi067.stdout:8/269: write f4 [1218083,113648] 0 2024-01-17T23:36:28.027 INFO:tasks.workunit.client.0.smithi067.stdout:8/270: write d6/db/f55 [880504,52247] 0 2024-01-17T23:36:28.027 INFO:tasks.workunit.client.0.smithi067.stdout:8/271: chown d6/d19/d22/d25/c49 197259 1 2024-01-17T23:36:28.594 INFO:tasks.workunit.client.0.smithi067.stdout:5/217: mkdir d10/d3f/d43 0 2024-01-17T23:36:28.761 INFO:tasks.workunit.client.0.smithi067.stdout:7/256: rename d4/d25/d39/f37 to d4/d25/f49 0 2024-01-17T23:36:28.761 INFO:tasks.workunit.client.0.smithi067.stdout:7/257: fsync d4/d16/f3f 0 2024-01-17T23:36:29.247 INFO:tasks.workunit.client.0.smithi067.stdout:4/242: getdents d3/d26 0 2024-01-17T23:36:29.275 INFO:tasks.workunit.client.0.smithi067.stdout:4/243: dwrite d3/d8/d35/d36/f48 [0,4194304] 0 2024-01-17T23:36:29.288 INFO:tasks.workunit.client.0.smithi067.stdout:4/244: dread d3/d26/f33 [0,4194304] 0 2024-01-17T23:36:29.288 INFO:tasks.workunit.client.0.smithi067.stdout:4/245: write d3/d26/d34/d3a/f45 [403714,29159] 0 2024-01-17T23:36:29.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/246: dread d3/f7 [0,4194304] 0 2024-01-17T23:36:29.352 INFO:tasks.workunit.client.0.smithi067.stdout:1/280: symlink d0/d7/d13/d3a/d45/l53 0 2024-01-17T23:36:29.352 INFO:tasks.workunit.client.0.smithi067.stdout:1/281: truncate d0/d7/d13/d2e/f52 394865 0 2024-01-17T23:36:29.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/267: dread d6/ff [0,4194304] 0 2024-01-17T23:36:29.928 INFO:tasks.workunit.client.0.smithi067.stdout:2/286: symlink d5/d1f/d2a/d54/d39/l60 0 2024-01-17T23:36:30.291 INFO:tasks.workunit.client.0.smithi067.stdout:5/218: mknod d10/d3f/d43/c44 0 2024-01-17T23:36:30.472 INFO:tasks.workunit.client.0.smithi067.stdout:0/266: rename d3/d6/dd/d61 to d3/d75 0 2024-01-17T23:36:30.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/324: write d0/d13/f19 [1438332,88166] 0 2024-01-17T23:36:30.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/325: fdatasync d0/d12/d1b/f54 0 2024-01-17T23:36:30.838 INFO:tasks.workunit.client.0.smithi067.stdout:7/258: unlink d4/de/c1a 0 2024-01-17T23:36:30.838 INFO:tasks.workunit.client.0.smithi067.stdout:9/243: sync 2024-01-17T23:36:30.838 INFO:tasks.workunit.client.0.smithi067.stdout:9/244: chown d3/da/l14 18423 1 2024-01-17T23:36:30.838 INFO:tasks.workunit.client.0.smithi067.stdout:7/259: fdatasync d4/f27 0 2024-01-17T23:36:31.020 INFO:tasks.workunit.client.0.smithi067.stdout:4/247: mknod d3/d5/c49 0 2024-01-17T23:36:31.023 INFO:tasks.workunit.client.0.smithi067.stdout:4/248: read d3/d8/de/f14 [379688,126492] 0 2024-01-17T23:36:31.036 INFO:tasks.workunit.client.0.smithi067.stdout:4/249: read d3/f7 [2211609,20606] 0 2024-01-17T23:36:31.037 INFO:tasks.workunit.client.0.smithi067.stdout:4/250: write d3/d26/d34/d3a/f47 [4559501,43048] 0 2024-01-17T23:36:31.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/282: creat d0/d7/d1c/f54 x:0 0 0 2024-01-17T23:36:31.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/283: fsync d0/d7/d13/d2e/f46 0 2024-01-17T23:36:31.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/284: chown d0/d7/d13/d3d/d48 202874979 1 2024-01-17T23:36:31.199 INFO:tasks.workunit.client.0.smithi067.stdout:1/285: dread d0/d7/d13/d2e/f4b [0,4194304] 0 2024-01-17T23:36:31.336 INFO:tasks.workunit.client.0.smithi067.stdout:6/268: symlink d6/d18/d44/l55 0 2024-01-17T23:36:31.558 INFO:tasks.workunit.client.0.smithi067.stdout:2/287: unlink d5/fa 0 2024-01-17T23:36:31.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/219: link d10/d24/c34 d10/d3f/d42/c45 0 2024-01-17T23:36:31.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/267: rmdir d3/d75/d6e 0 2024-01-17T23:36:32.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/326: symlink d0/d12/d59/l68 0 2024-01-17T23:36:32.184 INFO:tasks.workunit.client.0.smithi067.stdout:7/260: symlink d4/de/d41/l4a 0 2024-01-17T23:36:32.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/327: chown d0/d34/d35/d57 210 1 2024-01-17T23:36:32.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/245: truncate d3/d25/d28/f4a 1583075 0 2024-01-17T23:36:32.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/246: dwrite f0 [0,4194304] 0 2024-01-17T23:36:32.540 INFO:tasks.workunit.client.0.smithi067.stdout:1/286: link d0/d7/f29 d0/d7/f55 0 2024-01-17T23:36:32.540 INFO:tasks.workunit.client.0.smithi067.stdout:1/287: chown d0/d7/d13/d2e 8611917 1 2024-01-17T23:36:32.542 INFO:tasks.workunit.client.0.smithi067.stdout:1/288: dread d0/d7/d13/d2e/f52 [0,4194304] 0 2024-01-17T23:36:32.542 INFO:tasks.workunit.client.0.smithi067.stdout:1/289: write d0/d7/f29 [4609130,95123] 0 2024-01-17T23:36:32.744 INFO:tasks.workunit.client.0.smithi067.stdout:6/269: link d6/c3c d6/d18/d44/d51/c56 0 2024-01-17T23:36:32.863 INFO:tasks.workunit.client.0.smithi067.stdout:2/288: mkdir d5/d1f/d16/d61 0 2024-01-17T23:36:33.120 INFO:tasks.workunit.client.0.smithi067.stdout:0/268: creat d3/d6/f76 x:0 0 0 2024-01-17T23:36:33.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/328: mkdir d0/d17/d69 0 2024-01-17T23:36:33.780 INFO:tasks.workunit.client.0.smithi067.stdout:3/329: fsync d0/d17/f5f 0 2024-01-17T23:36:33.947 INFO:tasks.workunit.client.0.smithi067.stdout:1/290: symlink d0/d2d/d31/l56 0 2024-01-17T23:36:34.153 INFO:tasks.workunit.client.0.smithi067.stdout:6/270: mknod d6/d9/d1c/c57 0 2024-01-17T23:36:34.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/289: link d5/d1f/d2a/d54/l31 d5/d1f/d16/l62 0 2024-01-17T23:36:34.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/290: stat d5/d1f/c10 0 2024-01-17T23:36:34.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/291: creat d5/d1f/d35/f63 x:0 0 0 2024-01-17T23:36:34.354 INFO:tasks.workunit.client.0.smithi067.stdout:2/292: dwrite d5/d1f/d2a/f52 [0,4194304] 0 2024-01-17T23:36:35.095 INFO:tasks.workunit.client.0.smithi067.stdout:5/220: mkdir d10/d24/d46 0 2024-01-17T23:36:35.095 INFO:tasks.workunit.client.0.smithi067.stdout:0/269: stat d3/d6/dd/d43/l49 0 2024-01-17T23:36:35.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/221: dwrite d10/f14 [0,4194304] 0 2024-01-17T23:36:35.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/222: truncate d10/d24/f2d 410309 0 2024-01-17T23:36:35.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/223: write fd [5032215,64305] 0 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/272: rename d6/db/d18 to d6/d19/d22/d25/d53/d65 0 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/261: mkdir d4/d4b 0 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/273: write d6/d19/d22/d25/f59 [121139,101390] 0 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/262: creat d4/de/f4c x:0 0 0 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/263: chown d4/d25/f38 259 1 2024-01-17T23:36:35.305 INFO:tasks.workunit.client.0.smithi067.stdout:7/264: truncate d4/d25/f2c 717897 0 2024-01-17T23:36:35.306 INFO:tasks.workunit.client.0.smithi067.stdout:3/330: mknod d0/d17/c6a 0 2024-01-17T23:36:35.400 INFO:tasks.workunit.client.0.smithi067.stdout:1/291: unlink d0/d7/d1c/c2b 0 2024-01-17T23:36:35.404 INFO:tasks.workunit.client.0.smithi067.stdout:1/292: write d0/d7/f20 [143981,130131] 0 2024-01-17T23:36:35.449 INFO:tasks.workunit.client.0.smithi067.stdout:1/293: dwrite d0/d7/d13/d2e/f4b [0,4194304] 0 2024-01-17T23:36:35.629 INFO:tasks.workunit.client.0.smithi067.stdout:6/271: mkdir d6/d9/d30/d58 0 2024-01-17T23:36:36.135 INFO:tasks.workunit.client.0.smithi067.stdout:0/270: mknod d3/d5/d1a/d1c/d1d/d2e/d5a/c77 0 2024-01-17T23:36:36.135 INFO:tasks.workunit.client.0.smithi067.stdout:0/271: creat d3/d5/d32/f78 x:0 0 0 2024-01-17T23:36:36.145 INFO:tasks.workunit.client.0.smithi067.stdout:0/272: write d3/d5/d1a/f2c [538197,126109] 0 2024-01-17T23:36:36.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/224: link d10/f2c d10/d3f/d42/f47 0 2024-01-17T23:36:36.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/251: rename d3/d8/c1a to d3/d26/d34/d3a/c4a 0 2024-01-17T23:36:36.671 INFO:tasks.workunit.client.0.smithi067.stdout:4/252: write d3/d26/f33 [3625876,128661] 0 2024-01-17T23:36:36.696 INFO:tasks.workunit.client.0.smithi067.stdout:4/253: dwrite d3/d26/d34/d3a/f45 [0,4194304] 0 2024-01-17T23:36:36.697 INFO:tasks.workunit.client.0.smithi067.stdout:4/254: chown d3/d8/de/c2d 98 1 2024-01-17T23:36:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/274: mknod d6/d26/c66 0 2024-01-17T23:36:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/275: chown d6/d19/d22/d25/f59 285 1 2024-01-17T23:36:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/276: chown d6/d19/d22/d25/d53/d54/l5c 182790 1 2024-01-17T23:36:37.088 INFO:tasks.workunit.client.0.smithi067.stdout:7/265: rename d4/de/f2b to d4/de/f4d 0 2024-01-17T23:36:37.089 INFO:tasks.workunit.client.0.smithi067.stdout:3/331: getdents d0 0 2024-01-17T23:36:37.089 INFO:tasks.workunit.client.0.smithi067.stdout:3/332: chown d0/d37/c44 2716650 1 2024-01-17T23:36:37.106 INFO:tasks.workunit.client.0.smithi067.stdout:7/266: dread d4/fb [0,4194304] 0 2024-01-17T23:36:37.106 INFO:tasks.workunit.client.0.smithi067.stdout:7/267: creat d4/d16/f4e x:0 0 0 2024-01-17T23:36:37.324 INFO:tasks.workunit.client.0.smithi067.stdout:1/294: unlink d0/d32/d35/c42 0 2024-01-17T23:36:37.386 INFO:tasks.workunit.client.0.smithi067.stdout:6/272: symlink d6/d9/d30/d58/l59 0 2024-01-17T23:36:37.387 INFO:tasks.workunit.client.0.smithi067.stdout:6/273: stat d6/d18/f2a 0 2024-01-17T23:36:37.400 INFO:tasks.workunit.client.0.smithi067.stdout:6/274: write d6/d18/d44/f48 [684232,41337] 0 2024-01-17T23:36:37.414 INFO:tasks.workunit.client.0.smithi067.stdout:6/275: dread d6/d18/f33 [0,4194304] 0 2024-01-17T23:36:37.414 INFO:tasks.workunit.client.0.smithi067.stdout:6/276: creat d6/d9/d30/f5a x:0 0 0 2024-01-17T23:36:37.667 INFO:tasks.workunit.client.0.smithi067.stdout:0/273: rmdir d3/d5/d1a/d1c/d1d/d2e/d5a 39 2024-01-17T23:36:38.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/255: creat d3/d26/d34/d3a/f4b x:0 0 0 2024-01-17T23:36:38.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/277: mknod d6/d19/d22/d25/d53/d48/c67 0 2024-01-17T23:36:38.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/278: read - d6/db/d58/f39 zero size 2024-01-17T23:36:38.513 INFO:tasks.workunit.client.0.smithi067.stdout:3/333: mknod d0/c6b 0 2024-01-17T23:36:38.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/268: symlink d4/d25/l4f 0 2024-01-17T23:36:38.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/269: read - d4/d16/f29 zero size 2024-01-17T23:36:38.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/295: dread d0/d7/d13/d2e/f49 [0,4194304] 0 2024-01-17T23:36:38.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/296: creat d0/d7/d13/d3a/d3e/f57 x:0 0 0 2024-01-17T23:36:38.908 INFO:tasks.workunit.client.0.smithi067.stdout:6/277: mknod d6/d9/d1c/c5b 0 2024-01-17T23:36:38.909 INFO:tasks.workunit.client.0.smithi067.stdout:6/278: dread - d6/d18/d44/f4e zero size 2024-01-17T23:36:39.047 INFO:tasks.workunit.client.0.smithi067.stdout:0/274: mknod d3/d6/c79 0 2024-01-17T23:36:39.048 INFO:tasks.workunit.client.0.smithi067.stdout:0/275: creat d3/d5/d32/f7a x:0 0 0 2024-01-17T23:36:39.294 INFO:tasks.workunit.client.0.smithi067.stdout:8/279: mknod d6/d26/d3e/c68 0 2024-01-17T23:36:39.559 INFO:tasks.workunit.client.0.smithi067.stdout:3/334: fdatasync d0/d13/d1a/d38/f47 0 2024-01-17T23:36:39.824 INFO:tasks.workunit.client.0.smithi067.stdout:7/270: creat d4/d25/d39/d46/f50 x:0 0 0 2024-01-17T23:36:39.853 INFO:tasks.workunit.client.0.smithi067.stdout:7/271: dwrite d4/d16/f3f [0,4194304] 0 2024-01-17T23:36:39.853 INFO:tasks.workunit.client.0.smithi067.stdout:7/272: write d4/f8 [1236494,80404] 0 2024-01-17T23:36:39.865 INFO:tasks.workunit.client.0.smithi067.stdout:7/273: dread d4/d16/f1e [4194304,4194304] 0 2024-01-17T23:36:39.865 INFO:tasks.workunit.client.0.smithi067.stdout:7/274: creat d4/d16/f51 x:0 0 0 2024-01-17T23:36:40.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/279: mknod d6/d9/d1c/d1e/c5c 0 2024-01-17T23:36:41.101 INFO:tasks.workunit.client.0.smithi067.stdout:5/225: dwrite d10/f16 [4194304,4194304] 0 2024-01-17T23:36:41.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/275: symlink d4/de/d41/l52 0 2024-01-17T23:36:41.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/276: readlink d4/d16/l21 0 2024-01-17T23:36:41.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/277: write d4/d16/f29 [835530,9247] 0 2024-01-17T23:36:41.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/278: dread - d4/f26 zero size 2024-01-17T23:36:42.115 INFO:tasks.workunit.client.0.smithi067.stdout:5/226: symlink d10/d3f/d42/l48 0 2024-01-17T23:36:42.287 INFO:tasks.workunit.client.0.smithi067.stdout:9/247: rename d3/d6/d2c to d3/d6/d11/d50 0 2024-01-17T23:36:42.287 INFO:tasks.workunit.client.0.smithi067.stdout:9/248: stat d3/d6/d47 0 2024-01-17T23:36:42.287 INFO:tasks.workunit.client.0.smithi067.stdout:9/249: read d3/d6/d2a/d34/f36 [2146079,130455] 0 2024-01-17T23:36:42.495 INFO:tasks.workunit.client.0.smithi067.stdout:3/335: symlink d0/d12/l6c 0 2024-01-17T23:36:42.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/279: mknod d4/de/c53 0 2024-01-17T23:36:42.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/280: chown d4/d25/d39/d46 61927 1 2024-01-17T23:36:42.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/281: write d4/d16/f1e [2644477,3600] 0 2024-01-17T23:36:42.529 INFO:tasks.workunit.client.0.smithi067.stdout:4/256: dwrite d3/d5/f2e [0,4194304] 0 2024-01-17T23:36:42.562 INFO:tasks.workunit.client.0.smithi067.stdout:4/257: dwrite d3/d26/f43 [4194304,4194304] 0 2024-01-17T23:36:42.563 INFO:tasks.workunit.client.0.smithi067.stdout:4/258: stat d3/d8/d35/f3c 0 2024-01-17T23:36:42.596 INFO:tasks.workunit.client.0.smithi067.stdout:5/227: rmdir d10/d3f/d43 39 2024-01-17T23:36:42.596 INFO:tasks.workunit.client.0.smithi067.stdout:5/228: fsync d10/f20 0 2024-01-17T23:36:42.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/229: dread d10/f2c [0,4194304] 0 2024-01-17T23:36:42.886 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:42.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:36:43.011 INFO:tasks.workunit.client.0.smithi067.stdout:7/282: link d4/fd d4/d25/d39/f54 0 2024-01-17T23:36:43.011 INFO:tasks.workunit.client.0.smithi067.stdout:7/283: chown d4/de/d41/l4a 1 1 2024-01-17T23:36:43.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/284: dread d4/d25/d39/f34 [0,4194304] 0 2024-01-17T23:36:43.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/285: chown d4/d25/l36 66556 1 2024-01-17T23:36:43.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/286: chown d4/de/l12 2004 1 2024-01-17T23:36:43.021 INFO:tasks.workunit.client.0.smithi067.stdout:7/287: dread d4/d25/d39/f34 [0,4194304] 0 2024-01-17T23:36:43.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/336: getdents d0/d37 0 2024-01-17T23:36:44.043 INFO:tasks.workunit.client.0.smithi067.stdout:7/288: creat d4/de/d41/f55 x:0 0 0 2024-01-17T23:36:44.045 INFO:tasks.workunit.client.0.smithi067.stdout:7/289: read d4/de/f4d [5643,70375] 0 2024-01-17T23:36:44.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/290: read d4/de/f3e [1263539,24134] 0 2024-01-17T23:36:44.260 INFO:tasks.workunit.client.0.smithi067.stdout:8/280: write d6/d19/d22/d25/d53/d65/f23 [1978972,117808] 0 2024-01-17T23:36:44.260 INFO:tasks.workunit.client.0.smithi067.stdout:8/281: dread - d6/d19/d22/f4f zero size 2024-01-17T23:36:44.267 INFO:tasks.workunit.client.0.smithi067.stdout:6/280: sync 2024-01-17T23:36:44.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/297: sync 2024-01-17T23:36:44.279 INFO:tasks.workunit.client.0.smithi067.stdout:6/281: write d6/d18/f33 [1538748,22565] 0 2024-01-17T23:36:44.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/293: rename d5/d1f/d2a/d54/d8/d4c/f56 to d5/d1f/f64 0 2024-01-17T23:36:44.502 INFO:tasks.workunit.client.0.smithi067.stdout:3/337: creat d0/d12/f6d x:0 0 0 2024-01-17T23:36:44.502 INFO:tasks.workunit.client.0.smithi067.stdout:0/276: rename d3 to d3/d5/d1a/d1c/d1d/d2e/d5a/d7b 22 2024-01-17T23:36:44.502 INFO:tasks.workunit.client.0.smithi067.stdout:0/277: write d3/d5/f36 [109388,38748] 0 2024-01-17T23:36:44.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/338: dwrite d0/d13/d1a/d38/f47 [0,4194304] 0 2024-01-17T23:36:44.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/339: write d0/d13/d4a/d55/f62 [5597015,71959] 0 2024-01-17T23:36:44.622 INFO:tasks.workunit.client.0.smithi067.stdout:5/230: link d10/d24/l27 d10/d24/l49 0 2024-01-17T23:36:44.626 INFO:tasks.workunit.client.0.smithi067.stdout:5/231: dread d10/d3f/d42/f47 [0,4194304] 0 2024-01-17T23:36:44.681 INFO:tasks.workunit.client.0.smithi067.stdout:7/291: mkdir d4/d25/d56 0 2024-01-17T23:36:44.937 INFO:tasks.workunit.client.0.smithi067.stdout:6/282: creat d6/d18/d44/d51/f5d x:0 0 0 2024-01-17T23:36:44.966 INFO:tasks.workunit.client.0.smithi067.stdout:6/283: dwrite d6/d18/d2e/f40 [0,4194304] 0 2024-01-17T23:36:45.149 INFO:tasks.workunit.client.0.smithi067.stdout:2/294: mknod d5/d1f/c65 0 2024-01-17T23:36:45.280 INFO:tasks.workunit.client.0.smithi067.stdout:9/250: rename d3/d6/d2a/d34/c38 to d3/d6/d11/d50/c51 0 2024-01-17T23:36:45.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/251: read d3/f5 [478423,124986] 0 2024-01-17T23:36:45.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/232: mkdir d10/d24/d46/d4a 0 2024-01-17T23:36:45.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/233: dread d10/f1f [0,4194304] 0 2024-01-17T23:36:45.708 INFO:tasks.workunit.client.0.smithi067.stdout:5/234: dwrite f9 [0,4194304] 0 2024-01-17T23:36:45.779 INFO:tasks.workunit.client.0.smithi067.stdout:7/292: mknod d4/d25/c57 0 2024-01-17T23:36:45.779 INFO:tasks.workunit.client.0.smithi067.stdout:7/293: stat d4/d25/d39/f35 0 2024-01-17T23:36:45.779 INFO:tasks.workunit.client.0.smithi067.stdout:7/294: truncate d4/d25/d39/f35 719959 0 2024-01-17T23:36:45.963 INFO:tasks.workunit.client.0.smithi067.stdout:4/259: unlink d3/cd 0 2024-01-17T23:36:45.981 INFO:tasks.workunit.client.0.smithi067.stdout:4/260: dread d3/d26/d34/d3a/f45 [0,4194304] 0 2024-01-17T23:36:46.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/298: rename d0/d7/d13/d3a/d45/l4f to d0/d7/d13/l58 0 2024-01-17T23:36:46.045 INFO:tasks.workunit.client.0.smithi067.stdout:1/299: read d0/d7/d13/d2e/f49 [63328,2937] 0 2024-01-17T23:36:46.045 INFO:tasks.workunit.client.0.smithi067.stdout:1/300: write d0/d7/d13/d3a/f51 [866105,91311] 0 2024-01-17T23:36:46.049 INFO:tasks.workunit.client.0.smithi067.stdout:1/301: read d0/d7/f4c [35740,7014] 0 2024-01-17T23:36:46.140 INFO:tasks.workunit.client.0.smithi067.stdout:8/282: unlink d6/f9 0 2024-01-17T23:36:46.153 INFO:tasks.workunit.client.0.smithi067.stdout:8/283: write d6/d19/d22/d25/d53/f17 [4597863,95929] 0 2024-01-17T23:36:46.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/284: dread d6/db/f20 [0,4194304] 0 2024-01-17T23:36:46.177 INFO:tasks.workunit.client.0.smithi067.stdout:9/252: symlink d3/d6/d10/l52 0 2024-01-17T23:36:46.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/253: read d3/d6/f9 [2646026,58219] 0 2024-01-17T23:36:46.372 INFO:tasks.workunit.client.0.smithi067.stdout:0/278: getdents d3/d6/dd/d43 0 2024-01-17T23:36:46.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/340: mkdir d0/d17/d69/d6e 0 2024-01-17T23:36:46.541 INFO:tasks.workunit.client.0.smithi067.stdout:7/295: chown d4/c9 1 1 2024-01-17T23:36:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:8/285: symlink d6/l69 0 2024-01-17T23:36:47.668 INFO:tasks.workunit.client.0.smithi067.stdout:8/286: fdatasync d6/d19/d22/f37 0 2024-01-17T23:36:47.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/254: unlink d3/d6/d10/f46 0 2024-01-17T23:36:47.821 INFO:tasks.workunit.client.0.smithi067.stdout:9/255: dread d3/d6/d11/f4f [0,4194304] 0 2024-01-17T23:36:48.073 INFO:tasks.workunit.client.0.smithi067.stdout:6/284: rename d6/f2b to d6/d9/d1c/d1e/f5e 0 2024-01-17T23:36:48.074 INFO:tasks.workunit.client.0.smithi067.stdout:2/295: rename d5/d1f/d2a/d54 to d5/d1f/d2a/d54/d8/d32/d66 22 2024-01-17T23:36:48.090 INFO:tasks.workunit.client.0.smithi067.stdout:2/296: write d5/d1f/d2a/d54/d8/f3e [2210689,99318] 0 2024-01-17T23:36:48.090 INFO:tasks.workunit.client.0.smithi067.stdout:2/297: write d5/d1f/d2a/d54/d8/f3f [1094534,128478] 0 2024-01-17T23:36:48.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/279: mkdir d3/d5/d1a/d1c/d4e/d7c 0 2024-01-17T23:36:48.230 INFO:tasks.workunit.client.0.smithi067.stdout:0/280: stat d3/d5/d1a/d1c/d1d/d2e/d5a 0 2024-01-17T23:36:48.408 INFO:tasks.workunit.client.0.smithi067.stdout:3/341: dwrite d0/fd [0,4194304] 0 2024-01-17T23:36:48.408 INFO:tasks.workunit.client.0.smithi067.stdout:3/342: stat d0/d12/f21 0 2024-01-17T23:36:48.408 INFO:tasks.workunit.client.0.smithi067.stdout:3/343: fdatasync d0/d17/f5f 0 2024-01-17T23:36:48.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/296: rename d4/de/f4c to d4/de/f58 0 2024-01-17T23:36:48.491 INFO:tasks.workunit.client.0.smithi067.stdout:7/297: write d4/f27 [4309030,32956] 0 2024-01-17T23:36:48.583 INFO:tasks.workunit.client.0.smithi067.stdout:4/261: getdents d3/d40 0 2024-01-17T23:36:48.597 INFO:tasks.workunit.client.0.smithi067.stdout:4/262: dread d3/d5/f3f [0,4194304] 0 2024-01-17T23:36:48.609 INFO:tasks.workunit.client.0.smithi067.stdout:4/263: dread d3/d5/f2e [0,4194304] 0 2024-01-17T23:36:48.609 INFO:tasks.workunit.client.0.smithi067.stdout:4/264: write d3/d26/d34/d3a/f4b [58132,114631] 0 2024-01-17T23:36:48.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/287: rmdir d6/d19/d22/d25/d53/d65 39 2024-01-17T23:36:48.875 INFO:tasks.workunit.client.0.smithi067.stdout:9/256: mkdir d3/d53 0 2024-01-17T23:36:48.880 INFO:tasks.workunit.client.0.smithi067.stdout:8/288: dread d6/d19/f3f [0,4194304] 0 2024-01-17T23:36:48.883 INFO:tasks.workunit.client.0.smithi067.stdout:8/289: dread d6/d19/d22/d25/f59 [0,4194304] 0 2024-01-17T23:36:48.924 INFO:tasks.workunit.client.0.smithi067.stdout:8/290: dwrite d6/d19/d22/d25/d53/d65/f60 [0,4194304] 0 2024-01-17T23:36:48.924 INFO:tasks.workunit.client.0.smithi067.stdout:8/291: write d6/d19/d22/f2f [2215387,32872] 0 2024-01-17T23:36:48.924 INFO:tasks.workunit.client.0.smithi067.stdout:8/292: write d6/db/d58/f51 [936411,85132] 0 2024-01-17T23:36:48.928 INFO:tasks.workunit.client.0.smithi067.stdout:9/257: dwrite d3/d6/f9 [0,4194304] 0 2024-01-17T23:36:48.958 INFO:tasks.workunit.client.0.smithi067.stdout:9/258: dwrite d3/d6/d2a/f3f [0,4194304] 0 2024-01-17T23:36:48.958 INFO:tasks.workunit.client.0.smithi067.stdout:9/259: write d3/d6/d11/d50/f40 [614696,105789] 0 2024-01-17T23:36:49.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/285: symlink d6/d18/l5f 0 2024-01-17T23:36:49.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/235: rename d10/d3f/d42 to d10/d24/d46/d4a/d4b 0 2024-01-17T23:36:49.376 INFO:tasks.workunit.client.0.smithi067.stdout:0/281: mkdir d3/d64/d7d 0 2024-01-17T23:36:49.376 INFO:tasks.workunit.client.0.smithi067.stdout:0/282: chown d3/d5/d1a/d1c/f3e 6790 1 2024-01-17T23:36:49.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/265: mknod d3/d8/de/d20/c4c 0 2024-01-17T23:36:49.815 INFO:tasks.workunit.client.0.smithi067.stdout:4/266: dwrite d3/d26/d34/d3a/f4b [0,4194304] 0 2024-01-17T23:36:49.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/267: write d3/f7 [4685040,20816] 0 2024-01-17T23:36:50.089 INFO:tasks.workunit.client.0.smithi067.stdout:8/293: mknod d6/d19/d22/d25/d53/d48/c6a 0 2024-01-17T23:36:50.089 INFO:tasks.workunit.client.0.smithi067.stdout:8/294: fsync f4 0 2024-01-17T23:36:50.422 INFO:tasks.workunit.client.0.smithi067.stdout:9/260: symlink d3/d6/d2e/l54 0 2024-01-17T23:36:50.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/286: read d6/d9/d1c/d1e/f5e [2423932,57406] 0 2024-01-17T23:36:50.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/287: chown d6/d18/d2e 4256 1 2024-01-17T23:36:50.659 INFO:tasks.workunit.client.0.smithi067.stdout:2/298: rmdir d5/d1f/d2a/d54/d25 39 2024-01-17T23:36:50.776 INFO:tasks.workunit.client.0.smithi067.stdout:0/283: rmdir d3/d5/d1a/d1c/d1d 39 2024-01-17T23:36:50.776 INFO:tasks.workunit.client.0.smithi067.stdout:0/284: creat d3/d5/d1a/d1c/d4e/f7e x:0 0 0 2024-01-17T23:36:50.776 INFO:tasks.workunit.client.0.smithi067.stdout:0/285: write d3/f11 [529756,40593] 0 2024-01-17T23:36:51.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/268: mknod d3/d8/de/d20/d3b/c4d 0 2024-01-17T23:36:51.292 INFO:tasks.workunit.client.0.smithi067.stdout:1/302: sync 2024-01-17T23:36:51.310 INFO:tasks.workunit.client.0.smithi067.stdout:4/269: dread d3/f7 [4194304,4194304] 0 2024-01-17T23:36:51.310 INFO:tasks.workunit.client.0.smithi067.stdout:4/270: chown d3/d26/l27 15 1 2024-01-17T23:36:51.323 INFO:tasks.workunit.client.0.smithi067.stdout:4/271: dread d3/d5/fc [0,4194304] 0 2024-01-17T23:36:51.323 INFO:tasks.workunit.client.0.smithi067.stdout:4/272: readlink d3/d8/l22 0 2024-01-17T23:36:51.323 INFO:tasks.workunit.client.0.smithi067.stdout:4/273: fdatasync d3/d26/f33 0 2024-01-17T23:36:51.411 INFO:tasks.workunit.client.0.smithi067.stdout:8/295: symlink d6/d19/l6b 0 2024-01-17T23:36:51.635 INFO:tasks.workunit.client.0.smithi067.stdout:6/288: symlink d6/d18/d2e/l60 0 2024-01-17T23:36:52.208 INFO:tasks.workunit.client.0.smithi067.stdout:1/303: rename d0/d7/d13/d3a/d3e/f4a to d0/d7/d13/d3a/f59 0 2024-01-17T23:36:52.532 INFO:tasks.workunit.client.0.smithi067.stdout:4/274: truncate d3/d26/f43 503663 0 2024-01-17T23:36:52.532 INFO:tasks.workunit.client.0.smithi067.stdout:4/275: fdatasync d3/d5/f3f 0 2024-01-17T23:36:52.532 INFO:tasks.workunit.client.0.smithi067.stdout:8/296: mkdir d6/d26/d3e/d6c 0 2024-01-17T23:36:52.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/261: getdents d3/d25/d28 0 2024-01-17T23:36:52.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/262: write d3/d6/d2a/d34/f36 [3912804,117365] 0 2024-01-17T23:36:52.551 INFO:tasks.workunit.client.0.smithi067.stdout:6/289: mkdir d6/d18/d2e/d61 0 2024-01-17T23:36:52.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/290: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:36:52.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/291: write d6/d18/f4f [980068,116568] 0 2024-01-17T23:36:52.555 INFO:tasks.workunit.client.0.smithi067.stdout:6/292: read d6/d9/f14 [3808189,38875] 0 2024-01-17T23:36:52.666 INFO:tasks.workunit.client.0.smithi067.stdout:1/304: creat d0/d7/d13/d3a/d45/f5a x:0 0 0 2024-01-17T23:36:52.972 INFO:tasks.workunit.client.0.smithi067.stdout:4/276: mkdir d3/d4e 0 2024-01-17T23:36:53.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/344: dwrite d0/d13/f2f [0,4194304] 0 2024-01-17T23:36:53.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/297: mknod d6/db/c6d 0 2024-01-17T23:36:53.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/298: dread - d6/db/d58/f39 zero size 2024-01-17T23:36:53.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/299: dread - d6/db/d58/f39 zero size 2024-01-17T23:36:53.034 INFO:tasks.workunit.client.0.smithi067.stdout:9/263: mkdir d3/d15/d55 0 2024-01-17T23:36:53.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/298: write d4/d25/f2c [247531,65352] 0 2024-01-17T23:36:53.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/299: creat d4/d25/d39/d46/f59 x:0 0 0 2024-01-17T23:36:53.049 INFO:tasks.workunit.client.0.smithi067.stdout:3/345: dwrite d0/d12/d1b/f54 [0,4194304] 0 2024-01-17T23:36:53.175 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:37:41.392 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.179 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:37:41.396 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.199 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:37:41.510 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.205 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:37:41.516 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.213 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:37:41.524 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.223 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:37:41.534 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.244 INFO:tasks.workunit.client.0.smithi067.stdout:4/277: rmdir d3/d8/de/d20/d3b 39 2024-01-17T23:36:53.283 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:37:41.499 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.326 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:37:41.637 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.382 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:37:41.693 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:36:53.535 INFO:tasks.workunit.client.0.smithi067.stdout:8/300: creat d6/db/d58/f6e x:0 0 0 2024-01-17T23:36:53.557 INFO:tasks.workunit.client.0.smithi067.stdout:8/301: dwrite d6/db/d58/f6e [0,4194304] 0 2024-01-17T23:36:53.693 INFO:tasks.workunit.client.0.smithi067.stdout:7/300: creat d4/d25/f5a x:0 0 0 2024-01-17T23:36:54.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/293: rename d6/d9/f14 to d6/d9/d1c/d1e/f62 0 2024-01-17T23:36:54.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/294: write d6/f17 [420623,72572] 0 2024-01-17T23:36:54.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/295: chown d6/d9/d1c/d1e/d43 16791657 1 2024-01-17T23:36:54.030 INFO:tasks.workunit.client.0.smithi067.stdout:6/296: dwrite d6/d18/d2e/f40 [0,4194304] 0 2024-01-17T23:36:54.498 INFO:tasks.workunit.client.0.smithi067.stdout:2/299: dwrite d5/d1f/d2a/d54/f11 [0,4194304] 0 2024-01-17T23:36:54.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/236: dwrite d10/f1c [0,4194304] 0 2024-01-17T23:36:54.871 INFO:tasks.workunit.client.0.smithi067.stdout:8/302: symlink d6/l6f 0 2024-01-17T23:36:54.871 INFO:tasks.workunit.client.0.smithi067.stdout:8/303: chown d6/d26/l64 204 1 2024-01-17T23:36:54.871 INFO:tasks.workunit.client.0.smithi067.stdout:8/304: write d6/db/f5e [952711,91849] 0 2024-01-17T23:36:54.871 INFO:tasks.workunit.client.0.smithi067.stdout:0/286: getdents d3/d5/d1a/d1c/d4e 0 2024-01-17T23:36:54.871 INFO:tasks.workunit.client.0.smithi067.stdout:0/287: truncate d3/d5/d32/f78 1040795 0 2024-01-17T23:36:55.382 INFO:tasks.workunit.client.0.smithi067.stdout:6/297: read d6/d9/d1c/d1e/f5e [813830,124056] 0 2024-01-17T23:36:55.863 INFO:tasks.workunit.client.0.smithi067.stdout:1/305: creat d0/d7/d13/f5b x:0 0 0 2024-01-17T23:36:56.335 INFO:tasks.workunit.client.0.smithi067.stdout:8/305: creat d6/d19/d22/d25/d53/d48/f70 x:0 0 0 2024-01-17T23:36:56.336 INFO:tasks.workunit.client.0.smithi067.stdout:8/306: write d6/db/f5e [1103384,4782] 0 2024-01-17T23:36:56.492 INFO:tasks.workunit.client.0.smithi067.stdout:0/288: mkdir d3/d5/d32/d7f 0 2024-01-17T23:36:56.492 INFO:tasks.workunit.client.0.smithi067.stdout:0/289: fsync d3/d6/f56 0 2024-01-17T23:36:56.645 INFO:tasks.workunit.client.0.smithi067.stdout:6/298: symlink d6/d9/d1c/d1e/l63 0 2024-01-17T23:36:56.817 INFO:tasks.workunit.client.0.smithi067.stdout:1/306: mknod d0/c5c 0 2024-01-17T23:36:56.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/264: link d3/d6/d2a/d34/f36 d3/d6/f56 0 2024-01-17T23:36:56.944 INFO:tasks.workunit.client.0.smithi067.stdout:8/307: creat d6/d19/d22/f71 x:0 0 0 2024-01-17T23:36:57.148 INFO:tasks.workunit.client.0.smithi067.stdout:0/290: getdents d3/d5/d1a/d1c 0 2024-01-17T23:36:57.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/299: mknod d6/d9/d3e/c64 0 2024-01-17T23:36:57.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/300: truncate d6/d18/f33 5170744 0 2024-01-17T23:36:57.193 INFO:tasks.workunit.client.0.smithi067.stdout:9/265: mkdir d3/d15/d57 0 2024-01-17T23:36:57.593 INFO:tasks.workunit.client.0.smithi067.stdout:0/291: mkdir d3/d6/d80 0 2024-01-17T23:36:57.593 INFO:tasks.workunit.client.0.smithi067.stdout:0/292: stat d3/d5/d32/f7a 0 2024-01-17T23:36:57.683 INFO:tasks.workunit.client.0.smithi067.stdout:6/301: mkdir d6/d9/d65 0 2024-01-17T23:36:57.683 INFO:tasks.workunit.client.0.smithi067.stdout:6/302: creat d6/d9/d1c/f66 x:0 0 0 2024-01-17T23:36:57.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/266: mkdir d3/d58 0 2024-01-17T23:36:57.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/267: chown d3/d6/d11/l4c 1923426 1 2024-01-17T23:36:57.781 INFO:tasks.workunit.client.0.smithi067.stdout:9/268: chown f0 22 1 2024-01-17T23:36:57.781 INFO:tasks.workunit.client.0.smithi067.stdout:9/269: fdatasync d3/d6/f56 0 2024-01-17T23:36:57.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/307: getdents d0/d7/d13/d2e 0 2024-01-17T23:36:57.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/308: creat d0/d7/d13/d3a/f5d x:0 0 0 2024-01-17T23:36:57.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/309: creat d0/d7/d13/d3a/d3e/f5e x:0 0 0 2024-01-17T23:36:57.923 INFO:tasks.workunit.client.0.smithi067.stdout:1/310: dread d0/d7/f55 [4194304,4194304] 0 2024-01-17T23:36:58.062 INFO:tasks.workunit.client.0.smithi067.stdout:0/293: symlink d3/d5/d1a/d1c/d4e/d7c/l81 0 2024-01-17T23:36:58.227 INFO:tasks.workunit.client.0.smithi067.stdout:6/303: mknod d6/d9/d65/c67 0 2024-01-17T23:36:58.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/304: read - d6/d9/f31 zero size 2024-01-17T23:36:58.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/305: stat d6/c3b 0 2024-01-17T23:36:58.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/306: chown d6/d9/d30/d58 2071 1 2024-01-17T23:36:58.257 INFO:tasks.workunit.client.0.smithi067.stdout:6/307: dwrite d6/d18/f41 [0,4194304] 0 2024-01-17T23:36:58.367 INFO:tasks.workunit.client.0.smithi067.stdout:9/270: fdatasync d3/d6/d2e/f3d 0 2024-01-17T23:36:58.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/311: creat d0/d2d/f5f x:0 0 0 2024-01-17T23:36:58.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/312: dread d0/d7/d1c/f22 [0,4194304] 0 2024-01-17T23:36:58.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/313: write d0/d7/d13/d2e/f46 [2033424,44068] 0 2024-01-17T23:36:58.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/314: readlink d0/d7/d13/l37 0 2024-01-17T23:36:58.892 INFO:tasks.workunit.client.0.smithi067.stdout:0/294: mkdir d3/d64/d82 0 2024-01-17T23:36:58.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/295: dread d3/d5/f36 [0,4194304] 0 2024-01-17T23:36:58.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/296: write d3/d5/d1a/d1c/d4e/f7e [694946,1410] 0 2024-01-17T23:36:58.896 INFO:tasks.workunit.client.0.smithi067.stdout:0/297: chown d3/d5/d1a/d1c/d1d/d2e/d5a 18382072 1 2024-01-17T23:36:59.220 INFO:tasks.workunit.client.0.smithi067.stdout:9/271: getdents d3/d6/d2a 0 2024-01-17T23:36:59.821 INFO:tasks.workunit.client.0.smithi067.stdout:0/298: symlink d3/d5/l83 0 2024-01-17T23:37:00.319 INFO:tasks.workunit.client.0.smithi067.stdout:6/308: rmdir d6/d9/d3e 39 2024-01-17T23:37:00.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/346: sync 2024-01-17T23:37:00.321 INFO:tasks.workunit.client.0.smithi067.stdout:7/301: sync 2024-01-17T23:37:00.321 INFO:tasks.workunit.client.0.smithi067.stdout:4/278: sync 2024-01-17T23:37:00.321 INFO:tasks.workunit.client.0.smithi067.stdout:4/279: fdatasync d3/d40/f41 0 2024-01-17T23:37:00.330 INFO:tasks.workunit.client.0.smithi067.stdout:7/302: dread d4/f8 [0,4194304] 0 2024-01-17T23:37:00.330 INFO:tasks.workunit.client.0.smithi067.stdout:7/303: write d4/f8 [3490870,66032] 0 2024-01-17T23:37:00.537 INFO:tasks.workunit.client.0.smithi067.stdout:0/299: symlink d3/d6/l84 0 2024-01-17T23:37:00.672 INFO:tasks.workunit.client.0.smithi067.stdout:2/300: mknod d5/c67 0 2024-01-17T23:37:00.738 INFO:tasks.workunit.client.0.smithi067.stdout:6/309: truncate d6/d18/f4f 813315 0 2024-01-17T23:37:00.738 INFO:tasks.workunit.client.0.smithi067.stdout:6/310: stat d6/d9/d1c/d1e/l63 0 2024-01-17T23:37:00.738 INFO:tasks.workunit.client.0.smithi067.stdout:6/311: truncate d6/fb 4971421 0 2024-01-17T23:37:00.854 INFO:tasks.workunit.client.0.smithi067.stdout:3/347: dread d0/f1e [0,4194304] 0 2024-01-17T23:37:00.883 INFO:tasks.workunit.client.0.smithi067.stdout:3/348: dwrite d0/d12/d1b/d4d/f5b [0,4194304] 0 2024-01-17T23:37:01.214 INFO:tasks.workunit.client.0.smithi067.stdout:2/301: mkdir d5/d1f/d2a/d54/d39/d68 0 2024-01-17T23:37:01.246 INFO:tasks.workunit.client.0.smithi067.stdout:2/302: dwrite d5/d1f/d35/f3b [0,4194304] 0 2024-01-17T23:37:01.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/312: symlink d6/d9/d30/d4c/l68 0 2024-01-17T23:37:01.423 INFO:tasks.workunit.client.0.smithi067.stdout:6/313: write d6/d9/d3e/f3f [833152,67973] 0 2024-01-17T23:37:01.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/315: symlink d0/d7/l60 0 2024-01-17T23:37:01.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/316: fsync d0/d7/d1c/f22 0 2024-01-17T23:37:02.014 INFO:tasks.workunit.client.0.smithi067.stdout:2/303: symlink d5/d1f/d2a/d54/d8/d32/l69 0 2024-01-17T23:37:02.014 INFO:tasks.workunit.client.0.smithi067.stdout:2/304: write d5/d1f/d2a/d54/f1a [4511681,31993] 0 2024-01-17T23:37:02.122 INFO:tasks.workunit.client.0.smithi067.stdout:6/314: symlink d6/d9/d3e/l69 0 2024-01-17T23:37:02.276 INFO:tasks.workunit.client.0.smithi067.stdout:3/349: mkdir d0/d34/d35/d65/d6f 0 2024-01-17T23:37:02.293 INFO:tasks.workunit.client.0.smithi067.stdout:3/350: dread d0/fd [0,4194304] 0 2024-01-17T23:37:02.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/317: rmdir d0/d7/d13/d3a 39 2024-01-17T23:37:02.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/318: readlink d0/d7/d13/l28 0 2024-01-17T23:37:02.400 INFO:tasks.workunit.client.0.smithi067.stdout:1/319: dread d0/d7/f55 [0,4194304] 0 2024-01-17T23:37:02.577 INFO:tasks.workunit.client.0.smithi067.stdout:2/305: symlink d5/d2f/l6a 0 2024-01-17T23:37:02.578 INFO:tasks.workunit.client.0.smithi067.stdout:2/306: read d5/d1f/d2a/d54/f24 [1120222,21102] 0 2024-01-17T23:37:02.584 INFO:tasks.workunit.client.0.smithi067.stdout:7/304: creat d4/f5b x:0 0 0 2024-01-17T23:37:02.767 INFO:tasks.workunit.client.0.smithi067.stdout:3/351: mkdir d0/d34/d35/d65/d6f/d70 0 2024-01-17T23:37:02.767 INFO:tasks.workunit.client.0.smithi067.stdout:3/352: chown d0/d17 3 1 2024-01-17T23:37:03.044 INFO:tasks.workunit.client.0.smithi067.stdout:8/308: sync 2024-01-17T23:37:03.044 INFO:tasks.workunit.client.0.smithi067.stdout:5/237: sync 2024-01-17T23:37:03.044 INFO:tasks.workunit.client.0.smithi067.stdout:8/309: creat d6/d19/d22/f72 x:0 0 0 2024-01-17T23:37:03.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/310: readlink d6/db/l32 0 2024-01-17T23:37:03.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/311: creat d6/db/d58/f73 x:0 0 0 2024-01-17T23:37:03.271 INFO:tasks.workunit.client.0.smithi067.stdout:1/320: link d0/d7/f20 d0/d7/f61 0 2024-01-17T23:37:03.271 INFO:tasks.workunit.client.0.smithi067.stdout:1/321: read - d0/d7/d13/d3a/d3e/f57 zero size 2024-01-17T23:37:03.404 INFO:tasks.workunit.client.0.smithi067.stdout:2/307: stat d5/d1f/d2a/d54/d8/d32/d33/l37 0 2024-01-17T23:37:03.404 INFO:tasks.workunit.client.0.smithi067.stdout:7/305: mknod d4/de/c5c 0 2024-01-17T23:37:03.404 INFO:tasks.workunit.client.0.smithi067.stdout:2/308: chown d5/d1f/d2a/d54/d39/l60 62141762 1 2024-01-17T23:37:03.460 INFO:tasks.workunit.client.0.smithi067.stdout:0/300: write d3/d6/dd/f29 [1138584,108988] 0 2024-01-17T23:37:03.510 INFO:tasks.workunit.client.0.smithi067.stdout:3/353: dread d0/f5 [0,4194304] 0 2024-01-17T23:37:03.540 INFO:tasks.workunit.client.0.smithi067.stdout:3/354: dwrite d0/d13/f33 [0,4194304] 0 2024-01-17T23:37:03.540 INFO:tasks.workunit.client.0.smithi067.stdout:3/355: creat d0/d12/d1b/d4d/f71 x:0 0 0 2024-01-17T23:37:03.641 INFO:tasks.workunit.client.0.smithi067.stdout:5/238: dread d10/d24/f2d [0,4194304] 0 2024-01-17T23:37:03.668 INFO:tasks.workunit.client.0.smithi067.stdout:5/239: dwrite d10/f14 [4194304,4194304] 0 2024-01-17T23:37:03.671 INFO:tasks.workunit.client.0.smithi067.stdout:5/240: dread d10/f2c [0,4194304] 0 2024-01-17T23:37:03.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/312: creat d6/d26/d3e/f74 x:0 0 0 2024-01-17T23:37:04.299 INFO:tasks.workunit.client.0.smithi067.stdout:1/322: unlink d0/d7/d1c/l3f 0 2024-01-17T23:37:04.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/323: write d0/d7/d13/d3a/f51 [363887,122983] 0 2024-01-17T23:37:04.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/324: dwrite d0/d7/d13/f5b [0,4194304] 0 2024-01-17T23:37:04.503 INFO:tasks.workunit.client.0.smithi067.stdout:7/306: creat d4/f5d x:0 0 0 2024-01-17T23:37:04.503 INFO:tasks.workunit.client.0.smithi067.stdout:7/307: chown d4/de/d41/c48 246812591 1 2024-01-17T23:37:04.603 INFO:tasks.workunit.client.0.smithi067.stdout:2/309: mkdir d5/d1f/d16/d61/d6b 0 2024-01-17T23:37:04.713 INFO:tasks.workunit.client.0.smithi067.stdout:0/301: creat d3/d5/d1a/d1c/d1d/d2e/f85 x:0 0 0 2024-01-17T23:37:04.713 INFO:tasks.workunit.client.0.smithi067.stdout:0/302: fsync d3/d5/d1a/d1c/d1d/d2e/f33 0 2024-01-17T23:37:05.067 INFO:tasks.workunit.client.0.smithi067.stdout:5/241: link d10/d24/d25/f35 d10/d24/d46/f4c 0 2024-01-17T23:37:05.067 INFO:tasks.workunit.client.0.smithi067.stdout:5/242: read d10/f11 [3559883,110420] 0 2024-01-17T23:37:05.313 INFO:tasks.workunit.client.0.smithi067.stdout:8/313: creat d6/d19/d22/d25/d53/f75 x:0 0 0 2024-01-17T23:37:05.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/315: write d6/f8 [775740,99384] 0 2024-01-17T23:37:05.427 INFO:tasks.workunit.client.0.smithi067.stdout:9/272: rename f2 to d3/d6/d2a/d34/d42/f59 0 2024-01-17T23:37:05.951 INFO:tasks.workunit.client.0.smithi067.stdout:7/308: symlink d4/de/l5e 0 2024-01-17T23:37:05.970 INFO:tasks.workunit.client.0.smithi067.stdout:7/309: write d4/fb [3206943,123938] 0 2024-01-17T23:37:06.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/310: dwrite f1 [4194304,4194304] 0 2024-01-17T23:37:06.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/311: chown d4/c9 257534955 1 2024-01-17T23:37:06.061 INFO:tasks.workunit.client.0.smithi067.stdout:2/310: symlink d5/d1f/d35/l6c 0 2024-01-17T23:37:06.188 INFO:tasks.workunit.client.0.smithi067.stdout:0/303: unlink d3/d6/l84 0 2024-01-17T23:37:06.497 INFO:tasks.workunit.client.0.smithi067.stdout:8/314: stat d6/c47 0 2024-01-17T23:37:06.497 INFO:tasks.workunit.client.0.smithi067.stdout:5/243: creat d10/d3f/f4d x:0 0 0 2024-01-17T23:37:06.497 INFO:tasks.workunit.client.0.smithi067.stdout:5/244: stat d10/d24/d46 0 2024-01-17T23:37:06.519 INFO:tasks.workunit.client.0.smithi067.stdout:8/315: dread d6/db/f20 [4194304,4194304] 0 2024-01-17T23:37:06.519 INFO:tasks.workunit.client.0.smithi067.stdout:8/316: creat d6/d19/d22/d25/d53/f76 x:0 0 0 2024-01-17T23:37:06.519 INFO:tasks.workunit.client.0.smithi067.stdout:8/317: dread - d6/d19/d22/d25/f5d zero size 2024-01-17T23:37:07.140 INFO:tasks.workunit.client.0.smithi067.stdout:2/311: link d5/d1f/d2a/d54/d8/f3e d5/d1f/d35/f6d 0 2024-01-17T23:37:07.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/312: dwrite d5/d1f/d2a/d54/d8/d32/d33/f44 [0,4194304] 0 2024-01-17T23:37:07.322 INFO:tasks.workunit.client.0.smithi067.stdout:0/304: link d3/d5/d1a/d1c/d1d/d2e/l34 d3/d5/d1a/d1c/d4e/d7c/l86 0 2024-01-17T23:37:07.501 INFO:tasks.workunit.client.0.smithi067.stdout:8/318: creat d6/d19/d22/d25/d53/d54/f77 x:0 0 0 2024-01-17T23:37:07.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/273: mknod d3/d6/d11/c5a 0 2024-01-17T23:37:07.769 INFO:tasks.workunit.client.0.smithi067.stdout:9/274: truncate d3/d6/d11/f23 8608832 0 2024-01-17T23:37:07.956 INFO:tasks.workunit.client.0.smithi067.stdout:4/280: rename d3/d26/d34/d3a/c4a to d3/d8/d35/c4f 0 2024-01-17T23:37:07.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/281: chown d3/d5/l11 341353557 1 2024-01-17T23:37:08.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/312: getdents d4/d16 0 2024-01-17T23:37:08.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/313: fdatasync d4/f19 0 2024-01-17T23:37:08.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/313: mknod d5/d1f/d2a/d54/d8/c6e 0 2024-01-17T23:37:08.531 INFO:tasks.workunit.client.0.smithi067.stdout:0/305: mknod d3/d6/dd/d43/c87 0 2024-01-17T23:37:08.540 INFO:tasks.workunit.client.0.smithi067.stdout:0/306: read d3/d5/d1a/d1c/d4e/f7e [46250,68046] 0 2024-01-17T23:37:08.544 INFO:tasks.workunit.client.0.smithi067.stdout:0/307: dread d3/d5/f36 [0,4194304] 0 2024-01-17T23:37:08.786 INFO:tasks.workunit.client.0.smithi067.stdout:9/275: mknod d3/d15/c5b 0 2024-01-17T23:37:08.786 INFO:tasks.workunit.client.0.smithi067.stdout:9/276: chown d3/da/lb 36801 1 2024-01-17T23:37:08.924 INFO:tasks.workunit.client.0.smithi067.stdout:1/325: dwrite d0/d7/d13/d2e/f49 [0,4194304] 0 2024-01-17T23:37:09.353 INFO:tasks.workunit.client.0.smithi067.stdout:2/314: creat d5/d1f/d2a/d54/d8/d32/d33/f6f x:0 0 0 2024-01-17T23:37:10.880 INFO:tasks.workunit.client.0.smithi067.stdout:8/319: rmdir d6/d19/d22/d25/d53 39 2024-01-17T23:37:11.070 INFO:tasks.workunit.client.0.smithi067.stdout:4/282: symlink d3/d8/d35/l50 0 2024-01-17T23:37:11.098 INFO:tasks.workunit.client.0.smithi067.stdout:6/316: dwrite d6/d9/d30/f4d [0,4194304] 0 2024-01-17T23:37:11.606 INFO:tasks.workunit.client.0.smithi067.stdout:7/314: rmdir d4/de/d41 39 2024-01-17T23:37:12.005 INFO:tasks.workunit.client.0.smithi067.stdout:2/315: unlink d5/d2f/c49 0 2024-01-17T23:37:12.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/316: dwrite d5/d1f/f64 [0,4194304] 0 2024-01-17T23:37:12.263 INFO:tasks.workunit.client.0.smithi067.stdout:9/277: mkdir d3/d6/d11/d5c 0 2024-01-17T23:37:12.263 INFO:tasks.workunit.client.0.smithi067.stdout:9/278: chown d3/d6/d2a/d34/d42/f59 42 1 2024-01-17T23:37:12.760 INFO:tasks.workunit.client.0.smithi067.stdout:4/283: creat d3/d8/de/d20/d3b/f51 x:0 0 0 2024-01-17T23:37:12.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/317: truncate d5/d1f/d2a/d54/d8/f3e 1561708 0 2024-01-17T23:37:12.794 INFO:tasks.workunit.client.0.smithi067.stdout:2/318: dwrite d5/d1f/f3c [0,4194304] 0 2024-01-17T23:37:12.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/308: sync 2024-01-17T23:37:12.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/309: fsync d3/d5/d32/f41 0 2024-01-17T23:37:12.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/310: read - d3/d5/f45 zero size 2024-01-17T23:37:12.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/311: dread - d3/d5/d32/f7a zero size 2024-01-17T23:37:12.816 INFO:tasks.workunit.client.0.smithi067.stdout:0/312: dread d3/d5/f9 [4194304,4194304] 0 2024-01-17T23:37:12.845 INFO:tasks.workunit.client.0.smithi067.stdout:0/313: dwrite d3/d5/d1a/f24 [0,4194304] 0 2024-01-17T23:37:12.942 INFO:tasks.workunit.client.0.smithi067.stdout:4/284: mkdir d3/d8/de/d20/d52 0 2024-01-17T23:37:12.992 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:12.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:13.608 INFO:tasks.workunit.client.0.smithi067.stdout:2/319: mknod d5/d1f/d2a/d54/d8/d4c/c70 0 2024-01-17T23:37:13.775 INFO:tasks.workunit.client.0.smithi067.stdout:4/285: truncate d3/d5/f3f 3337584 0 2024-01-17T23:37:14.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/320: link d5/d1f/d2a/d54/d8/d4c/f5f d5/d1f/d2a/d55/f71 0 2024-01-17T23:37:14.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/321: write d5/d1f/d35/f3b [1755069,77103] 0 2024-01-17T23:37:14.166 INFO:tasks.workunit.client.0.smithi067.stdout:2/322: dread d5/d1f/d2a/d54/f11 [0,4194304] 0 2024-01-17T23:37:14.870 INFO:tasks.workunit.client.0.smithi067.stdout:3/356: rename d0/f9 to d0/d13/d4a/d55/f72 0 2024-01-17T23:37:14.991 INFO:tasks.workunit.client.0.smithi067.stdout:2/323: symlink d5/d1f/d2a/l72 0 2024-01-17T23:37:15.011 INFO:tasks.workunit.client.0.smithi067.stdout:2/324: write d5/d2f/f4b [3682722,7254] 0 2024-01-17T23:37:15.011 INFO:tasks.workunit.client.0.smithi067.stdout:2/325: fsync d5/d1f/f3c 0 2024-01-17T23:37:15.012 INFO:tasks.workunit.client.0.smithi067.stdout:2/326: read d5/d1f/f43 [183873,82747] 0 2024-01-17T23:37:15.012 INFO:tasks.workunit.client.0.smithi067.stdout:2/327: truncate d5/d1f/d2a/d54/d25/f59 87236 0 2024-01-17T23:37:15.044 INFO:tasks.workunit.client.0.smithi067.stdout:2/328: dwrite d5/d2f/f4b [0,4194304] 0 2024-01-17T23:37:15.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/357: creat d0/d13/d4a/d55/f73 x:0 0 0 2024-01-17T23:37:15.634 INFO:tasks.workunit.client.0.smithi067.stdout:1/326: mkdir d0/d62 0 2024-01-17T23:37:15.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/327: dread d0/d7/d13/d2e/f49 [0,4194304] 0 2024-01-17T23:37:15.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/329: rmdir d5/d1f/d16/d61/d6b 0 2024-01-17T23:37:15.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/330: write d5/d1f/d2a/d54/f1a [4727051,79163] 0 2024-01-17T23:37:15.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/331: chown d5/d1f/d2a/d54/d25/f59 4 1 2024-01-17T23:37:16.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/358: mknod d0/d13/d4a/d55/c74 0 2024-01-17T23:37:16.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/359: chown d0/d12/c60 32248 1 2024-01-17T23:37:16.059 INFO:tasks.workunit.client.0.smithi067.stdout:0/314: write d3/d5/f26 [4586239,77843] 0 2024-01-17T23:37:16.080 INFO:tasks.workunit.client.0.smithi067.stdout:1/328: getdents d0/d2d/d31 0 2024-01-17T23:37:16.080 INFO:tasks.workunit.client.0.smithi067.stdout:1/329: read d0/d7/d13/d3a/f51 [782638,126250] 0 2024-01-17T23:37:16.092 INFO:tasks.workunit.client.0.smithi067.stdout:2/332: mkdir d5/d1f/d2a/d73 0 2024-01-17T23:37:16.092 INFO:tasks.workunit.client.0.smithi067.stdout:2/333: stat d5/d1f/f3c 0 2024-01-17T23:37:16.417 INFO:tasks.workunit.client.0.smithi067.stdout:5/245: rename d10/d24/l27 to d10/d24/d46/d4a/d4b/l4e 0 2024-01-17T23:37:16.441 INFO:tasks.workunit.client.0.smithi067.stdout:5/246: dread d10/d3f/f41 [0,4194304] 0 2024-01-17T23:37:16.448 INFO:tasks.workunit.client.0.smithi067.stdout:4/286: dwrite d3/d8/f13 [4194304,4194304] 0 2024-01-17T23:37:16.556 INFO:tasks.workunit.client.0.smithi067.stdout:3/360: dread d0/d17/f4c [0,4194304] 0 2024-01-17T23:37:16.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/361: dwrite d0/fd [0,4194304] 0 2024-01-17T23:37:16.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/362: stat d0/d12/d1b/f2d 0 2024-01-17T23:37:16.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/315: creat d3/d5/d1a/d1c/d1d/d2e/d5a/f88 x:0 0 0 2024-01-17T23:37:16.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/316: stat c0 0 2024-01-17T23:37:16.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/330: stat d0/d7/d13/l58 0 2024-01-17T23:37:16.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/331: chown d0/f5 3 1 2024-01-17T23:37:16.722 INFO:tasks.workunit.client.0.smithi067.stdout:1/332: fsync d0/d2d/f5f 0 2024-01-17T23:37:16.732 INFO:tasks.workunit.client.0.smithi067.stdout:0/317: dwrite d3/d5/f2b [0,4194304] 0 2024-01-17T23:37:16.732 INFO:tasks.workunit.client.0.smithi067.stdout:0/318: creat d3/d5/d1a/d1c/d1d/d2e/f89 x:0 0 0 2024-01-17T23:37:16.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/334: symlink d5/d1f/d2a/l74 0 2024-01-17T23:37:17.140 INFO:tasks.workunit.client.0.smithi067.stdout:6/317: rename d6/ff to d6/d9/d30/d58/f6a 0 2024-01-17T23:37:17.209 INFO:tasks.workunit.client.0.smithi067.stdout:8/320: sync 2024-01-17T23:37:17.215 INFO:tasks.workunit.client.0.smithi067.stdout:8/321: write d6/db/f5e [58688,41325] 0 2024-01-17T23:37:17.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/322: dwrite d6/db/f63 [0,4194304] 0 2024-01-17T23:37:17.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/323: write d6/d19/d22/d25/d53/f75 [332138,50108] 0 2024-01-17T23:37:17.249 INFO:tasks.workunit.client.0.smithi067.stdout:8/324: write d6/db/f55 [676186,57254] 0 2024-01-17T23:37:17.377 INFO:tasks.workunit.client.0.smithi067.stdout:4/287: mkdir d3/d26/d34/d3a/d53 0 2024-01-17T23:37:17.377 INFO:tasks.workunit.client.0.smithi067.stdout:4/288: chown d3/d8/d35/d36/l3e 709 1 2024-01-17T23:37:17.377 INFO:tasks.workunit.client.0.smithi067.stdout:4/289: chown d3/d8/f13 3 1 2024-01-17T23:37:17.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/363: dread d0/f2a [0,4194304] 0 2024-01-17T23:37:17.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/364: dwrite d0/d34/d35/f50 [0,4194304] 0 2024-01-17T23:37:17.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/365: chown d0/d13/d4a/d55 68 1 2024-01-17T23:37:17.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/366: fsync d0/d17/f23 0 2024-01-17T23:37:18.109 INFO:tasks.workunit.client.0.smithi067.stdout:2/335: dread d5/d1f/d2a/d54/d8/f3e [0,4194304] 0 2024-01-17T23:37:18.378 INFO:tasks.workunit.client.0.smithi067.stdout:7/315: rename d4/d16/c47 to d4/d4b/c5f 0 2024-01-17T23:37:18.394 INFO:tasks.workunit.client.0.smithi067.stdout:7/316: read d4/f6 [5355689,81159] 0 2024-01-17T23:37:18.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/325: creat d6/d19/d22/d25/d53/d65/f78 x:0 0 0 2024-01-17T23:37:18.738 INFO:tasks.workunit.client.0.smithi067.stdout:8/326: dread - d6/db/d58/f73 zero size 2024-01-17T23:37:18.854 INFO:tasks.workunit.client.0.smithi067.stdout:4/290: creat d3/d8/de/f54 x:0 0 0 2024-01-17T23:37:19.250 INFO:tasks.workunit.client.0.smithi067.stdout:1/333: getdents d0/d32 0 2024-01-17T23:37:19.481 INFO:tasks.workunit.client.0.smithi067.stdout:2/336: mknod d5/d1f/d2a/d54/d8/d32/d33/c75 0 2024-01-17T23:37:19.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/337: dwrite d5/d1f/f64 [0,4194304] 0 2024-01-17T23:37:19.537 INFO:tasks.workunit.client.0.smithi067.stdout:2/338: write d5/d1f/d2a/d54/d8/d32/f42 [1757665,30420] 0 2024-01-17T23:37:19.537 INFO:tasks.workunit.client.0.smithi067.stdout:2/339: readlink d5/d1f/d16/l17 0 2024-01-17T23:37:19.995 INFO:tasks.workunit.client.0.smithi067.stdout:6/318: rmdir d6/d9/d30/d4c 39 2024-01-17T23:37:19.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/317: rmdir d4/de/d40 39 2024-01-17T23:37:20.086 INFO:tasks.workunit.client.0.smithi067.stdout:8/327: getdents d6/d19 0 2024-01-17T23:37:20.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/328: dread d6/d19/d22/d25/d53/f2d [0,4194304] 0 2024-01-17T23:37:20.088 INFO:tasks.workunit.client.0.smithi067.stdout:8/329: truncate d6/d19/d22/d25/f59 809379 0 2024-01-17T23:37:20.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/330: dwrite d6/d19/d22/d25/f59 [0,4194304] 0 2024-01-17T23:37:20.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/331: chown d6/d26 5620221 1 2024-01-17T23:37:20.134 INFO:tasks.workunit.client.0.smithi067.stdout:8/332: dwrite d6/d26/d3e/f74 [0,4194304] 0 2024-01-17T23:37:20.256 INFO:tasks.workunit.client.0.smithi067.stdout:3/367: truncate d0/f11 525056 0 2024-01-17T23:37:20.322 INFO:tasks.workunit.client.0.smithi067.stdout:1/334: symlink d0/d62/l63 0 2024-01-17T23:37:20.327 INFO:tasks.workunit.client.0.smithi067.stdout:1/335: dread d0/d7/f4c [0,4194304] 0 2024-01-17T23:37:20.753 INFO:tasks.workunit.client.0.smithi067.stdout:2/340: symlink d5/d1f/d2a/d54/d8/d32/d33/l76 0 2024-01-17T23:37:20.754 INFO:tasks.workunit.client.0.smithi067.stdout:2/341: fdatasync d5/d1f/d2a/d54/d25/f59 0 2024-01-17T23:37:21.004 INFO:tasks.workunit.client.0.smithi067.stdout:6/319: symlink d6/d9/d30/l6b 0 2024-01-17T23:37:21.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/318: mkdir d4/d25/d39/d46/d60 0 2024-01-17T23:37:21.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/319: fsync d4/d25/f49 0 2024-01-17T23:37:21.839 INFO:tasks.workunit.client.0.smithi067.stdout:8/333: link d6/d26/d3e/f74 d6/d26/d3e/f79 0 2024-01-17T23:37:21.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/334: read d6/d26/d3e/f74 [2381823,103154] 0 2024-01-17T23:37:21.983 INFO:tasks.workunit.client.0.smithi067.stdout:4/291: getdents d3/d5 0 2024-01-17T23:37:22.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/368: dread d0/f3 [0,4194304] 0 2024-01-17T23:37:22.300 INFO:tasks.workunit.client.0.smithi067.stdout:1/336: creat d0/d62/f64 x:0 0 0 2024-01-17T23:37:22.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/279: rename d3/d53 to d3/d25/d5d 0 2024-01-17T23:37:22.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/280: dwrite d3/d6/d11/d50/f43 [0,4194304] 0 2024-01-17T23:37:22.910 INFO:tasks.workunit.client.0.smithi067.stdout:6/320: creat d6/d9/d3e/f6c x:0 0 0 2024-01-17T23:37:23.456 INFO:tasks.workunit.client.0.smithi067.stdout:4/292: mkdir d3/d8/d55 0 2024-01-17T23:37:23.456 INFO:tasks.workunit.client.0.smithi067.stdout:1/337: unlink d0/d32/d35/l4e 0 2024-01-17T23:37:23.457 INFO:tasks.workunit.client.0.smithi067.stdout:1/338: creat d0/d62/f65 x:0 0 0 2024-01-17T23:37:23.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/369: dread d0/d13/f33 [0,4194304] 0 2024-01-17T23:37:23.576 INFO:tasks.workunit.client.0.smithi067.stdout:5/247: rename d10/f12 to d10/d24/d25/f4f 0 2024-01-17T23:37:23.704 INFO:tasks.workunit.client.0.smithi067.stdout:9/281: creat d3/f5e x:0 0 0 2024-01-17T23:37:23.729 INFO:tasks.workunit.client.0.smithi067.stdout:9/282: dwrite d3/d6/f9 [4194304,4194304] 0 2024-01-17T23:37:23.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/321: creat d6/d9/d30/d4c/f6d x:0 0 0 2024-01-17T23:37:23.910 INFO:tasks.workunit.client.0.smithi067.stdout:4/293: rmdir d3/d8/d35/d36 39 2024-01-17T23:37:24.242 INFO:tasks.workunit.client.0.smithi067.stdout:0/319: rename d3/d5/l60 to d3/d64/d7d/l8a 0 2024-01-17T23:37:24.256 INFO:tasks.workunit.client.0.smithi067.stdout:0/320: write d3/d6/dd/f4a [3783196,1626] 0 2024-01-17T23:37:24.297 INFO:tasks.workunit.client.0.smithi067.stdout:0/321: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:37:24.297 INFO:tasks.workunit.client.0.smithi067.stdout:0/322: stat d3/d6/f2f 0 2024-01-17T23:37:24.312 INFO:tasks.workunit.client.0.smithi067.stdout:0/323: dread d3/d5/d1a/f24 [0,4194304] 0 2024-01-17T23:37:24.339 INFO:tasks.workunit.client.0.smithi067.stdout:5/248: mkdir d10/d24/d46/d4a/d50 0 2024-01-17T23:37:24.345 INFO:tasks.workunit.client.0.smithi067.stdout:0/324: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:37:24.366 INFO:tasks.workunit.client.0.smithi067.stdout:5/249: dwrite d10/d24/f36 [0,4194304] 0 2024-01-17T23:37:24.404 INFO:tasks.workunit.client.0.smithi067.stdout:5/250: dwrite d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:37:24.657 INFO:tasks.workunit.client.0.smithi067.stdout:9/283: truncate d3/d6/d2a/f3f 3862450 0 2024-01-17T23:37:24.894 INFO:tasks.workunit.client.0.smithi067.stdout:4/294: creat d3/d8/de/d20/f56 x:0 0 0 2024-01-17T23:37:25.092 INFO:tasks.workunit.client.0.smithi067.stdout:7/320: rename d4/d16/f51 to d4/d4b/f61 0 2024-01-17T23:37:25.379 INFO:tasks.workunit.client.0.smithi067.stdout:9/284: symlink d3/d6/d2a/d34/d42/l5f 0 2024-01-17T23:37:25.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/295: mknod d3/d5/c57 0 2024-01-17T23:37:25.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/296: fdatasync d3/d8/de/f54 0 2024-01-17T23:37:25.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/297: fsync d3/f7 0 2024-01-17T23:37:25.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/298: dread d3/d26/f33 [0,4194304] 0 2024-01-17T23:37:25.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/335: rename d6/d26/d3e/c68 to d6/d19/d22/d25/d53/d48/c7a 0 2024-01-17T23:37:25.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/336: fdatasync d6/db/f34 0 2024-01-17T23:37:25.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/337: write d6/d19/d22/d25/d53/d65/f23 [3044677,84268] 0 2024-01-17T23:37:25.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/338: fdatasync d6/d19/d22/d25/f5d 0 2024-01-17T23:37:25.684 INFO:tasks.workunit.client.0.smithi067.stdout:7/321: symlink d4/d25/l62 0 2024-01-17T23:37:25.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/285: symlink d3/d6/d47/l60 0 2024-01-17T23:37:25.771 INFO:tasks.workunit.client.0.smithi067.stdout:9/286: write d3/f5 [2679556,78248] 0 2024-01-17T23:37:25.772 INFO:tasks.workunit.client.0.smithi067.stdout:2/342: sync 2024-01-17T23:37:25.772 INFO:tasks.workunit.client.0.smithi067.stdout:2/343: chown d5/d1f/f43 0 1 2024-01-17T23:37:25.840 INFO:tasks.workunit.client.0.smithi067.stdout:6/322: rmdir d6/d9/d3e 39 2024-01-17T23:37:25.840 INFO:tasks.workunit.client.0.smithi067.stdout:6/323: chown d6/f8 390204797 1 2024-01-17T23:37:25.946 INFO:tasks.workunit.client.0.smithi067.stdout:5/251: rename d10/d24/d46/f4c to d10/d3f/f51 0 2024-01-17T23:37:26.205 INFO:tasks.workunit.client.0.smithi067.stdout:7/322: mkdir d4/d4b/d63 0 2024-01-17T23:37:26.206 INFO:tasks.workunit.client.0.smithi067.stdout:9/287: symlink d3/d25/d5d/l61 0 2024-01-17T23:37:26.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/323: dread - d4/d16/f4e zero size 2024-01-17T23:37:26.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/324: dread d4/de/f3e [0,4194304] 0 2024-01-17T23:37:26.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/325: chown d4/d25/c57 536024 1 2024-01-17T23:37:26.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/326: chown d4/d25/f33 65 1 2024-01-17T23:37:26.397 INFO:tasks.workunit.client.0.smithi067.stdout:2/344: mknod d5/d1f/c77 0 2024-01-17T23:37:26.397 INFO:tasks.workunit.client.0.smithi067.stdout:2/345: fsync d5/d1f/f64 0 2024-01-17T23:37:26.489 INFO:tasks.workunit.client.0.smithi067.stdout:6/324: symlink d6/d9/d1c/l6e 0 2024-01-17T23:37:26.676 INFO:tasks.workunit.client.0.smithi067.stdout:4/299: rename d3/d5/c15 to d3/d26/d34/d3a/c58 0 2024-01-17T23:37:26.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/300: dwrite d3/f7 [0,4194304] 0 2024-01-17T23:37:26.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/301: dwrite d3/d5/fc [4194304,4194304] 0 2024-01-17T23:37:26.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/302: write d3/d8/f1f [3241992,49585] 0 2024-01-17T23:37:26.969 INFO:tasks.workunit.client.0.smithi067.stdout:9/288: truncate d3/d6/fe 673253 0 2024-01-17T23:37:27.162 INFO:tasks.workunit.client.0.smithi067.stdout:7/327: mknod d4/d25/d39/d46/c64 0 2024-01-17T23:37:27.194 INFO:tasks.workunit.client.0.smithi067.stdout:7/328: dwrite d4/d25/f5a [0,4194304] 0 2024-01-17T23:37:27.194 INFO:tasks.workunit.client.0.smithi067.stdout:7/329: readlink d4/de/l5e 0 2024-01-17T23:37:27.194 INFO:tasks.workunit.client.0.smithi067.stdout:7/330: fdatasync d4/d25/f49 0 2024-01-17T23:37:27.375 INFO:tasks.workunit.client.0.smithi067.stdout:6/325: getdents d6/d9/d30/d58 0 2024-01-17T23:37:27.642 INFO:tasks.workunit.client.0.smithi067.stdout:3/370: sync 2024-01-17T23:37:27.642 INFO:tasks.workunit.client.0.smithi067.stdout:1/339: sync 2024-01-17T23:37:27.642 INFO:tasks.workunit.client.0.smithi067.stdout:1/340: chown d0/d2d/d31 7 1 2024-01-17T23:37:27.653 INFO:tasks.workunit.client.0.smithi067.stdout:1/341: dread d0/d7/f36 [0,4194304] 0 2024-01-17T23:37:28.020 INFO:tasks.workunit.client.0.smithi067.stdout:7/331: unlink d4/d4b/c5f 0 2024-01-17T23:37:28.191 INFO:tasks.workunit.client.0.smithi067.stdout:6/326: creat d6/d18/f6f x:0 0 0 2024-01-17T23:37:28.201 INFO:tasks.workunit.client.0.smithi067.stdout:6/327: dread d6/d18/d44/f48 [0,4194304] 0 2024-01-17T23:37:28.201 INFO:tasks.workunit.client.0.smithi067.stdout:6/328: write d6/d18/d44/d51/f5d [408674,60165] 0 2024-01-17T23:37:28.201 INFO:tasks.workunit.client.0.smithi067.stdout:6/329: creat d6/d9/d30/f70 x:0 0 0 2024-01-17T23:37:28.202 INFO:tasks.workunit.client.0.smithi067.stdout:6/330: write d6/f8 [429914,110590] 0 2024-01-17T23:37:28.228 INFO:tasks.workunit.client.0.smithi067.stdout:6/331: dwrite d6/f3d [0,4194304] 0 2024-01-17T23:37:28.453 INFO:tasks.workunit.client.0.smithi067.stdout:1/342: creat d0/d7/f66 x:0 0 0 2024-01-17T23:37:28.453 INFO:tasks.workunit.client.0.smithi067.stdout:1/343: fsync d0/f27 0 2024-01-17T23:37:28.545 INFO:tasks.workunit.client.0.smithi067.stdout:9/289: symlink d3/d6/d2e/l62 0 2024-01-17T23:37:28.545 INFO:tasks.workunit.client.0.smithi067.stdout:9/290: chown d3/d6/d2a/d34/d42/l5f 121632498 1 2024-01-17T23:37:28.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/344: creat d0/d2d/d31/f67 x:0 0 0 2024-01-17T23:37:28.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/345: stat d0/d7/d13/d2e/f34 0 2024-01-17T23:37:28.963 INFO:tasks.workunit.client.0.smithi067.stdout:1/346: dwrite d0/d7/d13/d2e/f34 [0,4194304] 0 2024-01-17T23:37:28.974 INFO:tasks.workunit.client.0.smithi067.stdout:9/291: creat d3/d6/d2e/f63 x:0 0 0 2024-01-17T23:37:29.006 INFO:tasks.workunit.client.0.smithi067.stdout:9/292: dwrite d3/d6/d2e/f3d [0,4194304] 0 2024-01-17T23:37:30.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/347: mknod d0/d7/d13/d2e/c68 0 2024-01-17T23:37:31.367 INFO:tasks.workunit.client.0.smithi067.stdout:4/303: dwrite d3/d26/d34/d3a/f45 [0,4194304] 0 2024-01-17T23:37:31.381 INFO:tasks.workunit.client.0.smithi067.stdout:4/304: dread d3/f7 [0,4194304] 0 2024-01-17T23:37:31.381 INFO:tasks.workunit.client.0.smithi067.stdout:4/305: write d3/d8/f1f [2922422,105328] 0 2024-01-17T23:37:31.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/332: rename d4/de/f3e to d4/f65 0 2024-01-17T23:37:31.689 INFO:tasks.workunit.client.0.smithi067.stdout:4/306: rmdir d3/d8/d55 0 2024-01-17T23:37:31.689 INFO:tasks.workunit.client.0.smithi067.stdout:4/307: fsync d3/d40/f41 0 2024-01-17T23:37:31.846 INFO:tasks.workunit.client.0.smithi067.stdout:8/339: creat d6/f7b x:0 0 0 2024-01-17T23:37:31.929 INFO:tasks.workunit.client.0.smithi067.stdout:7/333: unlink d4/d25/l36 0 2024-01-17T23:37:31.929 INFO:tasks.workunit.client.0.smithi067.stdout:7/334: write d4/de/f58 [210992,9919] 0 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/346: creat d5/f78 x:0 0 0 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/347: chown d5/d1f/d2a/d55/l5d 75577 1 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/348: write d5/d1f/f3c [5165723,29927] 0 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/349: read d5/d1f/d35/f6d [550379,33449] 0 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/350: fsync d5/d1f/d35/f5c 0 2024-01-17T23:37:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/351: dread - d5/d1f/d35/f5c zero size 2024-01-17T23:37:33.140 INFO:tasks.workunit.client.0.smithi067.stdout:8/340: mkdir d6/d26/d7c 0 2024-01-17T23:37:33.180 INFO:tasks.workunit.client.0.smithi067.stdout:4/308: mkdir d3/d59 0 2024-01-17T23:37:33.220 INFO:tasks.workunit.client.0.smithi067.stdout:6/332: dwrite d6/d9/d1c/d1e/f5e [4194304,4194304] 0 2024-01-17T23:37:33.383 INFO:tasks.workunit.client.0.smithi067.stdout:2/352: truncate d5/d1f/d2a/d54/d8/f3f 1191638 0 2024-01-17T23:37:33.547 INFO:tasks.workunit.client.0.smithi067.stdout:5/252: mknod d10/c52 0 2024-01-17T23:37:33.783 INFO:tasks.workunit.client.0.smithi067.stdout:2/353: symlink d5/l79 0 2024-01-17T23:37:33.842 INFO:tasks.workunit.client.0.smithi067.stdout:2/354: dwrite d5/d1f/d16/f20 [0,4194304] 0 2024-01-17T23:37:33.842 INFO:tasks.workunit.client.0.smithi067.stdout:2/355: chown d5/d1f/f64 2773962 1 2024-01-17T23:37:33.896 INFO:tasks.workunit.client.0.smithi067.stdout:2/356: dwrite d5/d1f/d2a/d54/d25/f59 [0,4194304] 0 2024-01-17T23:37:33.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/371: rmdir d0/d13 39 2024-01-17T23:37:33.926 INFO:tasks.workunit.client.0.smithi067.stdout:5/253: mkdir d10/d53 0 2024-01-17T23:37:33.939 INFO:tasks.workunit.client.0.smithi067.stdout:5/254: dread d10/f11 [0,4194304] 0 2024-01-17T23:37:33.940 INFO:tasks.workunit.client.0.smithi067.stdout:5/255: chown fd 151488084 1 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/348: write d0/d7/d13/d2e/f52 [494290,58093] 0 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/325: mknod d3/c8b 0 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/326: chown d3/d6/dd/f3b 18641 1 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/327: chown d3/d4c 762391 1 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/349: fsync d0/d2d/f5f 0 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/328: fsync d3/d5/d1a/f42 0 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/350: write d0/d7/d13/d3a/f59 [626483,101697] 0 2024-01-17T23:37:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/351: fsync d0/d7/d13/d3a/d3e/f57 0 2024-01-17T23:37:34.915 INFO:tasks.workunit.client.0.smithi067.stdout:3/372: mkdir d0/d13/d4a/d75 0 2024-01-17T23:37:35.043 INFO:tasks.workunit.client.0.smithi067.stdout:5/256: creat d10/d24/d46/f54 x:0 0 0 2024-01-17T23:37:35.376 INFO:tasks.workunit.client.0.smithi067.stdout:0/329: link d3/d6/dd/d43/l49 d3/d6/dd/d43/l8c 0 2024-01-17T23:37:35.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/352: mkdir d0/d69 0 2024-01-17T23:37:35.763 INFO:tasks.workunit.client.0.smithi067.stdout:3/373: creat d0/d12/d59/f76 x:0 0 0 2024-01-17T23:37:35.763 INFO:tasks.workunit.client.0.smithi067.stdout:3/374: fdatasync d0/d12/d1b/d4d/f5b 0 2024-01-17T23:37:35.764 INFO:tasks.workunit.client.0.smithi067.stdout:3/375: fdatasync d0/f1e 0 2024-01-17T23:37:35.957 INFO:tasks.workunit.client.0.smithi067.stdout:5/257: getdents d10/d24/d46/d4a 0 2024-01-17T23:37:35.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/330: symlink d3/l8d 0 2024-01-17T23:37:35.990 INFO:tasks.workunit.client.0.smithi067.stdout:5/258: dwrite d10/f3d [0,4194304] 0 2024-01-17T23:37:36.000 INFO:tasks.workunit.client.0.smithi067.stdout:0/331: dwrite d3/d5/f2b [0,4194304] 0 2024-01-17T23:37:36.000 INFO:tasks.workunit.client.0.smithi067.stdout:0/332: fdatasync d3/d5/d32/f6a 0 2024-01-17T23:37:36.000 INFO:tasks.workunit.client.0.smithi067.stdout:0/333: creat d3/d5/d1a/d1c/d1d/d2e/f8e x:0 0 0 2024-01-17T23:37:36.006 INFO:tasks.workunit.client.0.smithi067.stdout:5/259: dread d10/f1a [0,4194304] 0 2024-01-17T23:37:36.022 INFO:tasks.workunit.client.0.smithi067.stdout:5/260: read d10/d3f/f41 [2802873,4638] 0 2024-01-17T23:37:36.065 INFO:tasks.workunit.client.0.smithi067.stdout:1/353: unlink d0/d7/d13/d2e/f52 0 2024-01-17T23:37:36.065 INFO:tasks.workunit.client.0.smithi067.stdout:1/354: creat d0/d2d/f6a x:0 0 0 2024-01-17T23:37:36.065 INFO:tasks.workunit.client.0.smithi067.stdout:1/355: dread - d0/d2d/d31/f67 zero size 2024-01-17T23:37:36.065 INFO:tasks.workunit.client.0.smithi067.stdout:1/356: dread - d0/d7/d13/d3a/d3e/f5e zero size 2024-01-17T23:37:36.068 INFO:tasks.workunit.client.0.smithi067.stdout:1/357: dread d0/d7/f4c [0,4194304] 0 2024-01-17T23:37:36.273 INFO:tasks.workunit.client.0.smithi067.stdout:3/376: mknod d0/d17/c77 0 2024-01-17T23:37:36.273 INFO:tasks.workunit.client.0.smithi067.stdout:3/377: fsync d0/d12/f21 0 2024-01-17T23:37:36.274 INFO:tasks.workunit.client.0.smithi067.stdout:3/378: getdents d0/d17/d69/d6e 0 2024-01-17T23:37:36.274 INFO:tasks.workunit.client.0.smithi067.stdout:3/379: chown d0/d12/d1b/f54 421271 1 2024-01-17T23:37:36.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/334: creat d3/d5/d1a/d1c/d4e/d6b/f8f x:0 0 0 2024-01-17T23:37:36.941 INFO:tasks.workunit.client.0.smithi067.stdout:5/261: symlink d10/d3f/d43/l55 0 2024-01-17T23:37:37.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/380: symlink d0/d12/d1b/d4d/l78 0 2024-01-17T23:37:37.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/381: dread - d0/d12/d1b/d4d/f71 zero size 2024-01-17T23:37:37.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/382: stat d0/d13 0 2024-01-17T23:37:37.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/383: dwrite d0/d17/f28 [4194304,4194304] 0 2024-01-17T23:37:37.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/384: chown d0/d13/d1a/l4b 332134 1 2024-01-17T23:37:37.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/335: mkdir d3/d5/d1a/d90 0 2024-01-17T23:37:37.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/336: write d3/d5/d1a/d1c/d1d/f21 [704546,31452] 0 2024-01-17T23:37:37.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/262: symlink d10/d53/l56 0 2024-01-17T23:37:37.789 INFO:tasks.workunit.client.0.smithi067.stdout:0/337: creat d3/d5/d1a/d1c/d4e/d7c/f91 x:0 0 0 2024-01-17T23:37:37.789 INFO:tasks.workunit.client.0.smithi067.stdout:5/263: link f9 d10/d24/d46/d4a/f57 0 2024-01-17T23:37:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/264: write d10/f1f [2881300,2613] 0 2024-01-17T23:37:38.051 INFO:tasks.workunit.client.0.smithi067.stdout:9/293: rename d3/d6/d10/f37 to d3/f64 0 2024-01-17T23:37:38.195 INFO:tasks.workunit.client.0.smithi067.stdout:0/338: creat d3/d6/dd/d43/f92 x:0 0 0 2024-01-17T23:37:38.813 INFO:tasks.workunit.client.0.smithi067.stdout:8/341: rename d6/db/d58/f39 to d6/d19/d22/d25/f7d 0 2024-01-17T23:37:38.813 INFO:tasks.workunit.client.0.smithi067.stdout:4/309: rename d3 to d3/d26/d5a 22 2024-01-17T23:37:38.813 INFO:tasks.workunit.client.0.smithi067.stdout:4/310: creat d3/d26/d34/d3a/f5b x:0 0 0 2024-01-17T23:37:38.843 INFO:tasks.workunit.client.0.smithi067.stdout:8/342: dwrite d6/db/f63 [0,4194304] 0 2024-01-17T23:37:38.843 INFO:tasks.workunit.client.0.smithi067.stdout:8/343: chown d6/d19/d22 379 1 2024-01-17T23:37:39.088 INFO:tasks.workunit.client.0.smithi067.stdout:9/294: symlink d3/d25/d28/l65 0 2024-01-17T23:37:39.098 INFO:tasks.workunit.client.0.smithi067.stdout:9/295: dread d3/d6/f56 [0,4194304] 0 2024-01-17T23:37:39.109 INFO:tasks.workunit.client.0.smithi067.stdout:0/339: symlink d3/d5/d1a/d1c/d1d/d2e/l93 0 2024-01-17T23:37:39.131 INFO:tasks.workunit.client.0.smithi067.stdout:0/340: write d3/d5/f38 [950080,102159] 0 2024-01-17T23:37:39.132 INFO:tasks.workunit.client.0.smithi067.stdout:0/341: creat d3/d5/d1a/d1c/d4e/d7c/f94 x:0 0 0 2024-01-17T23:37:39.156 INFO:tasks.workunit.client.0.smithi067.stdout:0/342: dwrite d3/d5/d1a/d1c/d1d/d2e/f33 [0,4194304] 0 2024-01-17T23:37:39.419 INFO:tasks.workunit.client.0.smithi067.stdout:6/333: rename d6/d9/d1c/c57 to d6/d9/d1c/d1e/d43/c71 0 2024-01-17T23:37:39.670 INFO:tasks.workunit.client.0.smithi067.stdout:4/311: creat d3/d8/d35/f5c x:0 0 0 2024-01-17T23:37:39.671 INFO:tasks.workunit.client.0.smithi067.stdout:8/344: creat d6/d19/d22/d25/d53/f7e x:0 0 0 2024-01-17T23:37:39.696 INFO:tasks.workunit.client.0.smithi067.stdout:8/345: dwrite d6/f7b [0,4194304] 0 2024-01-17T23:37:40.245 INFO:tasks.workunit.client.0.smithi067.stdout:0/343: link d3/d6/f56 d3/d64/f95 0 2024-01-17T23:37:40.282 INFO:tasks.workunit.client.0.smithi067.stdout:0/344: dwrite d3/d5/d1a/d1c/d4e/d6b/f8f [0,4194304] 0 2024-01-17T23:37:40.323 INFO:tasks.workunit.client.0.smithi067.stdout:7/335: sync 2024-01-17T23:37:40.622 INFO:tasks.workunit.client.0.smithi067.stdout:6/334: creat d6/d9/d65/f72 x:0 0 0 2024-01-17T23:37:40.622 INFO:tasks.workunit.client.0.smithi067.stdout:6/335: dread - d6/d9/d30/f5a zero size 2024-01-17T23:37:40.783 INFO:tasks.workunit.client.0.smithi067.stdout:4/312: mknod d3/d8/d35/d36/c5d 0 2024-01-17T23:37:41.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/346: symlink d6/d19/d22/l7f 0 2024-01-17T23:37:41.991 INFO:tasks.workunit.client.0.smithi067.stdout:6/336: mknod d6/d18/d44/c73 0 2024-01-17T23:37:42.187 INFO:tasks.workunit.client.0.smithi067.stdout:4/313: truncate d3/d8/de/f14 53306 0 2024-01-17T23:37:42.187 INFO:tasks.workunit.client.0.smithi067.stdout:4/314: creat d3/d8/de/d20/f5e x:0 0 0 2024-01-17T23:37:42.471 INFO:tasks.workunit.client.0.smithi067.stdout:2/357: rmdir d5/d2f 39 2024-01-17T23:37:42.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/358: write d5/d1f/d2a/d54/f11 [552505,111628] 0 2024-01-17T23:37:42.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/359: chown d5/d1f/d16/l17 241766 1 2024-01-17T23:37:42.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/360: chown d5/d1f/d2a/d54/d25/l46 57 1 2024-01-17T23:37:42.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/361: readlink d5/d1f/d2a/d54/lc 0 2024-01-17T23:37:42.628 INFO:tasks.workunit.client.0.smithi067.stdout:6/337: mknod d6/d9/d3e/c74 0 2024-01-17T23:37:43.108 INFO:tasks.workunit.client.0.smithi067.stdout:2/362: truncate d5/d1f/d2a/f52 2181069 0 2024-01-17T23:37:43.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:43.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:37:43.265 INFO:tasks.workunit.client.0.smithi067.stdout:6/338: link d6/d9/d1c/d1e/f62 d6/f75 0 2024-01-17T23:37:43.298 INFO:tasks.workunit.client.0.smithi067.stdout:6/339: dwrite d6/d9/f31 [0,4194304] 0 2024-01-17T23:37:43.623 INFO:tasks.workunit.client.0.smithi067.stdout:6/340: rmdir d6 39 2024-01-17T23:37:43.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/341: creat d6/d18/d2e/f76 x:0 0 0 2024-01-17T23:37:43.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/342: write d6/d9/d65/f72 [593962,8612] 0 2024-01-17T23:37:43.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/343: creat d6/d18/d2e/f77 x:0 0 0 2024-01-17T23:37:43.650 INFO:tasks.workunit.client.0.smithi067.stdout:6/344: dwrite d6/d9/d30/f5a [0,4194304] 0 2024-01-17T23:37:44.122 INFO:tasks.workunit.client.0.smithi067.stdout:8/347: dwrite d6/db/f41 [4194304,4194304] 0 2024-01-17T23:37:44.172 INFO:tasks.workunit.client.0.smithi067.stdout:0/345: truncate d3/d5/f2b 3986016 0 2024-01-17T23:37:44.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/346: write d3/d5/d1a/d1c/d4d/f65 [411355,62512] 0 2024-01-17T23:37:44.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/347: write d3/d5/d1a/d1c/d4e/f7e [610914,15143] 0 2024-01-17T23:37:44.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/348: chown d3/d5/d1a/d1c/d4e/d7c 196880 1 2024-01-17T23:37:44.187 INFO:tasks.workunit.client.0.smithi067.stdout:0/349: chown d3/d5/d32/l3c 617 1 2024-01-17T23:37:44.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/345: mkdir d6/d9/d1c/d1e/d43/d78 0 2024-01-17T23:37:44.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/346: fdatasync d6/d18/d2e/f76 0 2024-01-17T23:37:44.492 INFO:tasks.workunit.client.0.smithi067.stdout:1/358: rename d0/l6 to d0/d7/d13/l6b 0 2024-01-17T23:37:44.589 INFO:tasks.workunit.client.0.smithi067.stdout:8/348: mknod d6/db/d58/d5f/c80 0 2024-01-17T23:37:44.589 INFO:tasks.workunit.client.0.smithi067.stdout:8/349: write d6/d19/d22/d25/d53/f16 [341908,128066] 0 2024-01-17T23:37:44.837 INFO:tasks.workunit.client.0.smithi067.stdout:0/350: creat d3/d4c/f96 x:0 0 0 2024-01-17T23:37:45.510 INFO:tasks.workunit.client.0.smithi067.stdout:3/385: rename d0/d12/d1b/d4d/f5b to d0/d34/d35/d57/f79 0 2024-01-17T23:37:45.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/386: chown d0/d17/c77 48800 1 2024-01-17T23:37:45.687 INFO:tasks.workunit.client.0.smithi067.stdout:1/359: truncate d0/d7/f55 4063271 0 2024-01-17T23:37:45.687 INFO:tasks.workunit.client.0.smithi067.stdout:1/360: chown d0/c25 0 1 2024-01-17T23:37:45.687 INFO:tasks.workunit.client.0.smithi067.stdout:8/350: mknod d6/d19/d22/d25/d53/c81 0 2024-01-17T23:37:45.688 INFO:tasks.workunit.client.0.smithi067.stdout:8/351: chown d6/d19 1085 1 2024-01-17T23:37:45.830 INFO:tasks.workunit.client.0.smithi067.stdout:0/351: truncate d3/f11 4812715 0 2024-01-17T23:37:45.830 INFO:tasks.workunit.client.0.smithi067.stdout:0/352: readlink d3/d5/d1a/d1c/d1d/d2e/l67 0 2024-01-17T23:37:45.830 INFO:tasks.workunit.client.0.smithi067.stdout:0/353: fsync d3/d5/d1a/d1c/d1d/d2e/f89 0 2024-01-17T23:37:45.830 INFO:tasks.workunit.client.0.smithi067.stdout:0/354: readlink d3/d6/dd/l2a 0 2024-01-17T23:37:46.231 INFO:tasks.workunit.client.0.smithi067.stdout:5/265: rename d10/d24/d25/c3a to d10/d53/c58 0 2024-01-17T23:37:46.407 INFO:tasks.workunit.client.0.smithi067.stdout:8/352: symlink d6/d26/d56/l82 0 2024-01-17T23:37:46.407 INFO:tasks.workunit.client.0.smithi067.stdout:8/353: write d6/d19/d22/f72 [485868,47590] 0 2024-01-17T23:37:46.521 INFO:tasks.workunit.client.0.smithi067.stdout:0/355: creat d3/d5/d1a/d1c/d4d/f97 x:0 0 0 2024-01-17T23:37:46.543 INFO:tasks.workunit.client.0.smithi067.stdout:0/356: dread d3/d6/dd/d43/f59 [0,4194304] 0 2024-01-17T23:37:46.772 INFO:tasks.workunit.client.0.smithi067.stdout:8/354: mknod d6/d26/d3e/c83 0 2024-01-17T23:37:46.772 INFO:tasks.workunit.client.0.smithi067.stdout:5/266: truncate d10/d3f/f51 2414140 0 2024-01-17T23:37:46.893 INFO:tasks.workunit.client.0.smithi067.stdout:4/315: sync 2024-01-17T23:37:46.894 INFO:tasks.workunit.client.0.smithi067.stdout:7/336: sync 2024-01-17T23:37:46.894 INFO:tasks.workunit.client.0.smithi067.stdout:7/337: fdatasync d4/d25/f38 0 2024-01-17T23:37:46.978 INFO:tasks.workunit.client.0.smithi067.stdout:0/357: symlink d3/d5/d32/d7f/l98 0 2024-01-17T23:37:46.978 INFO:tasks.workunit.client.0.smithi067.stdout:0/358: fsync d3/d6/dd/f4a 0 2024-01-17T23:37:47.017 INFO:tasks.workunit.client.0.smithi067.stdout:0/359: dwrite d3/d5/d1a/d1c/d4e/f7e [0,4194304] 0 2024-01-17T23:37:47.033 INFO:tasks.workunit.client.0.smithi067.stdout:0/360: dread d3/d5/f38 [0,4194304] 0 2024-01-17T23:37:47.033 INFO:tasks.workunit.client.0.smithi067.stdout:0/361: stat d3/d5/d1a/d1c/d1d/d2e/c6c 0 2024-01-17T23:37:47.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/316: dwrite d3/d8/d35/d36/f48 [0,4194304] 0 2024-01-17T23:37:47.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/317: chown d3/d8/d35/c46 5 1 2024-01-17T23:37:47.388 INFO:tasks.workunit.client.0.smithi067.stdout:6/347: write d6/d9/f10 [1639944,36808] 0 2024-01-17T23:37:47.388 INFO:tasks.workunit.client.0.smithi067.stdout:6/348: stat d6/c39 0 2024-01-17T23:37:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:5/267: mkdir d10/d24/d59 0 2024-01-17T23:37:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:5/268: truncate d10/d24/d25/f2e 215055 0 2024-01-17T23:37:48.280 INFO:tasks.workunit.client.0.smithi067.stdout:5/269: dwrite d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:37:48.280 INFO:tasks.workunit.client.0.smithi067.stdout:0/362: write d3/d5/d1a/f2c [1620453,44757] 0 2024-01-17T23:37:48.306 INFO:tasks.workunit.client.0.smithi067.stdout:0/363: dwrite d3/d6/f4b [0,4194304] 0 2024-01-17T23:37:48.306 INFO:tasks.workunit.client.0.smithi067.stdout:0/364: truncate d3/d6/dd/d43/f92 105403 0 2024-01-17T23:37:48.329 INFO:tasks.workunit.client.0.smithi067.stdout:4/318: truncate d3/d40/f41 3289271 0 2024-01-17T23:37:48.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/319: write d3/d8/f13 [6945906,84057] 0 2024-01-17T23:37:48.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/349: symlink d6/d18/d2e/d61/l79 0 2024-01-17T23:37:48.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/350: readlink d6/d9/d1c/l6e 0 2024-01-17T23:37:48.601 INFO:tasks.workunit.client.0.smithi067.stdout:3/387: getdents d0/d34/d35/d57 0 2024-01-17T23:37:48.601 INFO:tasks.workunit.client.0.smithi067.stdout:3/388: read - d0/d12/f6d zero size 2024-01-17T23:37:48.808 INFO:tasks.workunit.client.0.smithi067.stdout:8/355: getdents d6/d26/d56 0 2024-01-17T23:37:49.093 INFO:tasks.workunit.client.0.smithi067.stdout:5/270: mkdir d10/d24/d46/d4a/d50/d5a 0 2024-01-17T23:37:49.125 INFO:tasks.workunit.client.0.smithi067.stdout:5/271: dwrite d10/f16 [0,4194304] 0 2024-01-17T23:37:49.125 INFO:tasks.workunit.client.0.smithi067.stdout:5/272: write d10/f19 [4981642,18118] 0 2024-01-17T23:37:49.153 INFO:tasks.workunit.client.0.smithi067.stdout:5/273: dwrite d10/d3f/f4d [0,4194304] 0 2024-01-17T23:37:49.173 INFO:tasks.workunit.client.0.smithi067.stdout:5/274: dread d10/d24/d25/f4f [4194304,4194304] 0 2024-01-17T23:37:49.173 INFO:tasks.workunit.client.0.smithi067.stdout:5/275: creat d10/d24/d46/f5b x:0 0 0 2024-01-17T23:37:49.186 INFO:tasks.workunit.client.0.smithi067.stdout:5/276: write d10/f3d [3227679,126235] 0 2024-01-17T23:37:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:0/365: symlink d3/d5/d1a/d1c/d4d/l99 0 2024-01-17T23:37:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:0/366: dread - d3/d5/d1a/d1c/d4e/f6f zero size 2024-01-17T23:37:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:0/367: readlink d3/d5/d1a/d1c/d1d/l39 0 2024-01-17T23:37:49.429 INFO:tasks.workunit.client.0.smithi067.stdout:0/368: dwrite d3/d5/d1a/d1c/d4e/f51 [0,4194304] 0 2024-01-17T23:37:49.532 INFO:tasks.workunit.client.0.smithi067.stdout:4/320: symlink d3/d8/de/d38/l5f 0 2024-01-17T23:37:49.562 INFO:tasks.workunit.client.0.smithi067.stdout:4/321: dwrite d3/d26/d34/d3a/f45 [0,4194304] 0 2024-01-17T23:37:49.728 INFO:tasks.workunit.client.0.smithi067.stdout:6/351: symlink d6/l7a 0 2024-01-17T23:37:50.017 INFO:tasks.workunit.client.0.smithi067.stdout:8/356: truncate d6/f1a 3217456 0 2024-01-17T23:37:50.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/357: write d6/db/d58/f51 [982978,29387] 0 2024-01-17T23:37:50.043 INFO:tasks.workunit.client.0.smithi067.stdout:8/358: dwrite d6/d19/d22/f72 [0,4194304] 0 2024-01-17T23:37:50.673 INFO:tasks.workunit.client.0.smithi067.stdout:5/277: mkdir d10/d24/d25/d5c 0 2024-01-17T23:37:50.959 INFO:tasks.workunit.client.0.smithi067.stdout:0/369: unlink d3/d5/d1a/d1c/d1d/d2e/f33 0 2024-01-17T23:37:51.079 INFO:tasks.workunit.client.0.smithi067.stdout:4/322: mknod d3/d26/d34/d3a/d53/c60 0 2024-01-17T23:37:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/296: rename f0 to d3/d6/d10/f66 0 2024-01-17T23:37:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/297: chown d3/d25/d28/l65 1068437814 1 2024-01-17T23:37:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:8/359: creat d6/db/f84 x:0 0 0 2024-01-17T23:37:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/298: chown d3/f13 85 1 2024-01-17T23:37:51.774 INFO:tasks.workunit.client.0.smithi067.stdout:8/360: readlink d6/la 0 2024-01-17T23:37:51.869 INFO:tasks.workunit.client.0.smithi067.stdout:3/389: write d0/d13/f33 [1799349,128911] 0 2024-01-17T23:37:51.869 INFO:tasks.workunit.client.0.smithi067.stdout:3/390: write d0/d13/f3c [1042339,27180] 0 2024-01-17T23:37:51.982 INFO:tasks.workunit.client.0.smithi067.stdout:0/370: creat d3/d5/d1a/d1c/d1d/f9a x:0 0 0 2024-01-17T23:37:51.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/371: stat d3/d75 0 2024-01-17T23:37:51.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/372: fdatasync d3/d5/f38 0 2024-01-17T23:37:51.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/373: write d3/d5/f36 [1043064,43755] 0 2024-01-17T23:37:52.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/323: mknod d3/d8/de/d20/d3b/c61 0 2024-01-17T23:37:52.433 INFO:tasks.workunit.client.0.smithi067.stdout:2/363: rename d5/d1f/d2a/l72 to d5/d1f/d2a/d54/d25/l7a 0 2024-01-17T23:37:52.474 INFO:tasks.workunit.client.0.smithi067.stdout:8/361: unlink d6/d19/d22/d25/d53/l2c 0 2024-01-17T23:37:52.552 INFO:tasks.workunit.client.0.smithi067.stdout:9/299: creat d3/d15/f67 x:0 0 0 2024-01-17T23:37:52.586 INFO:tasks.workunit.client.0.smithi067.stdout:9/300: dwrite d3/d6/f56 [0,4194304] 0 2024-01-17T23:37:52.756 INFO:tasks.workunit.client.0.smithi067.stdout:0/374: symlink d3/d5/d1a/l9b 0 2024-01-17T23:37:52.791 INFO:tasks.workunit.client.0.smithi067.stdout:3/391: dwrite d0/f5 [4194304,4194304] 0 2024-01-17T23:37:54.439 INFO:tasks.workunit.client.0.smithi067.stdout:0/375: symlink d3/d5/d1a/d1c/d1d/d2e/d5a/l9c 0 2024-01-17T23:37:54.461 INFO:tasks.workunit.client.0.smithi067.stdout:0/376: dread d3/d5/d1a/f3f [0,4194304] 0 2024-01-17T23:37:54.462 INFO:tasks.workunit.client.0.smithi067.stdout:0/377: write d3/d5/f38 [74982,52740] 0 2024-01-17T23:37:54.462 INFO:tasks.workunit.client.0.smithi067.stdout:0/378: fsync d3/d5/d1a/d1c/d1d/d2e/d5a/f88 0 2024-01-17T23:37:54.482 INFO:tasks.workunit.client.0.smithi067.stdout:3/392: readlink d0/l56 0 2024-01-17T23:37:54.483 INFO:tasks.workunit.client.0.smithi067.stdout:2/364: getdents d5/d1f/d35 0 2024-01-17T23:37:54.500 INFO:tasks.workunit.client.0.smithi067.stdout:7/338: sync 2024-01-17T23:37:54.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/365: dwrite d5/d1f/d2a/d54/d8/d32/d33/f6f [0,4194304] 0 2024-01-17T23:37:54.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/366: write d5/d1f/d2a/d55/f71 [887618,4811] 0 2024-01-17T23:37:54.515 INFO:tasks.workunit.client.0.smithi067.stdout:7/339: dread d4/fd [0,4194304] 0 2024-01-17T23:37:54.515 INFO:tasks.workunit.client.0.smithi067.stdout:7/340: truncate d4/d25/d39/f30 1429975 0 2024-01-17T23:37:54.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/341: chown d4/d16 7578 1 2024-01-17T23:37:54.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/342: read - d4/f5d zero size 2024-01-17T23:37:54.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/343: read d4/f6 [1910906,27605] 0 2024-01-17T23:37:54.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/344: dread d4/de/f4d [0,4194304] 0 2024-01-17T23:37:54.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/345: stat d4/l2e 0 2024-01-17T23:37:55.062 INFO:tasks.workunit.client.0.smithi067.stdout:1/361: rename d0/c8 to d0/d32/c6c 0 2024-01-17T23:37:55.079 INFO:tasks.workunit.client.0.smithi067.stdout:4/324: write d3/d40/f41 [3618816,115900] 0 2024-01-17T23:37:55.086 INFO:tasks.workunit.client.0.smithi067.stdout:6/352: rmdir d6/d18 39 2024-01-17T23:37:55.086 INFO:tasks.workunit.client.0.smithi067.stdout:6/353: truncate d6/d18/d44/f4e 714617 0 2024-01-17T23:37:55.086 INFO:tasks.workunit.client.0.smithi067.stdout:6/354: chown d6/d9/d30/l6b 1545750 1 2024-01-17T23:37:55.086 INFO:tasks.workunit.client.0.smithi067.stdout:9/301: write d3/f13 [2173777,123164] 0 2024-01-17T23:37:55.086 INFO:tasks.workunit.client.0.smithi067.stdout:6/355: creat d6/d9/d30/f7b x:0 0 0 2024-01-17T23:37:55.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/393: symlink d0/d12/l7a 0 2024-01-17T23:37:55.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/394: fsync d0/d12/d1b/f1d 0 2024-01-17T23:37:55.903 INFO:tasks.workunit.client.0.smithi067.stdout:3/395: dread d0/d17/f4c [0,4194304] 0 2024-01-17T23:37:55.903 INFO:tasks.workunit.client.0.smithi067.stdout:3/396: chown d0/d37/c45 1 1 2024-01-17T23:37:55.903 INFO:tasks.workunit.client.0.smithi067.stdout:3/397: fsync d0/d13/d4a/d55/f72 0 2024-01-17T23:37:55.914 INFO:tasks.workunit.client.0.smithi067.stdout:2/367: symlink d5/d1f/d16/l7b 0 2024-01-17T23:37:56.174 INFO:tasks.workunit.client.0.smithi067.stdout:7/346: creat d4/d25/d39/d46/d60/f66 x:0 0 0 2024-01-17T23:37:56.174 INFO:tasks.workunit.client.0.smithi067.stdout:7/347: dread - d4/d25/d39/d46/d60/f66 zero size 2024-01-17T23:37:56.955 INFO:tasks.workunit.client.0.smithi067.stdout:4/325: creat d3/d8/d35/d36/f62 x:0 0 0 2024-01-17T23:37:57.310 INFO:tasks.workunit.client.0.smithi067.stdout:9/302: mknod d3/c68 0 2024-01-17T23:37:57.310 INFO:tasks.workunit.client.0.smithi067.stdout:9/303: fsync d3/d6/f9 0 2024-01-17T23:37:57.385 INFO:tasks.workunit.client.0.smithi067.stdout:6/356: mkdir d6/d18/d2e/d7c 0 2024-01-17T23:37:57.386 INFO:tasks.workunit.client.0.smithi067.stdout:6/357: chown d6/d9/d30/f5a 3933 1 2024-01-17T23:37:58.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/398: truncate d0/d17/f28 1735988 0 2024-01-17T23:37:58.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/362: rmdir d6/db 39 2024-01-17T23:37:58.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/363: chown d6/db/d58 0 1 2024-01-17T23:37:58.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/364: write d6/d19/f3a [445777,71852] 0 2024-01-17T23:37:58.284 INFO:tasks.workunit.client.0.smithi067.stdout:7/348: unlink d4/d25/f5a 0 2024-01-17T23:37:58.535 INFO:tasks.workunit.client.0.smithi067.stdout:4/326: creat d3/d4e/f63 x:0 0 0 2024-01-17T23:37:58.724 INFO:tasks.workunit.client.0.smithi067.stdout:9/304: symlink d3/d6/l69 0 2024-01-17T23:37:58.749 INFO:tasks.workunit.client.0.smithi067.stdout:9/305: dwrite d3/d15/f44 [4194304,4194304] 0 2024-01-17T23:37:58.853 INFO:tasks.workunit.client.0.smithi067.stdout:6/358: mknod d6/d9/d3e/c7d 0 2024-01-17T23:37:59.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/379: sync 2024-01-17T23:37:59.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/365: creat d6/d19/d22/d25/f85 x:0 0 0 2024-01-17T23:37:59.672 INFO:tasks.workunit.client.0.smithi067.stdout:9/306: mkdir d3/d15/d57/d6a 0 2024-01-17T23:37:59.672 INFO:tasks.workunit.client.0.smithi067.stdout:9/307: stat d3/d15/c21 0 2024-01-17T23:37:59.672 INFO:tasks.workunit.client.0.smithi067.stdout:9/308: creat d3/d6/d2a/d34/d42/f6b x:0 0 0 2024-01-17T23:37:59.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/359: mkdir d6/d9/d1c/d1e/d7e 0 2024-01-17T23:37:59.938 INFO:tasks.workunit.client.0.smithi067.stdout:0/380: stat d3/d5/d1a/c5e 0 2024-01-17T23:38:00.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/366: unlink f4 0 2024-01-17T23:38:00.139 INFO:tasks.workunit.client.0.smithi067.stdout:7/349: mknod d4/c67 0 2024-01-17T23:38:00.239 INFO:tasks.workunit.client.0.smithi067.stdout:5/278: rename d10/d3f to d10/d24/d59/d5d 0 2024-01-17T23:38:00.239 INFO:tasks.workunit.client.0.smithi067.stdout:5/279: chown d10 19020 1 2024-01-17T23:38:00.583 INFO:tasks.workunit.client.0.smithi067.stdout:9/309: mknod d3/d6/d11/d50/c6c 0 2024-01-17T23:38:00.583 INFO:tasks.workunit.client.0.smithi067.stdout:9/310: chown d3/d15/d55 30 1 2024-01-17T23:38:00.640 INFO:tasks.workunit.client.0.smithi067.stdout:3/399: dread d0/d17/f28 [0,4194304] 0 2024-01-17T23:38:00.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/381: symlink d3/d5/d1a/d1c/d4e/l9d 0 2024-01-17T23:38:00.934 INFO:tasks.workunit.client.0.smithi067.stdout:0/382: read d3/d5/d1a/f42 [3513957,90610] 0 2024-01-17T23:38:00.934 INFO:tasks.workunit.client.0.smithi067.stdout:0/383: creat d3/d5/d1a/d1c/d4e/d7c/f9e x:0 0 0 2024-01-17T23:38:01.154 INFO:tasks.workunit.client.0.smithi067.stdout:8/367: mknod d6/d19/d22/d25/d53/d54/c86 0 2024-01-17T23:38:01.155 INFO:tasks.workunit.client.0.smithi067.stdout:8/368: write d6/d26/d3e/f74 [2569229,46800] 0 2024-01-17T23:38:01.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/350: truncate d4/d25/d39/f35 1523029 0 2024-01-17T23:38:01.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/351: chown d4/d25/c57 25259 1 2024-01-17T23:38:01.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/352: stat d4/d4b/d63 0 2024-01-17T23:38:01.167 INFO:tasks.workunit.client.0.smithi067.stdout:7/353: dread d4/f18 [0,4194304] 0 2024-01-17T23:38:01.168 INFO:tasks.workunit.client.0.smithi067.stdout:7/354: dread d4/f19 [0,4194304] 0 2024-01-17T23:38:01.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/355: dwrite d4/f2d [0,4194304] 0 2024-01-17T23:38:01.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/356: dread - d4/d16/f4e zero size 2024-01-17T23:38:01.836 INFO:tasks.workunit.client.0.smithi067.stdout:0/384: dread d3/d6/f1e [0,4194304] 0 2024-01-17T23:38:01.851 INFO:tasks.workunit.client.0.smithi067.stdout:0/385: dread d3/d5/d1a/f42 [0,4194304] 0 2024-01-17T23:38:02.003 INFO:tasks.workunit.client.0.smithi067.stdout:4/327: dwrite d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:38:02.057 INFO:tasks.workunit.client.0.smithi067.stdout:8/369: mkdir d6/d26/d3e/d87 0 2024-01-17T23:38:02.082 INFO:tasks.workunit.client.0.smithi067.stdout:8/370: dwrite d6/db/d58/f73 [0,4194304] 0 2024-01-17T23:38:02.119 INFO:tasks.workunit.client.0.smithi067.stdout:8/371: dwrite d6/d19/f2a [0,4194304] 0 2024-01-17T23:38:02.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/357: unlink d4/d25/c31 0 2024-01-17T23:38:02.661 INFO:tasks.workunit.client.0.smithi067.stdout:1/362: sync 2024-01-17T23:38:02.661 INFO:tasks.workunit.client.0.smithi067.stdout:2/368: sync 2024-01-17T23:38:02.661 INFO:tasks.workunit.client.0.smithi067.stdout:1/363: write d0/d7/d13/d3a/f51 [1424448,94648] 0 2024-01-17T23:38:02.912 INFO:tasks.workunit.client.0.smithi067.stdout:4/328: mknod d3/d4e/c64 0 2024-01-17T23:38:03.381 INFO:tasks.workunit.client.0.smithi067.stdout:8/372: rename d6/d19/d22/d25/d53/d65/c4d to d6/db/d58/d5f/c88 0 2024-01-17T23:38:03.381 INFO:tasks.workunit.client.0.smithi067.stdout:8/373: readlink d6/d19/d22/d25/d53/l3b 0 2024-01-17T23:38:03.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/374: write d6/d19/f3f [499171,51697] 0 2024-01-17T23:38:03.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/375: chown d6/db/f84 973963482 1 2024-01-17T23:38:03.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/360: sync 2024-01-17T23:38:03.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/361: fdatasync d6/d9/d30/f7b 0 2024-01-17T23:38:03.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/362: readlink d6/d9/d3e/l69 0 2024-01-17T23:38:03.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/363: write d6/f3d [4672394,30063] 0 2024-01-17T23:38:03.399 INFO:tasks.workunit.client.0.smithi067.stdout:6/364: stat d6/d9/d3e/c74 0 2024-01-17T23:38:03.458 INFO:tasks.workunit.client.0.smithi067.stdout:7/358: symlink d4/d25/d39/l68 0 2024-01-17T23:38:03.480 INFO:tasks.workunit.client.0.smithi067.stdout:7/359: read d4/de/f3a [3667342,125464] 0 2024-01-17T23:38:03.480 INFO:tasks.workunit.client.0.smithi067.stdout:7/360: truncate d4/d4b/f61 627379 0 2024-01-17T23:38:03.480 INFO:tasks.workunit.client.0.smithi067.stdout:7/361: write d4/f18 [2606440,29575] 0 2024-01-17T23:38:03.480 INFO:tasks.workunit.client.0.smithi067.stdout:7/362: write d4/de/f58 [534286,121423] 0 2024-01-17T23:38:03.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/369: mkdir d5/d1f/d2a/d54/d7c 0 2024-01-17T23:38:03.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/370: readlink d5/d1f/d2a/d54/d39/l60 0 2024-01-17T23:38:03.695 INFO:tasks.workunit.client.0.smithi067.stdout:2/371: dwrite d5/d1f/d2a/d55/f71 [0,4194304] 0 2024-01-17T23:38:03.737 INFO:tasks.workunit.client.0.smithi067.stdout:2/372: dwrite d5/d1f/d2a/d54/d25/f36 [0,4194304] 0 2024-01-17T23:38:03.751 INFO:tasks.workunit.client.0.smithi067.stdout:1/364: link d0/d7/d1c/f22 d0/d7/d13/d2e/f6d 0 2024-01-17T23:38:03.752 INFO:tasks.workunit.client.0.smithi067.stdout:1/365: stat d0/d7/d1c/f54 0 2024-01-17T23:38:03.835 INFO:tasks.workunit.client.0.smithi067.stdout:4/329: mkdir d3/d26/d34/d65 0 2024-01-17T23:38:03.898 INFO:tasks.workunit.client.0.smithi067.stdout:8/376: mkdir d6/d26/d56/d89 0 2024-01-17T23:38:03.933 INFO:tasks.workunit.client.0.smithi067.stdout:8/377: dwrite d6/d19/f3f [0,4194304] 0 2024-01-17T23:38:03.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/378: dwrite d6/d26/d56/f57 [4194304,4194304] 0 2024-01-17T23:38:03.978 INFO:tasks.workunit.client.0.smithi067.stdout:8/379: read d6/f7b [3467088,108701] 0 2024-01-17T23:38:03.978 INFO:tasks.workunit.client.0.smithi067.stdout:8/380: chown d6/d19/d22/d25/d53/f16 1018 1 2024-01-17T23:38:03.978 INFO:tasks.workunit.client.0.smithi067.stdout:8/381: truncate d6/db/f55 1695758 0 2024-01-17T23:38:04.121 INFO:tasks.workunit.client.0.smithi067.stdout:3/400: sync 2024-01-17T23:38:04.121 INFO:tasks.workunit.client.0.smithi067.stdout:6/365: creat d6/d9/d1c/d1e/f7f x:0 0 0 2024-01-17T23:38:04.145 INFO:tasks.workunit.client.0.smithi067.stdout:5/280: dwrite d10/d24/d59/d5d/f51 [0,4194304] 0 2024-01-17T23:38:04.302 INFO:tasks.workunit.client.0.smithi067.stdout:7/363: symlink d4/d25/d39/d46/d60/l69 0 2024-01-17T23:38:04.517 INFO:tasks.workunit.client.0.smithi067.stdout:9/311: write d3/d6/d11/f23 [8199867,87544] 0 2024-01-17T23:38:04.665 INFO:tasks.workunit.client.0.smithi067.stdout:2/373: mkdir d5/d1f/d16/d7d 0 2024-01-17T23:38:05.194 INFO:tasks.workunit.client.0.smithi067.stdout:0/386: rmdir d3/d6 39 2024-01-17T23:38:05.194 INFO:tasks.workunit.client.0.smithi067.stdout:0/387: chown d3/d6/f56 10182 1 2024-01-17T23:38:05.224 INFO:tasks.workunit.client.0.smithi067.stdout:0/388: dwrite d3/d6/f1e [0,4194304] 0 2024-01-17T23:38:05.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/389: dwrite d3/d5/d32/f7a [0,4194304] 0 2024-01-17T23:38:05.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/390: chown d3/d5/d32/c4f 78531500 1 2024-01-17T23:38:05.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/401: symlink d0/d34/d35/d65/l7b 0 2024-01-17T23:38:05.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/366: symlink d6/d9/d30/d4c/l80 0 2024-01-17T23:38:05.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/281: rename d10/d24/d46/d4a/d4b/l48 to d10/d24/d25/l5e 0 2024-01-17T23:38:06.136 INFO:tasks.workunit.client.0.smithi067.stdout:7/364: unlink d4/f18 0 2024-01-17T23:38:06.416 INFO:tasks.workunit.client.0.smithi067.stdout:2/374: truncate d5/d1f/f43 819393 0 2024-01-17T23:38:06.729 INFO:tasks.workunit.client.0.smithi067.stdout:0/391: mkdir d3/d5/d32/d9f 0 2024-01-17T23:38:06.729 INFO:tasks.workunit.client.0.smithi067.stdout:0/392: write d3/d6/f4b [4685740,86528] 0 2024-01-17T23:38:06.882 INFO:tasks.workunit.client.0.smithi067.stdout:1/366: mknod d0/c6e 0 2024-01-17T23:38:06.911 INFO:tasks.workunit.client.0.smithi067.stdout:1/367: dwrite d0/d7/f4c [0,4194304] 0 2024-01-17T23:38:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/282: rmdir d10/d24/d59/d5d 39 2024-01-17T23:38:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/283: readlink d10/l23 0 2024-01-17T23:38:07.733 INFO:tasks.workunit.client.0.smithi067.stdout:0/393: mknod d3/d5/d1a/d1c/d4e/d6b/ca0 0 2024-01-17T23:38:08.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/402: creat d0/f7c x:0 0 0 2024-01-17T23:38:08.017 INFO:tasks.workunit.client.0.smithi067.stdout:1/368: creat d0/f6f x:0 0 0 2024-01-17T23:38:08.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/403: truncate d0/d17/f5f 664376 0 2024-01-17T23:38:08.458 INFO:tasks.workunit.client.0.smithi067.stdout:3/404: mknod d0/d13/d4a/c7d 0 2024-01-17T23:38:08.724 INFO:tasks.workunit.client.0.smithi067.stdout:4/330: dwrite d3/d5/f3f [0,4194304] 0 2024-01-17T23:38:08.926 INFO:tasks.workunit.client.0.smithi067.stdout:8/382: write d6/f1a [3639899,97711] 0 2024-01-17T23:38:08.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/383: dwrite d6/d19/d22/d25/d53/d65/f60 [0,4194304] 0 2024-01-17T23:38:08.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/384: fdatasync d6/d19/d22/d25/d53/f76 0 2024-01-17T23:38:08.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/385: truncate d6/d19/d22/d25/f59 4528015 0 2024-01-17T23:38:09.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/365: symlink d4/de/d40/l6a 0 2024-01-17T23:38:09.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/366: chown d4/de/d41/c48 893049754 1 2024-01-17T23:38:09.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/367: write d4/d25/d39/d46/d60/f66 [4472,105118] 0 2024-01-17T23:38:09.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/368: dread - d4/d25/d39/d46/f50 zero size 2024-01-17T23:38:09.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/369: dwrite d4/d25/d39/d46/f59 [0,4194304] 0 2024-01-17T23:38:09.140 INFO:tasks.workunit.client.0.smithi067.stdout:7/370: dread d4/de/f3b [0,4194304] 0 2024-01-17T23:38:09.141 INFO:tasks.workunit.client.0.smithi067.stdout:7/371: truncate d4/d25/f2c 1203846 0 2024-01-17T23:38:09.141 INFO:tasks.workunit.client.0.smithi067.stdout:7/372: write d4/de/f3b [1527346,102901] 0 2024-01-17T23:38:09.178 INFO:tasks.workunit.client.0.smithi067.stdout:7/373: dwrite d4/f19 [0,4194304] 0 2024-01-17T23:38:09.217 INFO:tasks.workunit.client.0.smithi067.stdout:7/374: dwrite d4/fd [0,4194304] 0 2024-01-17T23:38:10.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/394: truncate d3/d5/f2b 3398068 0 2024-01-17T23:38:10.304 INFO:tasks.workunit.client.0.smithi067.stdout:3/405: symlink d0/d12/l7e 0 2024-01-17T23:38:10.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/395: write d3/d5/f9 [1363974,87226] 0 2024-01-17T23:38:10.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/396: write d3/d6/f76 [1001129,23403] 0 2024-01-17T23:38:10.381 INFO:tasks.workunit.client.0.smithi067.stdout:4/331: truncate d3/d8/f13 2190688 0 2024-01-17T23:38:10.381 INFO:tasks.workunit.client.0.smithi067.stdout:4/332: chown d3/d8/de/f14 3573516 1 2024-01-17T23:38:10.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/386: rename d6/d19/d22/d25/d53/d54/c86 to d6/d26/d3e/c8a 0 2024-01-17T23:38:10.509 INFO:tasks.workunit.client.0.smithi067.stdout:8/387: fsync d6/d19/f2a 0 2024-01-17T23:38:11.145 INFO:tasks.workunit.client.0.smithi067.stdout:3/406: truncate d0/d12/d1b/f54 1515424 0 2024-01-17T23:38:11.177 INFO:tasks.workunit.client.0.smithi067.stdout:3/407: dwrite d0/d12/f1c [0,4194304] 0 2024-01-17T23:38:11.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/397: mknod d3/d64/ca1 0 2024-01-17T23:38:11.471 INFO:tasks.workunit.client.0.smithi067.stdout:9/312: dwrite d3/f64 [0,4194304] 0 2024-01-17T23:38:11.480 INFO:tasks.workunit.client.0.smithi067.stdout:2/375: dwrite d5/d2f/f4b [0,4194304] 0 2024-01-17T23:38:11.489 INFO:tasks.workunit.client.0.smithi067.stdout:4/333: mknod d3/d8/de/d20/c66 0 2024-01-17T23:38:11.535 INFO:tasks.workunit.client.0.smithi067.stdout:4/334: dwrite d3/d26/f33 [0,4194304] 0 2024-01-17T23:38:11.564 INFO:tasks.workunit.client.0.smithi067.stdout:4/335: dwrite d3/d40/f41 [0,4194304] 0 2024-01-17T23:38:11.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/388: getdents d6/db 0 2024-01-17T23:38:13.167 INFO:tasks.workunit.client.0.smithi067.stdout:0/398: creat d3/d6/fa2 x:0 0 0 2024-01-17T23:38:13.218 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:13.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:13.298 INFO:tasks.workunit.client.0.smithi067.stdout:5/284: unlink d10/d24/c26 0 2024-01-17T23:38:13.298 INFO:tasks.workunit.client.0.smithi067.stdout:5/285: fdatasync d10/f20 0 2024-01-17T23:38:13.951 INFO:tasks.workunit.client.0.smithi067.stdout:9/313: mkdir d3/d6/d47/d6d 0 2024-01-17T23:38:14.066 INFO:tasks.workunit.client.0.smithi067.stdout:4/336: mknod d3/d8/de/d20/c67 0 2024-01-17T23:38:14.083 INFO:tasks.workunit.client.0.smithi067.stdout:6/367: mkdir d6/d81 0 2024-01-17T23:38:14.083 INFO:tasks.workunit.client.0.smithi067.stdout:6/368: read d6/d18/f1d [78966,71195] 0 2024-01-17T23:38:14.175 INFO:tasks.workunit.client.0.smithi067.stdout:8/389: dread d6/d19/d22/d25/d53/d65/f28 [0,4194304] 0 2024-01-17T23:38:14.175 INFO:tasks.workunit.client.0.smithi067.stdout:8/390: truncate d6/d19/d22/f71 78624 0 2024-01-17T23:38:14.221 INFO:tasks.workunit.client.0.smithi067.stdout:0/399: mknod d3/d4c/ca3 0 2024-01-17T23:38:14.231 INFO:tasks.workunit.client.0.smithi067.stdout:0/400: dread d3/d5/d1a/d1c/d4d/f65 [0,4194304] 0 2024-01-17T23:38:14.357 INFO:tasks.workunit.client.0.smithi067.stdout:5/286: truncate d10/d24/d25/f35 250765 0 2024-01-17T23:38:14.358 INFO:tasks.workunit.client.0.smithi067.stdout:5/287: fdatasync d10/f16 0 2024-01-17T23:38:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:9/314: unlink d3/d6/d2a/d34/f36 0 2024-01-17T23:38:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:4/337: creat d3/d26/d34/d65/f68 x:0 0 0 2024-01-17T23:38:15.047 INFO:tasks.workunit.client.0.smithi067.stdout:6/369: truncate d6/d9/f34 5195237 0 2024-01-17T23:38:15.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/391: getdents d6/d26 0 2024-01-17T23:38:15.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/392: chown d6/d19/d22/f71 1773505 1 2024-01-17T23:38:15.297 INFO:tasks.workunit.client.0.smithi067.stdout:5/288: creat d10/d24/f5f x:0 0 0 2024-01-17T23:38:15.548 INFO:tasks.workunit.client.0.smithi067.stdout:7/375: rename d4/d25/l45 to d4/d25/d56/l6b 0 2024-01-17T23:38:15.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/315: symlink d3/d25/l6e 0 2024-01-17T23:38:15.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/316: write d3/d6/d2a/d34/d42/f4d [999362,79733] 0 2024-01-17T23:38:15.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/317: fdatasync d3/d6/f56 0 2024-01-17T23:38:15.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/318: write d3/d15/f44 [8653645,38668] 0 2024-01-17T23:38:15.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/319: chown d3/d6/d11/d50/c51 6448783 1 2024-01-17T23:38:16.207 INFO:tasks.workunit.client.0.smithi067.stdout:6/370: mkdir d6/d9/d30/d4c/d82 0 2024-01-17T23:38:16.207 INFO:tasks.workunit.client.0.smithi067.stdout:8/393: creat d6/d26/d7c/f8b x:0 0 0 2024-01-17T23:38:16.442 INFO:tasks.workunit.client.0.smithi067.stdout:7/376: symlink d4/d25/l6c 0 2024-01-17T23:38:16.654 INFO:tasks.workunit.client.0.smithi067.stdout:9/320: creat d3/d6/d11/d5c/f6f x:0 0 0 2024-01-17T23:38:16.847 INFO:tasks.workunit.client.0.smithi067.stdout:6/371: getdents d6/d9 0 2024-01-17T23:38:16.887 INFO:tasks.workunit.client.0.smithi067.stdout:6/372: dwrite d6/d9/d30/d4c/f6d [0,4194304] 0 2024-01-17T23:38:17.126 INFO:tasks.workunit.client.0.smithi067.stdout:9/321: rename d3/d6/d2a/d34/d42/f59 to d3/d6/d11/d5c/f70 0 2024-01-17T23:38:17.127 INFO:tasks.workunit.client.0.smithi067.stdout:9/322: fdatasync d3/d6/d2a/f3f 0 2024-01-17T23:38:17.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/323: write d3/d6/d11/d50/f43 [1647049,42537] 0 2024-01-17T23:38:17.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/324: write d3/d6/d11/d5c/f6f [621845,53853] 0 2024-01-17T23:38:17.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/325: rename d3/d6/d2e/f3d to d3/d6/d2a/f71 0 2024-01-17T23:38:17.741 INFO:tasks.workunit.client.0.smithi067.stdout:6/373: rmdir d6/d9/d1c/d1e 39 2024-01-17T23:38:17.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/374: readlink d6/d9/d30/d58/l59 0 2024-01-17T23:38:17.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/375: truncate d6/d18/d44/d51/f5d 735914 0 2024-01-17T23:38:17.895 INFO:tasks.workunit.client.0.smithi067.stdout:9/326: symlink d3/d6/d10/l72 0 2024-01-17T23:38:17.991 INFO:tasks.workunit.client.0.smithi067.stdout:0/401: link d3/d5/d1a/f44 d3/d5/d1a/fa4 0 2024-01-17T23:38:18.068 INFO:tasks.workunit.client.0.smithi067.stdout:6/376: mkdir d6/d81/d83 0 2024-01-17T23:38:18.068 INFO:tasks.workunit.client.0.smithi067.stdout:6/377: write d6/d18/d2e/f77 [592725,42459] 0 2024-01-17T23:38:18.103 INFO:tasks.workunit.client.0.smithi067.stdout:6/378: dwrite d6/f17 [0,4194304] 0 2024-01-17T23:38:18.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/402: unlink d3/d6/f2f 0 2024-01-17T23:38:18.290 INFO:tasks.workunit.client.0.smithi067.stdout:0/403: dwrite d3/d6/dd/f5d [0,4194304] 0 2024-01-17T23:38:18.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/379: rename d6/d81/d83 to d6/d9/d84 0 2024-01-17T23:38:18.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/380: read - d6/d9/d30/f7b zero size 2024-01-17T23:38:18.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/381: chown d6/d9/d1c/d1e/c37 406495717 1 2024-01-17T23:38:18.600 INFO:tasks.workunit.client.0.smithi067.stdout:6/382: dread d6/f17 [0,4194304] 0 2024-01-17T23:38:18.621 INFO:tasks.workunit.client.0.smithi067.stdout:6/383: dread d6/d9/d30/d58/f6a [0,4194304] 0 2024-01-17T23:38:18.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/404: unlink d3/d6/dd/c68 0 2024-01-17T23:38:18.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/405: creat d3/d5/d32/fa5 x:0 0 0 2024-01-17T23:38:18.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/369: sync 2024-01-17T23:38:18.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/370: chown d0/d7/d13/l28 21836589 1 2024-01-17T23:38:18.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/371: chown d0/d7/d13/d2e 945504 1 2024-01-17T23:38:19.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/384: link d6/d9/d30/d58/l59 d6/l85 0 2024-01-17T23:38:19.230 INFO:tasks.workunit.client.0.smithi067.stdout:0/406: symlink d3/d75/la6 0 2024-01-17T23:38:19.237 INFO:tasks.workunit.client.0.smithi067.stdout:0/407: dread d3/f47 [0,4194304] 0 2024-01-17T23:38:19.614 INFO:tasks.workunit.client.0.smithi067.stdout:1/372: symlink d0/d69/l70 0 2024-01-17T23:38:19.614 INFO:tasks.workunit.client.0.smithi067.stdout:1/373: chown d0/d2d/d31/f67 0 1 2024-01-17T23:38:19.615 INFO:tasks.workunit.client.0.smithi067.stdout:6/385: mkdir d6/d9/d1c/d1e/d43/d86 0 2024-01-17T23:38:19.624 INFO:tasks.workunit.client.0.smithi067.stdout:6/386: dread d6/d9/d1c/f2f [0,4194304] 0 2024-01-17T23:38:19.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/408: symlink d3/d5/d1a/d1c/d4e/d6b/la7 0 2024-01-17T23:38:20.381 INFO:tasks.workunit.client.0.smithi067.stdout:2/376: sync 2024-01-17T23:38:20.562 INFO:tasks.workunit.client.0.smithi067.stdout:3/408: sync 2024-01-17T23:38:20.563 INFO:tasks.workunit.client.0.smithi067.stdout:2/377: readlink d5/d1f/d2a/d54/d8/d32/d33/l37 0 2024-01-17T23:38:20.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/409: write d0/d17/f28 [2516493,121132] 0 2024-01-17T23:38:20.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/410: write d0/d13/f3d [826880,116967] 0 2024-01-17T23:38:20.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/338: write d3/d26/f43 [401437,51575] 0 2024-01-17T23:38:20.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/339: fsync d3/d8/de/d20/f56 0 2024-01-17T23:38:21.360 INFO:tasks.workunit.client.0.smithi067.stdout:0/409: mknod d3/d5/d1a/d90/ca8 0 2024-01-17T23:38:21.397 INFO:tasks.workunit.client.0.smithi067.stdout:5/289: write d10/d24/d25/f2e [502585,112476] 0 2024-01-17T23:38:21.397 INFO:tasks.workunit.client.0.smithi067.stdout:5/290: fdatasync d10/d24/d25/f4f 0 2024-01-17T23:38:21.561 INFO:tasks.workunit.client.0.smithi067.stdout:2/378: mknod d5/d1f/d2a/d55/c7e 0 2024-01-17T23:38:21.561 INFO:tasks.workunit.client.0.smithi067.stdout:2/379: chown d5/d1f/d35/f5c 250 1 2024-01-17T23:38:21.660 INFO:tasks.workunit.client.0.smithi067.stdout:3/411: truncate d0/d12/d59/f66 4337439 0 2024-01-17T23:38:21.661 INFO:tasks.workunit.client.0.smithi067.stdout:3/412: creat d0/d12/d1b/d4d/f7f x:0 0 0 2024-01-17T23:38:22.335 INFO:tasks.workunit.client.0.smithi067.stdout:9/327: getdents d3/d6/d2a 0 2024-01-17T23:38:22.590 INFO:tasks.workunit.client.0.smithi067.stdout:5/291: rmdir d10/d24/d46 39 2024-01-17T23:38:22.660 INFO:tasks.workunit.client.0.smithi067.stdout:9/328: rename d3/d15/c2b to d3/d15/c73 0 2024-01-17T23:38:22.918 INFO:tasks.workunit.client.0.smithi067.stdout:5/292: mknod d10/d24/d46/d4a/d50/d5a/c60 0 2024-01-17T23:38:22.938 INFO:tasks.workunit.client.0.smithi067.stdout:3/413: write d0/f14 [1512769,3620] 0 2024-01-17T23:38:22.949 INFO:tasks.workunit.client.0.smithi067.stdout:3/414: fdatasync d0/d13/f3d 0 2024-01-17T23:38:23.019 INFO:tasks.workunit.client.0.smithi067.stdout:9/329: creat d3/d15/d57/f74 x:0 0 0 2024-01-17T23:38:23.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/415: creat d0/f80 x:0 0 0 2024-01-17T23:38:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/340: rename d3/d8/cb to d3/d26/d34/d3a/d53/c69 0 2024-01-17T23:38:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:5/293: rename d10/d24/d59/d5d/d43 to d10/d24/d59/d5d/d43/d61 22 2024-01-17T23:38:23.887 INFO:tasks.workunit.client.0.smithi067.stdout:3/416: dread d0/d12/d1b/f1d [0,4194304] 0 2024-01-17T23:38:23.887 INFO:tasks.workunit.client.0.smithi067.stdout:3/417: fdatasync d0/d13/d4a/d55/f72 0 2024-01-17T23:38:23.887 INFO:tasks.workunit.client.0.smithi067.stdout:3/418: chown d0/d34 3 1 2024-01-17T23:38:23.906 INFO:tasks.workunit.client.0.smithi067.stdout:3/419: dread d0/d17/f29 [0,4194304] 0 2024-01-17T23:38:24.428 INFO:tasks.workunit.client.0.smithi067.stdout:8/394: unlink d6/c24 0 2024-01-17T23:38:24.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/374: write d0/f5 [4214663,46803] 0 2024-01-17T23:38:24.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/375: fsync d0/d7/d13/d3a/d3e/f57 0 2024-01-17T23:38:24.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/376: write d0/d7/d13/d3a/d45/f5a [349816,16332] 0 2024-01-17T23:38:24.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/377: mknod d4/de/c6d 0 2024-01-17T23:38:24.474 INFO:tasks.workunit.client.0.smithi067.stdout:7/378: dwrite d4/fd [4194304,4194304] 0 2024-01-17T23:38:24.863 INFO:tasks.workunit.client.0.smithi067.stdout:4/341: mknod d3/d26/d34/d3a/d53/c6a 0 2024-01-17T23:38:24.863 INFO:tasks.workunit.client.0.smithi067.stdout:4/342: dread - d3/d8/de/d20/f5e zero size 2024-01-17T23:38:24.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/343: fdatasync d3/d5/f2e 0 2024-01-17T23:38:24.864 INFO:tasks.workunit.client.0.smithi067.stdout:5/294: creat d10/d53/f62 x:0 0 0 2024-01-17T23:38:24.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/420: unlink d0/d17/c77 0 2024-01-17T23:38:25.043 INFO:tasks.workunit.client.0.smithi067.stdout:8/395: mknod d6/d19/d22/c8c 0 2024-01-17T23:38:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/377: creat d0/d69/f71 x:0 0 0 2024-01-17T23:38:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/378: creat d0/d2d/d31/f72 x:0 0 0 2024-01-17T23:38:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/379: chown d0/d32/c6c 1008280423 1 2024-01-17T23:38:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/380: stat d0/d2d/d31/f67 0 2024-01-17T23:38:25.353 INFO:tasks.workunit.client.0.smithi067.stdout:7/379: getdents d4/d16 0 2024-01-17T23:38:25.520 INFO:tasks.workunit.client.0.smithi067.stdout:4/344: mknod d3/d8/de/d20/d52/c6b 0 2024-01-17T23:38:25.647 INFO:tasks.workunit.client.0.smithi067.stdout:5/295: mkdir d10/d24/d46/d4a/d63 0 2024-01-17T23:38:25.647 INFO:tasks.workunit.client.0.smithi067.stdout:3/421: symlink d0/d13/d4a/l81 0 2024-01-17T23:38:25.651 INFO:tasks.workunit.client.0.smithi067.stdout:3/422: write d0/d13/f3c [7963,42846] 0 2024-01-17T23:38:25.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/423: dread d0/d13/f2f [0,4194304] 0 2024-01-17T23:38:25.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/424: fdatasync d0/d13/f16 0 2024-01-17T23:38:25.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/425: write d0/d13/d4a/d55/f73 [841412,76334] 0 2024-01-17T23:38:25.673 INFO:tasks.workunit.client.0.smithi067.stdout:0/410: dwrite d3/d5/d32/f78 [0,4194304] 0 2024-01-17T23:38:25.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/426: dread d0/d13/d4a/d55/f62 [0,4194304] 0 2024-01-17T23:38:25.686 INFO:tasks.workunit.client.0.smithi067.stdout:0/411: write d3/d6/f55 [2115617,60618] 0 2024-01-17T23:38:25.919 INFO:tasks.workunit.client.0.smithi067.stdout:8/396: unlink d6/db/f20 0 2024-01-17T23:38:26.081 INFO:tasks.workunit.client.0.smithi067.stdout:1/381: mkdir d0/d7/d1c/d73 0 2024-01-17T23:38:26.880 INFO:tasks.workunit.client.0.smithi067.stdout:2/380: creat d5/d1f/d2a/f7f x:0 0 0 2024-01-17T23:38:27.431 INFO:tasks.workunit.client.0.smithi067.stdout:5/296: rename d10/d24/d46/d4a/d4b/c45 to d10/d24/d46/d4a/d50/c64 0 2024-01-17T23:38:27.431 INFO:tasks.workunit.client.0.smithi067.stdout:5/297: chown d10/d24/d25/c3b 282788500 1 2024-01-17T23:38:27.432 INFO:tasks.workunit.client.0.smithi067.stdout:5/298: write d10/f11 [4054251,38327] 0 2024-01-17T23:38:27.917 INFO:tasks.workunit.client.0.smithi067.stdout:3/427: mkdir d0/d13/d4a/d82 0 2024-01-17T23:38:27.917 INFO:tasks.workunit.client.0.smithi067.stdout:3/428: chown d0/d13/f33 76881 1 2024-01-17T23:38:27.917 INFO:tasks.workunit.client.0.smithi067.stdout:3/429: truncate d0/d12/d1b/d4d/f7f 288159 0 2024-01-17T23:38:27.929 INFO:tasks.workunit.client.0.smithi067.stdout:3/430: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:38:27.929 INFO:tasks.workunit.client.0.smithi067.stdout:3/431: truncate d0/d12/d1b/d4d/f71 602038 0 2024-01-17T23:38:27.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/330: write d3/d6/d11/f4f [3755058,54746] 0 2024-01-17T23:38:28.187 INFO:tasks.workunit.client.0.smithi067.stdout:8/397: mkdir d6/d26/d3e/d8d 0 2024-01-17T23:38:28.321 INFO:tasks.workunit.client.0.smithi067.stdout:6/387: sync 2024-01-17T23:38:28.488 INFO:tasks.workunit.client.0.smithi067.stdout:2/381: symlink d5/d1f/d35/l80 0 2024-01-17T23:38:28.653 INFO:tasks.workunit.client.0.smithi067.stdout:5/299: dread d10/d24/d25/f35 [0,4194304] 0 2024-01-17T23:38:28.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/331: symlink d3/d6/d11/d5c/l75 0 2024-01-17T23:38:28.955 INFO:tasks.workunit.client.0.smithi067.stdout:8/398: truncate d6/d19/d22/d25/d53/d65/f60 8697 0 2024-01-17T23:38:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:2/382: creat d5/d1f/d2a/d54/d8/d32/f81 x:0 0 0 2024-01-17T23:38:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/300: symlink d10/d24/d46/d4a/d50/l65 0 2024-01-17T23:38:29.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/432: rename d0/c10 to d0/d37/c83 0 2024-01-17T23:38:29.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/332: stat d3/d6/d11/f1b 0 2024-01-17T23:38:29.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/333: chown d3/l4 305775 1 2024-01-17T23:38:29.890 INFO:tasks.workunit.client.0.smithi067.stdout:5/301: getdents d10/d24/d59/d5d 0 2024-01-17T23:38:30.248 INFO:tasks.workunit.client.0.smithi067.stdout:3/433: dread d0/d12/d59/f66 [0,4194304] 0 2024-01-17T23:38:30.283 INFO:tasks.workunit.client.0.smithi067.stdout:3/434: dwrite d0/d13/f33 [0,4194304] 0 2024-01-17T23:38:30.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/302: link d10/d24/c31 d10/c66 0 2024-01-17T23:38:30.508 INFO:tasks.workunit.client.0.smithi067.stdout:5/303: fdatasync d10/f16 0 2024-01-17T23:38:30.508 INFO:tasks.workunit.client.0.smithi067.stdout:5/304: readlink d10/l1d 0 2024-01-17T23:38:30.661 INFO:tasks.workunit.client.0.smithi067.stdout:9/334: unlink d3/d6/d10/l72 0 2024-01-17T23:38:30.790 INFO:tasks.workunit.client.0.smithi067.stdout:5/305: link d10/f3d d10/d24/d59/f67 0 2024-01-17T23:38:30.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/335: truncate d3/f26 4075457 0 2024-01-17T23:38:31.032 INFO:tasks.workunit.client.0.smithi067.stdout:5/306: mknod d10/d24/d59/d5d/c68 0 2024-01-17T23:38:31.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/307: fsync d10/d24/f5f 0 2024-01-17T23:38:31.049 INFO:tasks.workunit.client.0.smithi067.stdout:5/308: write d10/d24/d59/d5d/f4d [3245374,73657] 0 2024-01-17T23:38:31.068 INFO:tasks.workunit.client.0.smithi067.stdout:5/309: dread d10/f16 [4194304,4194304] 0 2024-01-17T23:38:31.368 INFO:tasks.workunit.client.0.smithi067.stdout:3/435: unlink d0/d12/f6d 0 2024-01-17T23:38:31.368 INFO:tasks.workunit.client.0.smithi067.stdout:7/380: sync 2024-01-17T23:38:31.410 INFO:tasks.workunit.client.0.smithi067.stdout:3/436: dwrite d0/f1e [0,4194304] 0 2024-01-17T23:38:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:3/437: dread d0/f5 [0,4194304] 0 2024-01-17T23:38:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:3/438: write d0/f14 [3372987,109238] 0 2024-01-17T23:38:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:4/345: dwrite d3/d8/f13 [0,4194304] 0 2024-01-17T23:38:31.834 INFO:tasks.workunit.client.0.smithi067.stdout:5/310: creat d10/d24/d46/f69 x:0 0 0 2024-01-17T23:38:31.834 INFO:tasks.workunit.client.0.smithi067.stdout:5/311: chown d10/d24/d46/d4a/d50/l65 24102 1 2024-01-17T23:38:31.917 INFO:tasks.workunit.client.0.smithi067.stdout:0/412: sync 2024-01-17T23:38:31.917 INFO:tasks.workunit.client.0.smithi067.stdout:0/413: chown d3/d6/f17 9150 1 2024-01-17T23:38:31.917 INFO:tasks.workunit.client.0.smithi067.stdout:0/414: chown d3/d6/fa2 1031488 1 2024-01-17T23:38:31.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/381: dread d4/fb [0,4194304] 0 2024-01-17T23:38:31.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/382: dwrite d4/d25/f33 [0,4194304] 0 2024-01-17T23:38:31.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/383: fdatasync d4/d25/d39/d46/f50 0 2024-01-17T23:38:32.136 INFO:tasks.workunit.client.0.smithi067.stdout:3/439: truncate d0/d13/d1a/d38/f47 284823 0 2024-01-17T23:38:32.245 INFO:tasks.workunit.client.0.smithi067.stdout:4/346: unlink d3/d5/c49 0 2024-01-17T23:38:32.246 INFO:tasks.workunit.client.0.smithi067.stdout:4/347: chown d3/d5/l11 10749 1 2024-01-17T23:38:32.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/348: dread d3/d5/f3f [0,4194304] 0 2024-01-17T23:38:32.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/349: fdatasync d3/d26/d34/d3a/f47 0 2024-01-17T23:38:32.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/350: dread - d3/d26/d34/d3a/f5b zero size 2024-01-17T23:38:32.291 INFO:tasks.workunit.client.0.smithi067.stdout:4/351: dwrite d3/d26/d34/d3a/f5b [0,4194304] 0 2024-01-17T23:38:32.291 INFO:tasks.workunit.client.0.smithi067.stdout:4/352: write d3/d8/de/d20/f56 [729806,74516] 0 2024-01-17T23:38:32.291 INFO:tasks.workunit.client.0.smithi067.stdout:4/353: stat d3/d8/de/f14 0 2024-01-17T23:38:32.409 INFO:tasks.workunit.client.0.smithi067.stdout:6/388: rename d6/l45 to d6/d18/d44/d51/l87 0 2024-01-17T23:38:33.172 INFO:tasks.workunit.client.0.smithi067.stdout:7/384: read d4/d25/f2c [616559,74345] 0 2024-01-17T23:38:33.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/440: creat d0/d17/d69/d6e/f84 x:0 0 0 2024-01-17T23:38:33.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/399: dwrite d6/db/f55 [0,4194304] 0 2024-01-17T23:38:33.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/400: read - d6/d19/d22/f37 zero size 2024-01-17T23:38:33.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/441: dwrite d0/d12/d1b/f26 [4194304,4194304] 0 2024-01-17T23:38:33.541 INFO:tasks.workunit.client.0.smithi067.stdout:2/383: dwrite d5/d1f/f43 [0,4194304] 0 2024-01-17T23:38:33.541 INFO:tasks.workunit.client.0.smithi067.stdout:2/384: fdatasync d5/d1f/d35/f6d 0 2024-01-17T23:38:33.541 INFO:tasks.workunit.client.0.smithi067.stdout:2/385: fdatasync d5/d1f/d2a/d54/d8/d32/d33/f44 0 2024-01-17T23:38:33.952 INFO:tasks.workunit.client.0.smithi067.stdout:4/354: creat d3/d5/f6c x:0 0 0 2024-01-17T23:38:33.971 INFO:tasks.workunit.client.0.smithi067.stdout:4/355: write d3/d8/de/f14 [188623,12163] 0 2024-01-17T23:38:33.971 INFO:tasks.workunit.client.0.smithi067.stdout:4/356: fdatasync d3/d26/d34/d3a/f5b 0 2024-01-17T23:38:33.971 INFO:tasks.workunit.client.0.smithi067.stdout:4/357: getdents d3/d40 0 2024-01-17T23:38:34.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/415: getdents d3/d5/d1a/d1c/d1d/d2e 0 2024-01-17T23:38:34.724 INFO:tasks.workunit.client.0.smithi067.stdout:7/385: creat d4/d16/f6e x:0 0 0 2024-01-17T23:38:35.212 INFO:tasks.workunit.client.0.smithi067.stdout:3/442: truncate d0/d17/f23 3844838 0 2024-01-17T23:38:35.238 INFO:tasks.workunit.client.0.smithi067.stdout:3/443: dwrite d0/d12/d59/f76 [0,4194304] 0 2024-01-17T23:38:35.684 INFO:tasks.workunit.client.0.smithi067.stdout:2/386: creat d5/d1f/d2a/d54/d7c/f82 x:0 0 0 2024-01-17T23:38:35.961 INFO:tasks.workunit.client.0.smithi067.stdout:4/358: link d3/d8/d35/c46 d3/d59/c6d 0 2024-01-17T23:38:35.961 INFO:tasks.workunit.client.0.smithi067.stdout:9/336: link d3/d6/d2a/d34/d42/c4e d3/d15/c76 0 2024-01-17T23:38:35.961 INFO:tasks.workunit.client.0.smithi067.stdout:4/359: chown d3/d8/l22 83972031 1 2024-01-17T23:38:36.089 INFO:tasks.workunit.client.0.smithi067.stdout:0/416: rmdir d3/d5/d1a/d1c/d4e 39 2024-01-17T23:38:37.070 INFO:tasks.workunit.client.0.smithi067.stdout:3/444: symlink d0/d12/l85 0 2024-01-17T23:38:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/445: write d0/d13/d1a/d38/f53 [834924,58087] 0 2024-01-17T23:38:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/446: chown d0/d17 4754843 1 2024-01-17T23:38:37.074 INFO:tasks.workunit.client.0.smithi067.stdout:3/447: stat d0/c6b 0 2024-01-17T23:38:37.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/337: link d3/f5e d3/d6/d11/d50/f77 0 2024-01-17T23:38:37.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/338: truncate d3/d6/d2a/d34/f3e 327102 0 2024-01-17T23:38:37.384 INFO:tasks.workunit.client.0.smithi067.stdout:6/389: dwrite d6/d18/f4f [0,4194304] 0 2024-01-17T23:38:37.384 INFO:tasks.workunit.client.0.smithi067.stdout:6/390: chown d6/d9/d30/l6b 55365 1 2024-01-17T23:38:37.384 INFO:tasks.workunit.client.0.smithi067.stdout:6/391: dread - d6/d9/d30/f7b zero size 2024-01-17T23:38:37.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/392: dwrite d6/d18/d2e/f50 [0,4194304] 0 2024-01-17T23:38:37.432 INFO:tasks.workunit.client.0.smithi067.stdout:4/360: creat d3/d8/d35/f6e x:0 0 0 2024-01-17T23:38:37.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/417: rmdir d3/d5/d32/d7f 39 2024-01-17T23:38:37.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/418: truncate d3/d6/f56 1004392 0 2024-01-17T23:38:37.622 INFO:tasks.workunit.client.0.smithi067.stdout:0/419: dwrite d3/d5/d1a/f2c [4194304,4194304] 0 2024-01-17T23:38:37.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/420: dread d3/f47 [0,4194304] 0 2024-01-17T23:38:37.630 INFO:tasks.workunit.client.0.smithi067.stdout:0/421: read - d3/d5/d1a/d1c/d1d/d2e/f89 zero size 2024-01-17T23:38:37.630 INFO:tasks.workunit.client.0.smithi067.stdout:0/422: chown d3/d5/d32/f73 488124027 1 2024-01-17T23:38:37.630 INFO:tasks.workunit.client.0.smithi067.stdout:0/423: truncate d3/d5/d1a/f42 5423559 0 2024-01-17T23:38:37.630 INFO:tasks.workunit.client.0.smithi067.stdout:0/424: dread - d3/d5/d1a/d1c/d1d/d2e/f89 zero size 2024-01-17T23:38:37.871 INFO:tasks.workunit.client.0.smithi067.stdout:3/448: readlink d0/l22 0 2024-01-17T23:38:37.984 INFO:tasks.workunit.client.0.smithi067.stdout:9/339: dwrite d3/d6/d2e/f63 [0,4194304] 0 2024-01-17T23:38:37.984 INFO:tasks.workunit.client.0.smithi067.stdout:9/340: fdatasync d3/d15/f67 0 2024-01-17T23:38:38.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/361: mknod d3/d8/de/d38/c6f 0 2024-01-17T23:38:38.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/362: fsync d3/d8/f13 0 2024-01-17T23:38:38.658 INFO:tasks.workunit.client.0.smithi067.stdout:1/382: rename d0/d2d to d0/d74 0 2024-01-17T23:38:38.659 INFO:tasks.workunit.client.0.smithi067.stdout:1/383: fsync d0/d62/f65 0 2024-01-17T23:38:38.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/384: dwrite d0/d7/d1c/f54 [0,4194304] 0 2024-01-17T23:38:38.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/385: fsync d0/d7/d13/d2e/f6d 0 2024-01-17T23:38:38.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/449: mknod d0/d12/d1b/d4d/c86 0 2024-01-17T23:38:38.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/450: write d0/d13/f2c [1044986,40444] 0 2024-01-17T23:38:39.140 INFO:tasks.workunit.client.0.smithi067.stdout:9/341: dwrite d3/d6/f9 [4194304,4194304] 0 2024-01-17T23:38:39.363 INFO:tasks.workunit.client.0.smithi067.stdout:4/363: link d3/d8/d35/d36/f48 d3/d40/f70 0 2024-01-17T23:38:39.363 INFO:tasks.workunit.client.0.smithi067.stdout:4/364: chown d3/d8/de/d38/l5f 23 1 2024-01-17T23:38:39.665 INFO:tasks.workunit.client.0.smithi067.stdout:1/386: mkdir d0/d7/d13/d3a/d75 0 2024-01-17T23:38:39.906 INFO:tasks.workunit.client.0.smithi067.stdout:9/342: symlink d3/d6/d10/l78 0 2024-01-17T23:38:39.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/343: dwrite d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:38:39.972 INFO:tasks.workunit.client.0.smithi067.stdout:9/344: dwrite d3/d6/f9 [4194304,4194304] 0 2024-01-17T23:38:40.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/345: chown d3/d6/d47/l60 542589343 1 2024-01-17T23:38:40.562 INFO:tasks.workunit.client.0.smithi067.stdout:4/365: rename d3/d8/d35/f5c to d3/d8/d35/f71 0 2024-01-17T23:38:40.819 INFO:tasks.workunit.client.0.smithi067.stdout:9/346: mkdir d3/d25/d5d/d79 0 2024-01-17T23:38:40.819 INFO:tasks.workunit.client.0.smithi067.stdout:9/347: readlink d3/d6/d11/l29 0 2024-01-17T23:38:40.937 INFO:tasks.workunit.client.0.smithi067.stdout:8/401: creat d6/f8e x:0 0 0 2024-01-17T23:38:40.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/402: dread d6/d19/f3f [0,4194304] 0 2024-01-17T23:38:40.954 INFO:tasks.workunit.client.0.smithi067.stdout:8/403: chown d6/cd 775 1 2024-01-17T23:38:41.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/366: mknod d3/d59/c72 0 2024-01-17T23:38:41.176 INFO:tasks.workunit.client.0.smithi067.stdout:9/348: mknod d3/d25/d5d/c7a 0 2024-01-17T23:38:41.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/349: creat d3/d15/d55/f7b x:0 0 0 2024-01-17T23:38:41.424 INFO:tasks.workunit.client.0.smithi067.stdout:4/367: creat d3/d40/f73 x:0 0 0 2024-01-17T23:38:41.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/350: write d3/d6/d11/d50/f43 [5387321,80009] 0 2024-01-17T23:38:41.529 INFO:tasks.workunit.client.0.smithi067.stdout:8/404: rmdir d6/d26/d7c 39 2024-01-17T23:38:41.529 INFO:tasks.workunit.client.0.smithi067.stdout:8/405: chown d6/d19/d22/d25/d53/d54 114 1 2024-01-17T23:38:41.619 INFO:tasks.workunit.client.0.smithi067.stdout:4/368: truncate d3/d8/de/f14 2280460 0 2024-01-17T23:38:41.636 INFO:tasks.workunit.client.0.smithi067.stdout:4/369: write d3/d5/f3f [576335,129076] 0 2024-01-17T23:38:41.655 INFO:tasks.workunit.client.0.smithi067.stdout:4/370: dread d3/d5/f3f [0,4194304] 0 2024-01-17T23:38:41.655 INFO:tasks.workunit.client.0.smithi067.stdout:4/371: read d3/d8/d35/f3c [3127481,11747] 0 2024-01-17T23:38:41.712 INFO:tasks.workunit.client.0.smithi067.stdout:9/351: symlink d3/d15/d55/l7c 0 2024-01-17T23:38:42.148 INFO:tasks.workunit.client.0.smithi067.stdout:8/406: unlink d6/d19/d22/f37 0 2024-01-17T23:38:42.341 INFO:tasks.workunit.client.0.smithi067.stdout:4/372: symlink d3/d59/l74 0 2024-01-17T23:38:42.341 INFO:tasks.workunit.client.0.smithi067.stdout:4/373: readlink d3/d8/d35/l50 0 2024-01-17T23:38:42.341 INFO:tasks.workunit.client.0.smithi067.stdout:4/374: dread - d3/d8/de/f54 zero size 2024-01-17T23:38:42.353 INFO:tasks.workunit.client.0.smithi067.stdout:4/375: dread d3/d40/f41 [0,4194304] 0 2024-01-17T23:38:42.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/376: dwrite d3/d26/f43 [0,4194304] 0 2024-01-17T23:38:42.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/407: unlink d6/d26/d3e/f79 0 2024-01-17T23:38:42.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/312: rename d10/f1a to d10/d24/d46/f6a 0 2024-01-17T23:38:42.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/313: write f9 [5363111,20483] 0 2024-01-17T23:38:43.290 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:43.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:38:43.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/408: link d6/d26/d56/c5b d6/d26/d3e/d8d/c8f 0 2024-01-17T23:38:43.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/387: rename d5/d1f/d2a/d54/d8/d32/d33/f44 to d5/d1f/d2a/d73/f83 0 2024-01-17T23:38:43.372 INFO:tasks.workunit.client.0.smithi067.stdout:5/314: symlink d10/d53/l6b 0 2024-01-17T23:38:43.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/451: write d0/d17/f4c [841615,122406] 0 2024-01-17T23:38:43.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/452: chown d0/d13/d4a/c7d 231 1 2024-01-17T23:38:43.658 INFO:tasks.workunit.client.0.smithi067.stdout:8/409: mknod d6/d26/d3e/c90 0 2024-01-17T23:38:43.674 INFO:tasks.workunit.client.0.smithi067.stdout:8/410: dread d6/d19/d22/d25/d53/d65/f44 [0,4194304] 0 2024-01-17T23:38:43.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/411: write d6/db/f41 [2580791,24101] 0 2024-01-17T23:38:43.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/412: chown d6/d19/d22/d25/d53/f76 256750 1 2024-01-17T23:38:43.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/413: write d6/d19/d22/d25/d53/f7e [613620,19549] 0 2024-01-17T23:38:43.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/414: chown d6/d19/f3a 612 1 2024-01-17T23:38:43.960 INFO:tasks.workunit.client.0.smithi067.stdout:0/425: rename d3/d5/d32/l3c to d3/la9 0 2024-01-17T23:38:44.000 INFO:tasks.workunit.client.0.smithi067.stdout:0/426: dwrite d3/d5/d1a/d1c/d1d/d2e/f89 [0,4194304] 0 2024-01-17T23:38:44.123 INFO:tasks.workunit.client.0.smithi067.stdout:2/388: mkdir d5/d1f/d2a/d54/d8/d4c/d84 0 2024-01-17T23:38:44.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/453: mkdir d0/d34/d35/d57/d87 0 2024-01-17T23:38:44.319 INFO:tasks.workunit.client.0.smithi067.stdout:3/454: dread d0/f1e [0,4194304] 0 2024-01-17T23:38:44.319 INFO:tasks.workunit.client.0.smithi067.stdout:3/455: fsync d0/d13/f2c 0 2024-01-17T23:38:44.456 INFO:tasks.workunit.client.0.smithi067.stdout:8/415: creat d6/d19/d22/f91 x:0 0 0 2024-01-17T23:38:44.558 INFO:tasks.workunit.client.0.smithi067.stdout:1/387: rename d0/d7/d13/l37 to d0/d74/d31/l76 0 2024-01-17T23:38:44.585 INFO:tasks.workunit.client.0.smithi067.stdout:1/388: dwrite d0/d7/d13/d3a/f59 [0,4194304] 0 2024-01-17T23:38:44.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/389: readlink d0/d7/d13/l6b 0 2024-01-17T23:38:44.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/390: write d0/d7/d13/d3a/f5d [664908,125015] 0 2024-01-17T23:38:45.843 INFO:tasks.workunit.client.0.smithi067.stdout:2/389: creat d5/d1f/d16/f85 x:0 0 0 2024-01-17T23:38:46.052 INFO:tasks.workunit.client.0.smithi067.stdout:6/393: link d6/d9/f31 d6/f88 0 2024-01-17T23:38:46.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/456: symlink d0/d17/d69/d6e/l88 0 2024-01-17T23:38:46.212 INFO:tasks.workunit.client.0.smithi067.stdout:3/457: dread d0/f2a [0,4194304] 0 2024-01-17T23:38:46.721 INFO:tasks.workunit.client.0.smithi067.stdout:1/391: mkdir d0/d7/d13/d77 0 2024-01-17T23:38:46.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/386: sync 2024-01-17T23:38:46.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/387: fdatasync d4/d25/f38 0 2024-01-17T23:38:46.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/388: read - d4/de/d41/f55 zero size 2024-01-17T23:38:46.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/389: fsync d4/de/f4d 0 2024-01-17T23:38:46.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/390: read d4/d25/f2c [541398,71210] 0 2024-01-17T23:38:47.103 INFO:tasks.workunit.client.0.smithi067.stdout:3/458: readlink d0/lf 0 2024-01-17T23:38:47.103 INFO:tasks.workunit.client.0.smithi067.stdout:3/459: creat d0/d17/d69/d6e/f89 x:0 0 0 2024-01-17T23:38:47.275 INFO:tasks.workunit.client.0.smithi067.stdout:1/392: creat d0/d7/d13/d2e/f78 x:0 0 0 2024-01-17T23:38:47.358 INFO:tasks.workunit.client.0.smithi067.stdout:7/391: link d4/de/l5e d4/d25/d39/d46/l6f 0 2024-01-17T23:38:48.031 INFO:tasks.workunit.client.0.smithi067.stdout:1/393: link d0/d74/f6a d0/d32/d35/f79 0 2024-01-17T23:38:48.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/392: stat d4/de/d40/f42 0 2024-01-17T23:38:48.399 INFO:tasks.workunit.client.0.smithi067.stdout:1/394: mkdir d0/d7/d1c/d73/d7a 0 2024-01-17T23:38:48.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/395: dwrite d0/d7/d13/d2e/f4b [4194304,4194304] 0 2024-01-17T23:38:48.429 INFO:tasks.workunit.client.0.smithi067.stdout:1/396: chown d0/f5 73317 1 2024-01-17T23:38:48.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/393: creat d4/d25/d39/f70 x:0 0 0 2024-01-17T23:38:48.848 INFO:tasks.workunit.client.0.smithi067.stdout:1/397: mknod d0/d69/c7b 0 2024-01-17T23:38:48.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/394: creat d4/de/d40/f71 x:0 0 0 2024-01-17T23:38:48.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/395: chown d4/f19 25133175 1 2024-01-17T23:38:48.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/396: fsync d4/de/f4d 0 2024-01-17T23:38:48.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/397: fdatasync d4/d25/f2c 0 2024-01-17T23:38:48.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/398: truncate d4/de/f3b 5089027 0 2024-01-17T23:38:48.875 INFO:tasks.workunit.client.0.smithi067.stdout:5/315: dwrite d10/d24/f2d [0,4194304] 0 2024-01-17T23:38:48.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/316: chown d10/d24/d46/f54 0 1 2024-01-17T23:38:48.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/317: fdatasync d10/d24/d25/f2e 0 2024-01-17T23:38:48.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/318: write d10/f3d [1654279,103697] 0 2024-01-17T23:38:49.055 INFO:tasks.workunit.client.0.smithi067.stdout:1/398: mkdir d0/d7/d13/d3a/d3e/d7c 0 2024-01-17T23:38:49.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/460: creat d0/d13/f8a x:0 0 0 2024-01-17T23:38:49.356 INFO:tasks.workunit.client.0.smithi067.stdout:7/399: symlink d4/d25/d39/d46/d60/l72 0 2024-01-17T23:38:49.731 INFO:tasks.workunit.client.0.smithi067.stdout:1/399: read d0/d7/f29 [1582634,16522] 0 2024-01-17T23:38:49.866 INFO:tasks.workunit.client.0.smithi067.stdout:3/461: write d0/d13/d4a/f5c [576925,124235] 0 2024-01-17T23:38:49.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/462: dread d0/f1e [0,4194304] 0 2024-01-17T23:38:49.986 INFO:tasks.workunit.client.0.smithi067.stdout:7/400: unlink d4/de/l5e 0 2024-01-17T23:38:49.986 INFO:tasks.workunit.client.0.smithi067.stdout:7/401: fsync d4/f8 0 2024-01-17T23:38:50.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/402: write d4/d25/f49 [649607,12134] 0 2024-01-17T23:38:50.558 INFO:tasks.workunit.client.0.smithi067.stdout:1/400: symlink d0/d7/d13/d3a/d3e/l7d 0 2024-01-17T23:38:50.558 INFO:tasks.workunit.client.0.smithi067.stdout:3/463: creat d0/d12/d1b/f8b x:0 0 0 2024-01-17T23:38:50.558 INFO:tasks.workunit.client.0.smithi067.stdout:3/464: stat d0/d13/d4a/d55/c74 0 2024-01-17T23:38:50.559 INFO:tasks.workunit.client.0.smithi067.stdout:8/416: symlink d6/d19/d22/d25/d53/l92 0 2024-01-17T23:38:50.559 INFO:tasks.workunit.client.0.smithi067.stdout:8/417: write d6/d19/f4a [3586,66754] 0 2024-01-17T23:38:50.564 INFO:tasks.workunit.client.0.smithi067.stdout:8/418: dread d6/fe [0,4194304] 0 2024-01-17T23:38:50.927 INFO:tasks.workunit.client.0.smithi067.stdout:1/401: creat d0/d7/d13/f7e x:0 0 0 2024-01-17T23:38:51.051 INFO:tasks.workunit.client.0.smithi067.stdout:3/465: getdents d0/d34/d35/d65 0 2024-01-17T23:38:51.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/419: mkdir d6/d93 0 2024-01-17T23:38:51.320 INFO:tasks.workunit.client.0.smithi067.stdout:8/420: dwrite d6/db/d58/f73 [0,4194304] 0 2024-01-17T23:38:51.320 INFO:tasks.workunit.client.0.smithi067.stdout:8/421: readlink d6/db/l21 0 2024-01-17T23:38:51.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/466: creat d0/d13/d4a/d82/f8c x:0 0 0 2024-01-17T23:38:52.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/422: creat d6/d26/d3e/d87/f94 x:0 0 0 2024-01-17T23:38:52.833 INFO:tasks.workunit.client.0.smithi067.stdout:8/423: unlink d6/d19/d22/d25/d53/d48/f70 0 2024-01-17T23:38:52.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/352: rename d3/d6/c18 to d3/d6/d11/d50/c7d 0 2024-01-17T23:38:52.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/353: chown d3/d6 46000 1 2024-01-17T23:38:52.922 INFO:tasks.workunit.client.0.smithi067.stdout:7/403: rmdir d4/d25/d39/d46 39 2024-01-17T23:38:52.947 INFO:tasks.workunit.client.0.smithi067.stdout:7/404: dread d4/d25/d39/f54 [4194304,4194304] 0 2024-01-17T23:38:53.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/394: rename d6/d18/f6f to d6/d9/d65/f89 0 2024-01-17T23:38:53.241 INFO:tasks.workunit.client.0.smithi067.stdout:6/395: dwrite d6/d9/f10 [0,4194304] 0 2024-01-17T23:38:53.249 INFO:tasks.workunit.client.0.smithi067.stdout:5/319: write d10/f11 [4887936,19449] 0 2024-01-17T23:38:53.280 INFO:tasks.workunit.client.0.smithi067.stdout:5/320: dwrite d10/d24/d46/f69 [0,4194304] 0 2024-01-17T23:38:53.568 INFO:tasks.workunit.client.0.smithi067.stdout:7/405: unlink d4/d25/d39/c32 0 2024-01-17T23:38:53.569 INFO:tasks.workunit.client.0.smithi067.stdout:4/377: creat d3/f75 x:0 0 0 2024-01-17T23:38:53.620 INFO:tasks.workunit.client.0.smithi067.stdout:7/406: dwrite d4/de/f14 [0,4194304] 0 2024-01-17T23:38:54.239 INFO:tasks.workunit.client.0.smithi067.stdout:3/467: unlink d0/d12/l85 0 2024-01-17T23:38:54.335 INFO:tasks.workunit.client.0.smithi067.stdout:6/396: getdents d6/d9 0 2024-01-17T23:38:54.743 INFO:tasks.workunit.client.0.smithi067.stdout:5/321: dread d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:38:54.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/322: dwrite d10/f19 [0,4194304] 0 2024-01-17T23:38:54.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/378: unlink d3/d26/d34/d3a/f45 0 2024-01-17T23:38:55.283 INFO:tasks.workunit.client.0.smithi067.stdout:7/407: link d4/d25/d56/l6b d4/d25/d39/l73 0 2024-01-17T23:38:55.283 INFO:tasks.workunit.client.0.smithi067.stdout:7/408: chown d4/de/c5c 99827191 1 2024-01-17T23:38:55.340 INFO:tasks.workunit.client.0.smithi067.stdout:3/468: truncate d0/d12/d59/f66 1037157 0 2024-01-17T23:38:55.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/397: mknod d6/d9/d1c/c8a 0 2024-01-17T23:38:55.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/398: chown d6/d9/d30 68733827 1 2024-01-17T23:38:55.657 INFO:tasks.workunit.client.0.smithi067.stdout:4/379: rename d3/d8/d35/f71 to d3/d8/de/d20/d52/f76 0 2024-01-17T23:38:55.826 INFO:tasks.workunit.client.0.smithi067.stdout:7/409: mknod d4/d25/d56/c74 0 2024-01-17T23:38:55.826 INFO:tasks.workunit.client.0.smithi067.stdout:7/410: write d4/f65 [1102174,117098] 0 2024-01-17T23:38:55.826 INFO:tasks.workunit.client.0.smithi067.stdout:7/411: write d4/d25/d39/f70 [174696,26514] 0 2024-01-17T23:38:56.018 INFO:tasks.workunit.client.0.smithi067.stdout:3/469: mknod d0/d17/d69/d6e/c8d 0 2024-01-17T23:38:56.052 INFO:tasks.workunit.client.0.smithi067.stdout:3/470: dwrite d0/d17/f4c [0,4194304] 0 2024-01-17T23:38:56.090 INFO:tasks.workunit.client.0.smithi067.stdout:3/471: dwrite d0/d34/d35/f50 [4194304,4194304] 0 2024-01-17T23:38:56.190 INFO:tasks.workunit.client.0.smithi067.stdout:6/399: creat d6/d9/d1c/d1e/d43/f8b x:0 0 0 2024-01-17T23:38:56.328 INFO:tasks.workunit.client.0.smithi067.stdout:5/323: mknod d10/d24/c6c 0 2024-01-17T23:38:56.328 INFO:tasks.workunit.client.0.smithi067.stdout:5/324: chown d10/d24/d46/f54 9 1 2024-01-17T23:38:56.367 INFO:tasks.workunit.client.0.smithi067.stdout:5/325: dwrite d10/d24/f5f [0,4194304] 0 2024-01-17T23:38:56.367 INFO:tasks.workunit.client.0.smithi067.stdout:5/326: fsync d10/d24/d46/f6a 0 2024-01-17T23:38:56.367 INFO:tasks.workunit.client.0.smithi067.stdout:5/327: chown d10/d24/c31 3032 1 2024-01-17T23:38:56.518 INFO:tasks.workunit.client.0.smithi067.stdout:1/402: sync 2024-01-17T23:38:56.518 INFO:tasks.workunit.client.0.smithi067.stdout:0/427: sync 2024-01-17T23:38:56.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/390: sync 2024-01-17T23:38:56.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/391: write d5/d1f/d16/f85 [36593,20756] 0 2024-01-17T23:38:57.763 INFO:tasks.workunit.client.0.smithi067.stdout:6/400: creat d6/d9/d1c/d1e/d7e/f8c x:0 0 0 2024-01-17T23:38:57.766 INFO:tasks.workunit.client.0.smithi067.stdout:1/403: rmdir d0/d7/d13 39 2024-01-17T23:38:57.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/328: truncate d10/d24/d25/f2e 186253 0 2024-01-17T23:38:57.778 INFO:tasks.workunit.client.0.smithi067.stdout:0/428: dread d3/d5/f2b [0,4194304] 0 2024-01-17T23:38:57.778 INFO:tasks.workunit.client.0.smithi067.stdout:0/429: dread - d3/d4c/f96 zero size 2024-01-17T23:38:57.778 INFO:tasks.workunit.client.0.smithi067.stdout:0/430: fsync d3/d5/d32/f41 0 2024-01-17T23:38:58.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/401: mkdir d6/d9/d30/d4c/d8d 0 2024-01-17T23:38:58.590 INFO:tasks.workunit.client.0.smithi067.stdout:1/404: mkdir d0/d7/d7f 0 2024-01-17T23:38:58.789 INFO:tasks.workunit.client.0.smithi067.stdout:5/329: symlink d10/d24/d59/d5d/l6d 0 2024-01-17T23:38:58.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/431: unlink d3/d5/d1a/d1c/d1d/f21 0 2024-01-17T23:38:58.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/432: chown d3/d5/d1a/d1c/d4e/d6b/ca0 2 1 2024-01-17T23:38:58.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/433: creat d3/d5/d1a/d1c/d4d/faa x:0 0 0 2024-01-17T23:38:58.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/434: creat d3/d5/d1a/d1c/d4e/d6b/fab x:0 0 0 2024-01-17T23:38:58.985 INFO:tasks.workunit.client.0.smithi067.stdout:0/435: readlink d3/d6/dd/d43/l49 0 2024-01-17T23:38:59.073 INFO:tasks.workunit.client.0.smithi067.stdout:6/402: symlink d6/d9/d30/d4c/d8d/l8e 0 2024-01-17T23:38:59.226 INFO:tasks.workunit.client.0.smithi067.stdout:1/405: symlink d0/d7/l80 0 2024-01-17T23:38:59.556 INFO:tasks.workunit.client.0.smithi067.stdout:0/436: dread d3/d5/d1a/f42 [0,4194304] 0 2024-01-17T23:38:59.559 INFO:tasks.workunit.client.0.smithi067.stdout:0/437: dread d3/d5/d32/f41 [4194304,4194304] 0 2024-01-17T23:38:59.794 INFO:tasks.workunit.client.0.smithi067.stdout:6/403: symlink d6/l8f 0 2024-01-17T23:38:59.795 INFO:tasks.workunit.client.0.smithi067.stdout:4/380: getdents d3/d8/d35 0 2024-01-17T23:38:59.808 INFO:tasks.workunit.client.0.smithi067.stdout:6/404: write d6/d9/d1c/f2f [1622258,36758] 0 2024-01-17T23:38:59.815 INFO:tasks.workunit.client.0.smithi067.stdout:9/354: unlink d3/f64 0 2024-01-17T23:38:59.822 INFO:tasks.workunit.client.0.smithi067.stdout:6/405: dread d6/d9/d1c/d1e/f5e [0,4194304] 0 2024-01-17T23:38:59.863 INFO:tasks.workunit.client.0.smithi067.stdout:6/406: dwrite d6/d9/d30/f4d [4194304,4194304] 0 2024-01-17T23:39:00.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/438: unlink d3/d5/d32/f6a 0 2024-01-17T23:39:00.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/439: chown c0 0 1 2024-01-17T23:39:00.519 INFO:tasks.workunit.client.0.smithi067.stdout:9/355: mknod d3/d6/d47/c7e 0 2024-01-17T23:39:00.528 INFO:tasks.workunit.client.0.smithi067.stdout:9/356: write d3/f13 [1466059,102750] 0 2024-01-17T23:39:00.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/407: symlink d6/d18/d2e/d7c/l90 0 2024-01-17T23:39:00.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/408: stat d6/d9/d1c/c36 0 2024-01-17T23:39:00.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/409: getdents d6/d9/d1c/d1e/d43/d86 0 2024-01-17T23:39:01.045 INFO:tasks.workunit.client.0.smithi067.stdout:0/440: mkdir d3/d5/d1a/d1c/d4d/dac 0 2024-01-17T23:39:01.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/424: symlink d6/l95 0 2024-01-17T23:39:01.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/425: truncate d6/d19/d22/d25/d53/f16 953990 0 2024-01-17T23:39:01.229 INFO:tasks.workunit.client.0.smithi067.stdout:5/330: rename d10/d24/d46/d4a/d4b/f47 to d10/f6e 0 2024-01-17T23:39:01.525 INFO:tasks.workunit.client.0.smithi067.stdout:8/426: rmdir d6/d26 39 2024-01-17T23:39:01.525 INFO:tasks.workunit.client.0.smithi067.stdout:6/410: creat d6/d9/d30/d4c/d82/f91 x:0 0 0 2024-01-17T23:39:01.541 INFO:tasks.workunit.client.0.smithi067.stdout:6/411: write d6/fa [5090347,4744] 0 2024-01-17T23:39:01.556 INFO:tasks.workunit.client.0.smithi067.stdout:6/412: dread d6/f8 [0,4194304] 0 2024-01-17T23:39:01.648 INFO:tasks.workunit.client.0.smithi067.stdout:0/441: rename d3/d5/d1a/d1c/d4e/f7e to d3/d5/d32/d9f/fad 0 2024-01-17T23:39:01.648 INFO:tasks.workunit.client.0.smithi067.stdout:8/427: rename d6 to d6/d19/d22/d25/d53/d65/d96 22 2024-01-17T23:39:01.803 INFO:tasks.workunit.client.0.smithi067.stdout:3/472: mkdir d0/d13/d8e 0 2024-01-17T23:39:02.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/442: rename d3/d6/dd/l2a to d3/d5/lae 0 2024-01-17T23:39:02.883 INFO:tasks.workunit.client.0.smithi067.stdout:3/473: creat d0/d12/f8f x:0 0 0 2024-01-17T23:39:03.061 INFO:tasks.workunit.client.0.smithi067.stdout:2/392: write d5/d1f/d2a/d54/d8/f58 [3272316,85837] 0 2024-01-17T23:39:03.094 INFO:tasks.workunit.client.0.smithi067.stdout:2/393: dwrite d5/d1f/d16/f85 [0,4194304] 0 2024-01-17T23:39:03.094 INFO:tasks.workunit.client.0.smithi067.stdout:2/394: readlink d5/l53 0 2024-01-17T23:39:03.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/395: dwrite d5/d1f/d2a/d54/d8/d4c/f5f [0,4194304] 0 2024-01-17T23:39:03.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/443: rename d3/d6/l19 to d3/d5/d1a/d1c/d1d/d2e/d5a/laf 0 2024-01-17T23:39:03.317 INFO:tasks.workunit.client.0.smithi067.stdout:3/474: mknod d0/d34/d35/d57/c90 0 2024-01-17T23:39:03.327 INFO:tasks.workunit.client.0.smithi067.stdout:3/475: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:39:03.602 INFO:tasks.workunit.client.0.smithi067.stdout:0/444: mkdir d3/d6/dd/d43/db0 0 2024-01-17T23:39:03.870 INFO:tasks.workunit.client.0.smithi067.stdout:0/445: mknod d3/d5/d1a/d1c/d4e/cb1 0 2024-01-17T23:39:03.870 INFO:tasks.workunit.client.0.smithi067.stdout:3/476: truncate d0/d12/f20 1236408 0 2024-01-17T23:39:03.870 INFO:tasks.workunit.client.0.smithi067.stdout:3/477: dread - d0/d17/f5e zero size 2024-01-17T23:39:03.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/478: dwrite d0/f14 [0,4194304] 0 2024-01-17T23:39:03.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/479: write d0/d13/d4a/f5c [1534742,19619] 0 2024-01-17T23:39:03.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/480: readlink d0/d12/d1b/l49 0 2024-01-17T23:39:04.150 INFO:tasks.workunit.client.0.smithi067.stdout:1/406: dwrite d0/f2f [0,4194304] 0 2024-01-17T23:39:04.750 INFO:tasks.workunit.client.0.smithi067.stdout:9/357: link d3/d6/d2a/d34/d42/f6b d3/d6/f7f 0 2024-01-17T23:39:04.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/412: sync 2024-01-17T23:39:04.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/446: rename d3/d5/d1a/d1c/d4d/dac to d3/d6/dd/d43/db2 0 2024-01-17T23:39:05.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/481: dwrite d0/d13/f2c [0,4194304] 0 2024-01-17T23:39:05.186 INFO:tasks.workunit.client.0.smithi067.stdout:1/407: creat d0/d7/d13/d3a/f81 x:0 0 0 2024-01-17T23:39:05.186 INFO:tasks.workunit.client.0.smithi067.stdout:1/408: truncate d0/d7/f61 1614414 0 2024-01-17T23:39:05.519 INFO:tasks.workunit.client.0.smithi067.stdout:4/381: sync 2024-01-17T23:39:05.519 INFO:tasks.workunit.client.0.smithi067.stdout:9/358: symlink d3/d15/d55/l80 0 2024-01-17T23:39:05.544 INFO:tasks.workunit.client.0.smithi067.stdout:4/382: dread d3/d8/f1f [0,4194304] 0 2024-01-17T23:39:05.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/331: dwrite d10/d24/d25/f35 [0,4194304] 0 2024-01-17T23:39:05.571 INFO:tasks.workunit.client.0.smithi067.stdout:4/383: dwrite d3/d8/d35/f6e [0,4194304] 0 2024-01-17T23:39:05.598 INFO:tasks.workunit.client.0.smithi067.stdout:7/413: mkdir d4/d4b/d63/d75 0 2024-01-17T23:39:05.763 INFO:tasks.workunit.client.0.smithi067.stdout:6/413: dwrite d6/fb [0,4194304] 0 2024-01-17T23:39:05.774 INFO:tasks.workunit.client.0.smithi067.stdout:6/414: dread d6/f1f [0,4194304] 0 2024-01-17T23:39:05.906 INFO:tasks.workunit.client.0.smithi067.stdout:3/482: readlink d0/l24 0 2024-01-17T23:39:05.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/483: write d0/f14 [602526,46867] 0 2024-01-17T23:39:05.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/484: fdatasync d0/f7c 0 2024-01-17T23:39:06.029 INFO:tasks.workunit.client.0.smithi067.stdout:1/409: rmdir d0/d7/d1c/d73/d7a 0 2024-01-17T23:39:06.182 INFO:tasks.workunit.client.0.smithi067.stdout:9/359: creat d3/d58/f81 x:0 0 0 2024-01-17T23:39:06.511 INFO:tasks.workunit.client.0.smithi067.stdout:2/396: mkdir d5/d86 0 2024-01-17T23:39:06.511 INFO:tasks.workunit.client.0.smithi067.stdout:5/332: rmdir d10/d24/d46/d4a 39 2024-01-17T23:39:06.511 INFO:tasks.workunit.client.0.smithi067.stdout:5/333: chown d10/f3d 13044 1 2024-01-17T23:39:06.529 INFO:tasks.workunit.client.0.smithi067.stdout:5/334: dread d10/d24/f2d [0,4194304] 0 2024-01-17T23:39:06.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/397: dwrite d5/d1f/d16/f20 [0,4194304] 0 2024-01-17T23:39:06.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/384: creat d3/d8/de/f77 x:0 0 0 2024-01-17T23:39:06.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/385: readlink d3/d8/de/d38/l5f 0 2024-01-17T23:39:06.719 INFO:tasks.workunit.client.0.smithi067.stdout:4/386: dread d3/d40/f41 [0,4194304] 0 2024-01-17T23:39:06.974 INFO:tasks.workunit.client.0.smithi067.stdout:6/415: creat d6/d9/d3e/f92 x:0 0 0 2024-01-17T23:39:07.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/335: rmdir d10/d24/d46/d4a/d50 39 2024-01-17T23:39:07.465 INFO:tasks.workunit.client.0.smithi067.stdout:2/398: symlink d5/d1f/d2a/d54/l87 0 2024-01-17T23:39:07.465 INFO:tasks.workunit.client.0.smithi067.stdout:2/399: fdatasync d5/d1f/d2a/d54/d8/f34 0 2024-01-17T23:39:08.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/400: symlink d5/d1f/d16/l88 0 2024-01-17T23:39:08.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/401: dwrite d5/d1f/d2a/d54/d8/d32/f42 [0,4194304] 0 2024-01-17T23:39:08.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/402: fsync d5/d1f/d35/f6d 0 2024-01-17T23:39:08.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/403: write d5/d1f/d2a/d54/d7c/f82 [700881,117045] 0 2024-01-17T23:39:08.497 INFO:tasks.workunit.client.0.smithi067.stdout:2/404: chown d5/d1f/d2a/d54/d8/f58 56 1 2024-01-17T23:39:08.767 INFO:tasks.workunit.client.0.smithi067.stdout:8/428: sync 2024-01-17T23:39:09.086 INFO:tasks.workunit.client.0.smithi067.stdout:2/405: creat d5/d1f/d2a/d54/d8/d4c/d84/f89 x:0 0 0 2024-01-17T23:39:09.110 INFO:tasks.workunit.client.0.smithi067.stdout:2/406: write d5/d1f/d2a/d55/f71 [3203264,81564] 0 2024-01-17T23:39:09.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/429: symlink d6/d19/d22/d25/d53/l97 0 2024-01-17T23:39:09.404 INFO:tasks.workunit.client.0.smithi067.stdout:0/447: rename d3/d5/d1a/l3a to d3/d64/d7d/lb3 0 2024-01-17T23:39:09.647 INFO:tasks.workunit.client.0.smithi067.stdout:9/360: rmdir d3/d15/d55 39 2024-01-17T23:39:09.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/430: getdents d6/d26/d3e/d8d 0 2024-01-17T23:39:09.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/431: chown d6/d19/d22/d25/d53/l92 1935 1 2024-01-17T23:39:09.969 INFO:tasks.workunit.client.0.smithi067.stdout:0/448: symlink d3/d6/d80/lb4 0 2024-01-17T23:39:09.969 INFO:tasks.workunit.client.0.smithi067.stdout:0/449: write d3/f47 [1241206,130831] 0 2024-01-17T23:39:10.036 INFO:tasks.workunit.client.0.smithi067.stdout:9/361: stat d3/d6/d11/d50/c51 0 2024-01-17T23:39:10.315 INFO:tasks.workunit.client.0.smithi067.stdout:0/450: creat d3/d5/d1a/d1c/d4d/fb5 x:0 0 0 2024-01-17T23:39:10.460 INFO:tasks.workunit.client.0.smithi067.stdout:8/432: truncate d6/d26/d3e/f74 1365397 0 2024-01-17T23:39:10.460 INFO:tasks.workunit.client.0.smithi067.stdout:8/433: chown d6/d26/d7c 28045 1 2024-01-17T23:39:10.474 INFO:tasks.workunit.client.0.smithi067.stdout:8/434: write d6/db/d58/f73 [334779,8062] 0 2024-01-17T23:39:10.809 INFO:tasks.workunit.client.0.smithi067.stdout:9/362: link d3/d6/d11/d5c/f70 d3/d6/d11/f82 0 2024-01-17T23:39:10.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/485: dwrite d0/d17/f5f [0,4194304] 0 2024-01-17T23:39:10.845 INFO:tasks.workunit.client.0.smithi067.stdout:3/486: read d0/f11 [271895,83803] 0 2024-01-17T23:39:10.882 INFO:tasks.workunit.client.0.smithi067.stdout:7/414: mknod d4/d25/c76 0 2024-01-17T23:39:11.125 INFO:tasks.workunit.client.0.smithi067.stdout:0/451: truncate d3/d6/dd/d43/f92 947972 0 2024-01-17T23:39:11.285 INFO:tasks.workunit.client.0.smithi067.stdout:8/435: symlink d6/d26/d56/d89/l98 0 2024-01-17T23:39:11.285 INFO:tasks.workunit.client.0.smithi067.stdout:8/436: fdatasync d6/d19/d22/d25/f85 0 2024-01-17T23:39:11.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/437: dread d6/d19/d22/f2f [0,4194304] 0 2024-01-17T23:39:11.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/438: chown d6/db/d58/f3d 923 1 2024-01-17T23:39:11.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/439: stat d6/db/f55 0 2024-01-17T23:39:11.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/440: chown d6/db/d58/c4b 146858 1 2024-01-17T23:39:11.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/441: fsync d6/db/f55 0 2024-01-17T23:39:11.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/363: creat d3/d25/d28/f83 x:0 0 0 2024-01-17T23:39:11.880 INFO:tasks.workunit.client.0.smithi067.stdout:1/410: rename d0/d32 to d0/d7/d7f/d82 0 2024-01-17T23:39:11.881 INFO:tasks.workunit.client.0.smithi067.stdout:2/407: rename d5 to d5/d2f/d8a 22 2024-01-17T23:39:12.071 INFO:tasks.workunit.client.0.smithi067.stdout:0/452: creat d3/d5/d1a/d1c/d4e/fb6 x:0 0 0 2024-01-17T23:39:12.098 INFO:tasks.workunit.client.0.smithi067.stdout:0/453: dwrite d3/d5/d1a/d1c/d4e/d6b/f8f [0,4194304] 0 2024-01-17T23:39:12.244 INFO:tasks.workunit.client.0.smithi067.stdout:8/442: symlink d6/d19/d22/d25/l99 0 2024-01-17T23:39:12.244 INFO:tasks.workunit.client.0.smithi067.stdout:8/443: fdatasync d6/d26/d7c/f8b 0 2024-01-17T23:39:12.245 INFO:tasks.workunit.client.0.smithi067.stdout:8/444: truncate d6/d19/d22/d25/f7d 911412 0 2024-01-17T23:39:12.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/411: rename d0/d7/d1c/f23 to d0/d7/d7f/d82/d35/f83 0 2024-01-17T23:39:12.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/408: symlink d5/d1f/d35/l8b 0 2024-01-17T23:39:12.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/409: write d5/f78 [338003,51784] 0 2024-01-17T23:39:12.760 INFO:tasks.workunit.client.0.smithi067.stdout:2/410: creat d5/d1f/d2a/d54/d8/d4c/d84/f8c x:0 0 0 2024-01-17T23:39:13.005 INFO:tasks.workunit.client.0.smithi067.stdout:0/454: mkdir d3/d6/dd/d43/db2/db7 0 2024-01-17T23:39:13.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/364: getdents d3/d15/d57 0 2024-01-17T23:39:13.214 INFO:tasks.workunit.client.0.smithi067.stdout:3/487: link d0/c6 d0/c91 0 2024-01-17T23:39:13.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:13.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:1/412: creat d0/d74/f84 x:0 0 0 2024-01-17T23:39:13.663 INFO:tasks.workunit.client.0.smithi067.stdout:2/411: mkdir d5/d1f/d2a/d8d 0 2024-01-17T23:39:13.663 INFO:tasks.workunit.client.0.smithi067.stdout:2/412: fsync d5/d1f/f64 0 2024-01-17T23:39:13.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/455: creat d3/d6/dd/fb8 x:0 0 0 2024-01-17T23:39:14.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/365: unlink d3/d25/d28/f4a 0 2024-01-17T23:39:14.029 INFO:tasks.workunit.client.0.smithi067.stdout:9/366: dread d3/d6/d2a/f3f [0,4194304] 0 2024-01-17T23:39:14.030 INFO:tasks.workunit.client.0.smithi067.stdout:9/367: fdatasync d3/d15/d57/f74 0 2024-01-17T23:39:14.114 INFO:tasks.workunit.client.0.smithi067.stdout:3/488: dwrite d0/d13/f16 [0,4194304] 0 2024-01-17T23:39:14.233 INFO:tasks.workunit.client.0.smithi067.stdout:7/415: rename d4/d25/d39/d46/d60/l69 to d4/d25/d39/d46/l77 0 2024-01-17T23:39:14.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/416: read d4/d25/f33 [447171,112346] 0 2024-01-17T23:39:14.268 INFO:tasks.workunit.client.0.smithi067.stdout:1/413: symlink d0/d74/d31/l85 0 2024-01-17T23:39:14.386 INFO:tasks.workunit.client.0.smithi067.stdout:5/336: sync 2024-01-17T23:39:14.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/387: sync 2024-01-17T23:39:14.386 INFO:tasks.workunit.client.0.smithi067.stdout:6/416: sync 2024-01-17T23:39:14.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/388: fsync d3/d8/de/f54 0 2024-01-17T23:39:14.387 INFO:tasks.workunit.client.0.smithi067.stdout:6/417: dread - d6/d9/d30/f7b zero size 2024-01-17T23:39:14.387 INFO:tasks.workunit.client.0.smithi067.stdout:6/418: fdatasync d6/d9/f34 0 2024-01-17T23:39:14.415 INFO:tasks.workunit.client.0.smithi067.stdout:4/389: dwrite d3/d8/f13 [0,4194304] 0 2024-01-17T23:39:14.482 INFO:tasks.workunit.client.0.smithi067.stdout:2/413: creat d5/d1f/d2a/d54/d25/f8e x:0 0 0 2024-01-17T23:39:15.075 INFO:tasks.workunit.client.0.smithi067.stdout:8/445: rename d6/d19/d22/d25/d53/d65/f43 to d6/d26/d7c/f9a 0 2024-01-17T23:39:15.075 INFO:tasks.workunit.client.0.smithi067.stdout:8/446: chown d6/d26/l64 1 1 2024-01-17T23:39:15.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/414: creat d0/d74/d31/f86 x:0 0 0 2024-01-17T23:39:15.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/419: creat d6/d9/d30/d4c/d8d/f93 x:0 0 0 2024-01-17T23:39:15.785 INFO:tasks.workunit.client.0.smithi067.stdout:4/390: link d3/d8/l1d d3/d4e/l78 0 2024-01-17T23:39:15.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/414: creat d5/d2f/f8f x:0 0 0 2024-01-17T23:39:15.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/415: write d5/d1f/d2a/d54/d8/f58 [1898434,77553] 0 2024-01-17T23:39:15.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/391: dwrite d3/f7 [0,4194304] 0 2024-01-17T23:39:15.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/392: dwrite d3/d8/de/d20/f56 [0,4194304] 0 2024-01-17T23:39:15.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/393: truncate d3/d8/de/f54 97024 0 2024-01-17T23:39:15.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/394: truncate d3/f75 225460 0 2024-01-17T23:39:16.178 INFO:tasks.workunit.client.0.smithi067.stdout:0/456: rename d3/d4c/f96 to d3/d6/dd/d43/fb9 0 2024-01-17T23:39:16.178 INFO:tasks.workunit.client.0.smithi067.stdout:0/457: chown d3/d5/d32/c4f 11 1 2024-01-17T23:39:16.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/417: mkdir d4/d25/d39/d46/d78 0 2024-01-17T23:39:16.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/415: symlink d0/d7/d13/d3a/l87 0 2024-01-17T23:39:16.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/416: stat d0/d7/f61 0 2024-01-17T23:39:17.392 INFO:tasks.workunit.client.0.smithi067.stdout:4/395: symlink d3/d26/d34/d3a/l79 0 2024-01-17T23:39:17.413 INFO:tasks.workunit.client.0.smithi067.stdout:4/396: dread d3/d8/d35/f6e [0,4194304] 0 2024-01-17T23:39:17.413 INFO:tasks.workunit.client.0.smithi067.stdout:4/397: fdatasync d3/d8/de/d20/f56 0 2024-01-17T23:39:17.667 INFO:tasks.workunit.client.0.smithi067.stdout:0/458: symlink d3/d64/lba 0 2024-01-17T23:39:17.667 INFO:tasks.workunit.client.0.smithi067.stdout:0/459: read d3/d5/f38 [3769798,79856] 0 2024-01-17T23:39:18.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/417: rmdir d0/d7/d13/d3d 39 2024-01-17T23:39:18.341 INFO:tasks.workunit.client.0.smithi067.stdout:4/398: symlink d3/d26/d34/d3a/d53/l7a 0 2024-01-17T23:39:18.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/420: rename d6/d9/f34 to d6/d9/f94 0 2024-01-17T23:39:18.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/421: creat d6/d9/d30/d4c/d82/f95 x:0 0 0 2024-01-17T23:39:18.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/422: fdatasync d6/d9/d30/d4c/f6d 0 2024-01-17T23:39:18.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/423: chown d6/d9/d30/d58/f6a 138975772 1 2024-01-17T23:39:18.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/424: fsync d6/d9/d1c/d1e/f5e 0 2024-01-17T23:39:18.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/425: chown d6/d18 16677 1 2024-01-17T23:39:18.944 INFO:tasks.workunit.client.0.smithi067.stdout:4/399: creat d3/d26/d34/f7b x:0 0 0 2024-01-17T23:39:19.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/426: creat d6/d9/d1c/f96 x:0 0 0 2024-01-17T23:39:19.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/427: fsync d6/d9/d30/f5a 0 2024-01-17T23:39:19.180 INFO:tasks.workunit.client.0.smithi067.stdout:6/428: write d6/f1f [4023832,49075] 0 2024-01-17T23:39:19.180 INFO:tasks.workunit.client.0.smithi067.stdout:6/429: write d6/f8 [1361316,56005] 0 2024-01-17T23:39:19.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/418: rmdir d0/d7/d13/d2e 39 2024-01-17T23:39:19.424 INFO:tasks.workunit.client.0.smithi067.stdout:3/489: sync 2024-01-17T23:39:19.577 INFO:tasks.workunit.client.0.smithi067.stdout:5/337: dwrite d10/d24/d25/f2e [0,4194304] 0 2024-01-17T23:39:19.580 INFO:tasks.workunit.client.0.smithi067.stdout:5/338: write d10/d24/d25/f2b [99908,12168] 0 2024-01-17T23:39:19.879 INFO:tasks.workunit.client.0.smithi067.stdout:6/430: creat d6/d9/d1c/d1e/d43/d86/f97 x:0 0 0 2024-01-17T23:39:19.879 INFO:tasks.workunit.client.0.smithi067.stdout:6/431: write d6/d9/d1c/d1e/d43/f8b [999754,118993] 0 2024-01-17T23:39:19.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/432: dread d6/d9/d1c/d1e/f5e [0,4194304] 0 2024-01-17T23:39:19.946 INFO:tasks.workunit.client.0.smithi067.stdout:9/368: dwrite d3/d6/d11/f1b [0,4194304] 0 2024-01-17T23:39:20.109 INFO:tasks.workunit.client.0.smithi067.stdout:1/419: link d0/d7/d13/d2e/f6d d0/d7/d13/d3a/d3e/f88 0 2024-01-17T23:39:20.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/490: chown d0/c3a 293 1 2024-01-17T23:39:20.150 INFO:tasks.workunit.client.0.smithi067.stdout:1/420: dwrite d0/d7/d13/f5b [0,4194304] 0 2024-01-17T23:39:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:1/421: dwrite d0/d74/f6a [0,4194304] 0 2024-01-17T23:39:20.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/422: dwrite d0/d74/d31/f86 [0,4194304] 0 2024-01-17T23:39:20.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/423: creat d0/d62/f89 x:0 0 0 2024-01-17T23:39:20.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/424: fsync d0/d7/f29 0 2024-01-17T23:39:20.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/425: readlink d0/d62/l63 0 2024-01-17T23:39:20.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/426: fsync d0/f5 0 2024-01-17T23:39:20.437 INFO:tasks.workunit.client.0.smithi067.stdout:5/339: link c6 d10/d24/d59/d5d/d43/c6f 0 2024-01-17T23:39:20.437 INFO:tasks.workunit.client.0.smithi067.stdout:6/433: symlink d6/d9/l98 0 2024-01-17T23:39:20.437 INFO:tasks.workunit.client.0.smithi067.stdout:6/434: creat d6/d9/d30/d4c/d8d/f99 x:0 0 0 2024-01-17T23:39:20.474 INFO:tasks.workunit.client.0.smithi067.stdout:5/340: dwrite d10/d24/d59/d5d/f41 [0,4194304] 0 2024-01-17T23:39:20.475 INFO:tasks.workunit.client.0.smithi067.stdout:8/447: dwrite d6/d19/d22/d25/f59 [0,4194304] 0 2024-01-17T23:39:20.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/369: mkdir d3/d6/d11/d50/d84 0 2024-01-17T23:39:20.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/370: dread - d3/d6/d11/d50/f77 zero size 2024-01-17T23:39:20.643 INFO:tasks.workunit.client.0.smithi067.stdout:3/491: symlink d0/d13/d4a/d82/l92 0 2024-01-17T23:39:20.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/371: chown d3/d6/d2a/f71 1278 1 2024-01-17T23:39:20.644 INFO:tasks.workunit.client.0.smithi067.stdout:3/492: fsync d0/f14 0 2024-01-17T23:39:20.673 INFO:tasks.workunit.client.0.smithi067.stdout:9/372: dwrite d3/d6/d11/f4f [0,4194304] 0 2024-01-17T23:39:20.699 INFO:tasks.workunit.client.0.smithi067.stdout:9/373: dwrite d3/d6/d11/d50/f43 [0,4194304] 0 2024-01-17T23:39:20.860 INFO:tasks.workunit.client.0.smithi067.stdout:2/416: rmdir d5/d1f/d2a/d54/d39 39 2024-01-17T23:39:20.860 INFO:tasks.workunit.client.0.smithi067.stdout:2/417: readlink d5/d1f/d16/l17 0 2024-01-17T23:39:21.050 INFO:tasks.workunit.client.0.smithi067.stdout:1/427: mknod d0/d7/d13/d3a/d75/c8a 0 2024-01-17T23:39:21.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/428: dwrite d0/d7/d13/d2e/f78 [0,4194304] 0 2024-01-17T23:39:21.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/429: dread d0/d7/d13/d3a/d45/f5a [0,4194304] 0 2024-01-17T23:39:21.854 INFO:tasks.workunit.client.0.smithi067.stdout:5/341: creat d10/d24/d59/d5d/d43/f70 x:0 0 0 2024-01-17T23:39:21.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/342: readlink d10/l1d 0 2024-01-17T23:39:21.855 INFO:tasks.workunit.client.0.smithi067.stdout:8/448: getdents d6/d26/d56/d89 0 2024-01-17T23:39:21.890 INFO:tasks.workunit.client.0.smithi067.stdout:5/343: dwrite d10/d24/d25/f2e [0,4194304] 0 2024-01-17T23:39:21.891 INFO:tasks.workunit.client.0.smithi067.stdout:5/344: getdents d10/d24/d25/d5c 0 2024-01-17T23:39:22.198 INFO:tasks.workunit.client.0.smithi067.stdout:7/418: write d4/d4b/f61 [88963,92205] 0 2024-01-17T23:39:22.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/493: write d0/d13/f3c [1500733,113771] 0 2024-01-17T23:39:22.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/494: stat d0/d12/d1b/f1d 0 2024-01-17T23:39:22.749 INFO:tasks.workunit.client.0.smithi067.stdout:2/418: symlink d5/d2f/l90 0 2024-01-17T23:39:22.750 INFO:tasks.workunit.client.0.smithi067.stdout:2/419: fdatasync d5/d1f/d2a/d54/d25/f8e 0 2024-01-17T23:39:23.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/345: creat d10/f71 x:0 0 0 2024-01-17T23:39:23.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/346: truncate d10/d24/d46/f54 879083 0 2024-01-17T23:39:23.066 INFO:tasks.workunit.client.0.smithi067.stdout:5/347: dwrite d10/d24/d46/f69 [0,4194304] 0 2024-01-17T23:39:23.098 INFO:tasks.workunit.client.0.smithi067.stdout:5/348: dwrite f9 [0,4194304] 0 2024-01-17T23:39:23.256 INFO:tasks.workunit.client.0.smithi067.stdout:7/419: mkdir d4/d25/d39/d79 0 2024-01-17T23:39:23.295 INFO:tasks.workunit.client.0.smithi067.stdout:0/460: dwrite d3/d6/dd/f29 [0,4194304] 0 2024-01-17T23:39:23.347 INFO:tasks.workunit.client.0.smithi067.stdout:3/495: mknod d0/d37/c93 0 2024-01-17T23:39:23.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/420: symlink d5/d1f/d16/d7d/l91 0 2024-01-17T23:39:23.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/421: fsync d5/f78 0 2024-01-17T23:39:23.773 INFO:tasks.workunit.client.0.smithi067.stdout:5/349: mknod d10/d24/d59/d5d/d43/c72 0 2024-01-17T23:39:23.773 INFO:tasks.workunit.client.0.smithi067.stdout:7/420: creat d4/d4b/f7a x:0 0 0 2024-01-17T23:39:23.832 INFO:tasks.workunit.client.0.smithi067.stdout:0/461: rename d3/d6/dd/d43/c87 to d3/d6/d80/cbb 0 2024-01-17T23:39:23.846 INFO:tasks.workunit.client.0.smithi067.stdout:0/462: read d3/d5/d32/f78 [3835108,2263] 0 2024-01-17T23:39:24.425 INFO:tasks.workunit.client.0.smithi067.stdout:0/463: mkdir d3/d6/dd/d43/db0/dbc 0 2024-01-17T23:39:24.455 INFO:tasks.workunit.client.0.smithi067.stdout:4/400: sync 2024-01-17T23:39:24.509 INFO:tasks.workunit.client.0.smithi067.stdout:2/422: truncate d5/d1f/d2a/f52 1940854 0 2024-01-17T23:39:24.649 INFO:tasks.workunit.client.0.smithi067.stdout:7/421: link d4/d25/c76 d4/c7b 0 2024-01-17T23:39:24.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/464: truncate d3/d64/f95 520041 0 2024-01-17T23:39:24.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/465: write d3/d6/dd/f4a [4992804,42775] 0 2024-01-17T23:39:24.896 INFO:tasks.workunit.client.0.smithi067.stdout:2/423: link d5/l1c d5/d1f/d16/l92 0 2024-01-17T23:39:25.012 INFO:tasks.workunit.client.0.smithi067.stdout:7/422: creat d4/d25/d56/f7c x:0 0 0 2024-01-17T23:39:25.012 INFO:tasks.workunit.client.0.smithi067.stdout:7/423: read d4/d25/d39/d46/d60/f66 [14336,24513] 0 2024-01-17T23:39:25.585 INFO:tasks.workunit.client.0.smithi067.stdout:8/449: mkdir d6/d26/d9b 0 2024-01-17T23:39:25.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/450: symlink d6/d26/d56/d89/l9c 0 2024-01-17T23:39:26.088 INFO:tasks.workunit.client.0.smithi067.stdout:6/435: sync 2024-01-17T23:39:26.349 INFO:tasks.workunit.client.0.smithi067.stdout:8/451: link d6/db/f34 d6/d26/d3e/f9d 0 2024-01-17T23:39:26.465 INFO:tasks.workunit.client.0.smithi067.stdout:6/436: mkdir d6/d18/d2e/d61/d9a 0 2024-01-17T23:39:26.465 INFO:tasks.workunit.client.0.smithi067.stdout:6/437: chown d6/d9/d1c/d1e/d43/d78 3439384 1 2024-01-17T23:39:26.465 INFO:tasks.workunit.client.0.smithi067.stdout:6/438: rename d6/d9/d1c to d6/d9/d1c/d9b 22 2024-01-17T23:39:26.601 INFO:tasks.workunit.client.0.smithi067.stdout:8/452: dread d6/db/f27 [0,4194304] 0 2024-01-17T23:39:26.601 INFO:tasks.workunit.client.0.smithi067.stdout:8/453: write d6/db/f41 [2976713,124110] 0 2024-01-17T23:39:26.601 INFO:tasks.workunit.client.0.smithi067.stdout:8/454: dread - d6/d19/d22/d25/d53/f76 zero size 2024-01-17T23:39:26.606 INFO:tasks.workunit.client.0.smithi067.stdout:8/455: write d6/d19/d22/d25/d53/f7e [72632,7314] 0 2024-01-17T23:39:26.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/456: dwrite d6/f1a [0,4194304] 0 2024-01-17T23:39:27.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/457: mknod d6/d26/d9b/c9e 0 2024-01-17T23:39:27.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/458: write d6/db/d58/f73 [171191,82227] 0 2024-01-17T23:39:27.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/459: dwrite d6/d19/f4a [0,4194304] 0 2024-01-17T23:39:27.584 INFO:tasks.workunit.client.0.smithi067.stdout:4/401: dwrite d3/f75 [0,4194304] 0 2024-01-17T23:39:27.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/460: creat d6/d26/d3e/d8d/f9f x:0 0 0 2024-01-17T23:39:27.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/461: fsync d6/d19/d22/f2f 0 2024-01-17T23:39:27.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/462: write d6/d26/d3e/d8d/f9f [129100,19503] 0 2024-01-17T23:39:27.673 INFO:tasks.workunit.client.0.smithi067.stdout:8/463: dwrite d6/d26/d7c/f8b [0,4194304] 0 2024-01-17T23:39:27.679 INFO:tasks.workunit.client.0.smithi067.stdout:8/464: dread d6/d19/d22/d25/d53/f16 [0,4194304] 0 2024-01-17T23:39:27.869 INFO:tasks.workunit.client.0.smithi067.stdout:0/466: write d3/d6/dd/d43/f92 [1675890,71724] 0 2024-01-17T23:39:27.977 INFO:tasks.workunit.client.0.smithi067.stdout:7/424: write d4/de/f3b [4892696,26153] 0 2024-01-17T23:39:27.977 INFO:tasks.workunit.client.0.smithi067.stdout:7/425: write d4/f5b [952623,66341] 0 2024-01-17T23:39:28.006 INFO:tasks.workunit.client.0.smithi067.stdout:7/426: dwrite d4/d25/d39/f54 [4194304,4194304] 0 2024-01-17T23:39:28.009 INFO:tasks.workunit.client.0.smithi067.stdout:7/427: dread d4/d25/f2c [0,4194304] 0 2024-01-17T23:39:28.010 INFO:tasks.workunit.client.0.smithi067.stdout:7/428: write d4/d16/f1e [5049295,37816] 0 2024-01-17T23:39:28.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/424: symlink d5/d1f/l93 0 2024-01-17T23:39:28.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/465: symlink d6/d19/d22/d25/d53/d54/la0 0 2024-01-17T23:39:28.517 INFO:tasks.workunit.client.0.smithi067.stdout:0/467: mknod d3/d64/d82/cbd 0 2024-01-17T23:39:28.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/429: mkdir d4/de/d41/d7d 0 2024-01-17T23:39:28.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/425: mknod d5/d1f/d35/c94 0 2024-01-17T23:39:28.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/426: dread - d5/d1f/d2a/d54/d8/d4c/d84/f8c zero size 2024-01-17T23:39:28.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/466: mkdir d6/d19/da1 0 2024-01-17T23:39:29.018 INFO:tasks.workunit.client.0.smithi067.stdout:3/496: creat d0/f94 x:0 0 0 2024-01-17T23:39:29.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/468: creat d3/d64/d82/fbe x:0 0 0 2024-01-17T23:39:29.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/430: chown d4/d25/d39/d46/f59 396 1 2024-01-17T23:39:29.368 INFO:tasks.workunit.client.0.smithi067.stdout:2/427: unlink d5/d1f/d2a/d54/d8/d32/l40 0 2024-01-17T23:39:29.420 INFO:tasks.workunit.client.0.smithi067.stdout:2/428: dwrite d5/d1f/d2a/d54/d8/d4c/d84/f8c [0,4194304] 0 2024-01-17T23:39:29.428 INFO:tasks.workunit.client.0.smithi067.stdout:8/467: getdents d6/db/d58 0 2024-01-17T23:39:29.508 INFO:tasks.workunit.client.0.smithi067.stdout:9/374: creat d3/f85 x:0 0 0 2024-01-17T23:39:29.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/375: dread d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:39:29.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/376: chown d3/d6/d2e/f63 0 1 2024-01-17T23:39:29.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/377: stat d3/d6/d47/l49 0 2024-01-17T23:39:29.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/378: stat d3 0 2024-01-17T23:39:29.624 INFO:tasks.workunit.client.0.smithi067.stdout:3/497: symlink d0/d34/d35/d65/d6f/l95 0 2024-01-17T23:39:30.605 INFO:tasks.workunit.client.0.smithi067.stdout:0/469: mkdir d3/dbf 0 2024-01-17T23:39:31.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/402: rename d3/d59 to d3/d8/de/d20/d3b/d7c 0 2024-01-17T23:39:31.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/403: getdents d3/d8/d35 0 2024-01-17T23:39:31.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/404: write d3/d26/d34/f7b [108094,129583] 0 2024-01-17T23:39:31.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/379: creat d3/d15/f86 x:0 0 0 2024-01-17T23:39:31.377 INFO:tasks.workunit.client.0.smithi067.stdout:3/498: creat d0/d34/d35/f96 x:0 0 0 2024-01-17T23:39:31.397 INFO:tasks.workunit.client.0.smithi067.stdout:0/470: symlink d3/d5/d1a/d1c/d4e/d7c/lc0 0 2024-01-17T23:39:31.415 INFO:tasks.workunit.client.0.smithi067.stdout:4/405: symlink d3/d5/l7d 0 2024-01-17T23:39:31.986 INFO:tasks.workunit.client.0.smithi067.stdout:8/468: getdents d6/d19/d22/d25/d53/d54 0 2024-01-17T23:39:32.000 INFO:tasks.workunit.client.0.smithi067.stdout:6/439: creat d6/d9/f9c x:0 0 0 2024-01-17T23:39:32.034 INFO:tasks.workunit.client.0.smithi067.stdout:6/440: dwrite d6/d9/d3e/f3f [0,4194304] 0 2024-01-17T23:39:32.065 INFO:tasks.workunit.client.0.smithi067.stdout:6/441: dwrite d6/d18/f41 [0,4194304] 0 2024-01-17T23:39:32.065 INFO:tasks.workunit.client.0.smithi067.stdout:6/442: truncate d6/d9/d1c/d1e/d7e/f8c 792533 0 2024-01-17T23:39:32.105 INFO:tasks.workunit.client.0.smithi067.stdout:9/380: symlink d3/d6/d47/l87 0 2024-01-17T23:39:32.301 INFO:tasks.workunit.client.0.smithi067.stdout:0/471: symlink d3/d5/d1a/d1c/d1d/d2e/d5a/lc1 0 2024-01-17T23:39:32.331 INFO:tasks.workunit.client.0.smithi067.stdout:0/472: dwrite d3/d6/dd/d43/fb9 [0,4194304] 0 2024-01-17T23:39:32.332 INFO:tasks.workunit.client.0.smithi067.stdout:0/473: chown d3/l25 344313 1 2024-01-17T23:39:32.350 INFO:tasks.workunit.client.0.smithi067.stdout:1/430: sync 2024-01-17T23:39:32.350 INFO:tasks.workunit.client.0.smithi067.stdout:5/350: sync 2024-01-17T23:39:32.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/474: dwrite d3/d5/d1a/d1c/d4d/f97 [0,4194304] 0 2024-01-17T23:39:32.381 INFO:tasks.workunit.client.0.smithi067.stdout:1/431: dwrite d0/d74/d31/f86 [4194304,4194304] 0 2024-01-17T23:39:32.388 INFO:tasks.workunit.client.0.smithi067.stdout:5/351: dwrite d10/f1c [4194304,4194304] 0 2024-01-17T23:39:32.439 INFO:tasks.workunit.client.0.smithi067.stdout:4/406: creat d3/d8/de/d38/f7e x:0 0 0 2024-01-17T23:39:32.745 INFO:tasks.workunit.client.0.smithi067.stdout:8/469: link d6/d26/d3e/c8a d6/d26/d9b/ca2 0 2024-01-17T23:39:32.779 INFO:tasks.workunit.client.0.smithi067.stdout:7/431: write d4/d25/d39/f34 [295338,70476] 0 2024-01-17T23:39:32.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/470: dwrite d6/db/d58/f51 [0,4194304] 0 2024-01-17T23:39:32.835 INFO:tasks.workunit.client.0.smithi067.stdout:8/471: dwrite d6/d19/d22/d25/d53/f75 [0,4194304] 0 2024-01-17T23:39:32.836 INFO:tasks.workunit.client.0.smithi067.stdout:8/472: dread - d6/d19/d22/d25/d53/d65/f78 zero size 2024-01-17T23:39:33.295 INFO:tasks.workunit.client.0.smithi067.stdout:9/381: mkdir d3/d6/d47/d88 0 2024-01-17T23:39:33.932 INFO:tasks.workunit.client.0.smithi067.stdout:0/475: unlink d3/d6/dd/f29 0 2024-01-17T23:39:34.061 INFO:tasks.workunit.client.0.smithi067.stdout:1/432: mknod d0/d7/d13/d3a/d3e/c8b 0 2024-01-17T23:39:34.061 INFO:tasks.workunit.client.0.smithi067.stdout:1/433: stat d0/c5c 0 2024-01-17T23:39:34.251 INFO:tasks.workunit.client.0.smithi067.stdout:5/352: mknod d10/d24/d46/c73 0 2024-01-17T23:39:34.448 INFO:tasks.workunit.client.0.smithi067.stdout:4/407: read d3/d5/f3f [2338184,122075] 0 2024-01-17T23:39:34.448 INFO:tasks.workunit.client.0.smithi067.stdout:4/408: stat d3/d8/de/d20/d3b 0 2024-01-17T23:39:34.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/432: mknod d4/d25/d39/c7e 0 2024-01-17T23:39:34.947 INFO:tasks.workunit.client.0.smithi067.stdout:8/473: truncate d6/d26/d7c/f8b 1486036 0 2024-01-17T23:39:35.105 INFO:tasks.workunit.client.0.smithi067.stdout:9/382: symlink d3/d25/d28/l89 0 2024-01-17T23:39:35.465 INFO:tasks.workunit.client.0.smithi067.stdout:0/476: link d3/d6/dd/c52 d3/d6/dd/d43/db0/dbc/cc2 0 2024-01-17T23:39:35.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/434: unlink d0/d7/d1c/f22 0 2024-01-17T23:39:35.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/435: write d0/d74/f6a [4584151,30177] 0 2024-01-17T23:39:35.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/436: chown d0/d7/d13/d2e 0 1 2024-01-17T23:39:35.771 INFO:tasks.workunit.client.0.smithi067.stdout:2/429: sync 2024-01-17T23:39:35.771 INFO:tasks.workunit.client.0.smithi067.stdout:5/353: creat d10/d24/d46/d4a/f74 x:0 0 0 2024-01-17T23:39:35.771 INFO:tasks.workunit.client.0.smithi067.stdout:2/430: dread - d5/d1f/d2a/f4a zero size 2024-01-17T23:39:35.775 INFO:tasks.workunit.client.0.smithi067.stdout:4/409: creat d3/d26/d34/d3a/f7f x:0 0 0 2024-01-17T23:39:35.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/410: truncate d3/d8/de/d20/d3b/f51 153081 0 2024-01-17T23:39:35.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/411: write d3/d26/d34/d3a/f7f [172493,127067] 0 2024-01-17T23:39:35.805 INFO:tasks.workunit.client.0.smithi067.stdout:4/412: dwrite d3/d5/f2e [0,4194304] 0 2024-01-17T23:39:35.805 INFO:tasks.workunit.client.0.smithi067.stdout:4/413: write d3/d8/de/d38/f7e [223964,21204] 0 2024-01-17T23:39:35.828 INFO:tasks.workunit.client.0.smithi067.stdout:7/433: mkdir d4/d4b/d7f 0 2024-01-17T23:39:35.846 INFO:tasks.workunit.client.0.smithi067.stdout:3/499: write d0/d13/f33 [909106,115687] 0 2024-01-17T23:39:36.037 INFO:tasks.workunit.client.0.smithi067.stdout:8/474: mknod d6/d26/d3e/d6c/ca3 0 2024-01-17T23:39:36.037 INFO:tasks.workunit.client.0.smithi067.stdout:8/475: stat d6/d19/d22/d25/d53/d48/c67 0 2024-01-17T23:39:36.055 INFO:tasks.workunit.client.0.smithi067.stdout:8/476: write d6/f1a [1448977,31075] 0 2024-01-17T23:39:36.455 INFO:tasks.workunit.client.0.smithi067.stdout:9/383: symlink d3/d6/d11/d50/l8a 0 2024-01-17T23:39:36.606 INFO:tasks.workunit.client.0.smithi067.stdout:0/477: symlink d3/d5/d1a/d1c/d4e/lc3 0 2024-01-17T23:39:36.633 INFO:tasks.workunit.client.0.smithi067.stdout:0/478: dwrite d3/d6/f6d [0,4194304] 0 2024-01-17T23:39:36.896 INFO:tasks.workunit.client.0.smithi067.stdout:1/437: link d0/d74/f5f d0/d74/f8c 0 2024-01-17T23:39:36.906 INFO:tasks.workunit.client.0.smithi067.stdout:1/438: dread d0/f5 [0,4194304] 0 2024-01-17T23:39:36.960 INFO:tasks.workunit.client.0.smithi067.stdout:2/431: mkdir d5/d1f/d2a/d73/d95 0 2024-01-17T23:39:37.037 INFO:tasks.workunit.client.0.smithi067.stdout:6/443: sync 2024-01-17T23:39:37.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/354: getdents d10/d24/d59 0 2024-01-17T23:39:37.118 INFO:tasks.workunit.client.0.smithi067.stdout:5/355: dwrite d10/f11 [4194304,4194304] 0 2024-01-17T23:39:37.136 INFO:tasks.workunit.client.0.smithi067.stdout:5/356: dread d10/d24/f5f [0,4194304] 0 2024-01-17T23:39:37.144 INFO:tasks.workunit.client.0.smithi067.stdout:5/357: dread fa [0,4194304] 0 2024-01-17T23:39:37.156 INFO:tasks.workunit.client.0.smithi067.stdout:5/358: dread d10/f20 [0,4194304] 0 2024-01-17T23:39:37.156 INFO:tasks.workunit.client.0.smithi067.stdout:5/359: truncate d10/f11 9207928 0 2024-01-17T23:39:37.183 INFO:tasks.workunit.client.0.smithi067.stdout:5/360: dwrite d10/f20 [0,4194304] 0 2024-01-17T23:39:37.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/414: symlink d3/d8/de/d20/d3b/d7c/l80 0 2024-01-17T23:39:37.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/415: chown d3/d8/de/c23 128720509 1 2024-01-17T23:39:37.347 INFO:tasks.workunit.client.0.smithi067.stdout:4/416: write d3/d8/de/d20/f56 [4057634,99119] 0 2024-01-17T23:39:37.365 INFO:tasks.workunit.client.0.smithi067.stdout:4/417: dread d3/d8/de/d20/f56 [0,4194304] 0 2024-01-17T23:39:38.439 INFO:tasks.workunit.client.0.smithi067.stdout:8/477: link d6/d19/d22/d25/d53/f76 d6/d26/d9b/fa4 0 2024-01-17T23:39:39.180 INFO:tasks.workunit.client.0.smithi067.stdout:6/444: link d6/d9/d1c/d1e/d7e/f8c d6/d18/d44/f9d 0 2024-01-17T23:39:39.407 INFO:tasks.workunit.client.0.smithi067.stdout:5/361: link d10/l23 d10/d24/d46/d4a/d4b/l75 0 2024-01-17T23:39:39.601 INFO:tasks.workunit.client.0.smithi067.stdout:4/418: mknod d3/d26/d34/d3a/c81 0 2024-01-17T23:39:40.569 INFO:tasks.workunit.client.0.smithi067.stdout:6/445: mkdir d6/d9/d3e/d9e 0 2024-01-17T23:39:40.569 INFO:tasks.workunit.client.0.smithi067.stdout:6/446: creat d6/d9/d1c/d1e/d43/f9f x:0 0 0 2024-01-17T23:39:40.757 INFO:tasks.workunit.client.0.smithi067.stdout:4/419: link d3/d26/d34/d3a/c3d d3/d8/de/d38/c82 0 2024-01-17T23:39:40.757 INFO:tasks.workunit.client.0.smithi067.stdout:4/420: write d3/d26/d34/d3a/f5b [4418419,3632] 0 2024-01-17T23:39:41.150 INFO:tasks.workunit.client.0.smithi067.stdout:1/439: link d0/d62/f89 d0/d7/d13/d3d/f8d 0 2024-01-17T23:39:41.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/447: symlink d6/d9/d3e/la0 0 2024-01-17T23:39:42.074 INFO:tasks.workunit.client.0.smithi067.stdout:6/448: creat d6/d9/d1c/d1e/d43/d78/fa1 x:0 0 0 2024-01-17T23:39:42.074 INFO:tasks.workunit.client.0.smithi067.stdout:6/449: chown d6/d9/d3e/c64 1 1 2024-01-17T23:39:42.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/440: link d0/d7/d13/d3a/d3e/f5e d0/d7/d13/d3d/f8e 0 2024-01-17T23:39:42.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/441: write d0/f6f [979350,81920] 0 2024-01-17T23:39:42.201 INFO:tasks.workunit.client.0.smithi067.stdout:1/442: chown d0/d7/d1c/f54 24267 1 2024-01-17T23:39:42.621 INFO:tasks.workunit.client.0.smithi067.stdout:6/450: link d6/d9/d1c/f96 d6/d9/d30/d58/fa2 0 2024-01-17T23:39:42.637 INFO:tasks.workunit.client.0.smithi067.stdout:7/434: sync 2024-01-17T23:39:42.637 INFO:tasks.workunit.client.0.smithi067.stdout:7/435: fdatasync d4/f65 0 2024-01-17T23:39:42.653 INFO:tasks.workunit.client.0.smithi067.stdout:9/384: write d3/d6/f7f [678735,106341] 0 2024-01-17T23:39:42.663 INFO:tasks.workunit.client.0.smithi067.stdout:6/451: dwrite d6/d9/d3e/f6c [0,4194304] 0 2024-01-17T23:39:42.663 INFO:tasks.workunit.client.0.smithi067.stdout:6/452: write d6/d9/d30/f7b [690703,16845] 0 2024-01-17T23:39:43.010 INFO:tasks.workunit.client.0.smithi067.stdout:1/443: unlink d0/d7/d13/l58 0 2024-01-17T23:39:43.182 INFO:tasks.workunit.client.0.smithi067.stdout:7/436: symlink d4/d4b/d63/d75/l80 0 2024-01-17T23:39:43.268 INFO:tasks.workunit.client.0.smithi067.stdout:9/385: creat d3/d6/d2a/d34/f8b x:0 0 0 2024-01-17T23:39:43.403 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:43.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:39:43.568 INFO:tasks.workunit.client.0.smithi067.stdout:6/453: unlink d6/d18/l5f 0 2024-01-17T23:39:43.947 INFO:tasks.workunit.client.0.smithi067.stdout:7/437: unlink d4/d25/f49 0 2024-01-17T23:39:43.947 INFO:tasks.workunit.client.0.smithi067.stdout:7/438: readlink d4/d16/l21 0 2024-01-17T23:39:43.989 INFO:tasks.workunit.client.0.smithi067.stdout:7/439: dwrite d4/de/f4d [0,4194304] 0 2024-01-17T23:39:44.101 INFO:tasks.workunit.client.0.smithi067.stdout:9/386: creat d3/d6/d47/d6d/f8c x:0 0 0 2024-01-17T23:39:44.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/444: rmdir d0/d69 39 2024-01-17T23:39:44.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/440: rmdir d4/d25/d39/d46/d60 39 2024-01-17T23:39:44.684 INFO:tasks.workunit.client.0.smithi067.stdout:9/387: truncate d3/d6/d11/f1b 3584618 0 2024-01-17T23:39:44.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/388: dwrite d3/d15/f86 [0,4194304] 0 2024-01-17T23:39:44.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/389: dread - d3/d6/d2a/d34/f8b zero size 2024-01-17T23:39:44.778 INFO:tasks.workunit.client.0.smithi067.stdout:9/390: dwrite d3/d6/d11/f23 [8388608,4194304] 0 2024-01-17T23:39:44.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/391: dread d3/f13 [0,4194304] 0 2024-01-17T23:39:44.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/392: readlink d3/d6/d10/l78 0 2024-01-17T23:39:44.795 INFO:tasks.workunit.client.0.smithi067.stdout:9/393: dread d3/d6/d11/d50/f40 [0,4194304] 0 2024-01-17T23:39:44.795 INFO:tasks.workunit.client.0.smithi067.stdout:9/394: chown d3/d6/d11/d5c/f70 162889 1 2024-01-17T23:39:44.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/445: mknod d0/d7/d13/c8f 0 2024-01-17T23:39:44.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/446: write d0/d7/f55 [3124941,69273] 0 2024-01-17T23:39:44.946 INFO:tasks.workunit.client.0.smithi067.stdout:1/447: dwrite d0/d7/f4c [0,4194304] 0 2024-01-17T23:39:45.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/441: unlink d4/de/c5c 0 2024-01-17T23:39:45.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/442: chown d4/d25/d39/d46/d60/f66 966512 1 2024-01-17T23:39:45.121 INFO:tasks.workunit.client.0.smithi067.stdout:7/443: dwrite d4/de/d40/f71 [0,4194304] 0 2024-01-17T23:39:45.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/395: mknod d3/d6/d47/c8d 0 2024-01-17T23:39:45.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/396: creat d3/d6/d2a/d34/d42/f8e x:0 0 0 2024-01-17T23:39:45.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/397: dread - d3/d6/d2a/d34/f45 zero size 2024-01-17T23:39:45.502 INFO:tasks.workunit.client.0.smithi067.stdout:1/448: symlink d0/d7/d13/d77/l90 0 2024-01-17T23:39:45.502 INFO:tasks.workunit.client.0.smithi067.stdout:1/449: dread - d0/d74/f84 zero size 2024-01-17T23:39:45.502 INFO:tasks.workunit.client.0.smithi067.stdout:1/450: fdatasync d0/d7/d13/f5b 0 2024-01-17T23:39:45.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/444: mkdir d4/de/d41/d7d/d81 0 2024-01-17T23:39:45.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/445: readlink d4/d25/l4f 0 2024-01-17T23:39:45.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/446: chown d4/d25/d39/c7e 52098 1 2024-01-17T23:39:45.757 INFO:tasks.workunit.client.0.smithi067.stdout:7/447: dread d4/de/f58 [0,4194304] 0 2024-01-17T23:39:46.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/451: unlink d0/d7/d13/d3a/l87 0 2024-01-17T23:39:46.293 INFO:tasks.workunit.client.0.smithi067.stdout:7/448: mkdir d4/d4b/d7f/d82 0 2024-01-17T23:39:46.396 INFO:tasks.workunit.client.0.smithi067.stdout:9/398: link d3/d6/d11/d50/l3b d3/d6/d11/l8f 0 2024-01-17T23:39:46.674 INFO:tasks.workunit.client.0.smithi067.stdout:7/449: truncate d4/f2d 1088587 0 2024-01-17T23:39:47.027 INFO:tasks.workunit.client.0.smithi067.stdout:9/399: link d3/d6/d10/l78 d3/d6/d10/l90 0 2024-01-17T23:39:47.027 INFO:tasks.workunit.client.0.smithi067.stdout:0/479: mkdir d3/d6/dd/dc4 0 2024-01-17T23:39:47.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/480: dwrite d3/d5/d1a/d1c/d1d/f9a [0,4194304] 0 2024-01-17T23:39:47.090 INFO:tasks.workunit.client.0.smithi067.stdout:0/481: dwrite d3/d6/f76 [0,4194304] 0 2024-01-17T23:39:47.225 INFO:tasks.workunit.client.0.smithi067.stdout:2/432: rename d5/d1f/d2a/d54/d8/ff to d5/d1f/f96 0 2024-01-17T23:39:47.237 INFO:tasks.workunit.client.0.smithi067.stdout:2/433: dread d5/d1f/d2a/d54/d25/f36 [0,4194304] 0 2024-01-17T23:39:47.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/450: mknod d4/d4b/c83 0 2024-01-17T23:39:47.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/451: readlink d4/l2e 0 2024-01-17T23:39:47.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/452: dwrite d4/de/d41/f55 [0,4194304] 0 2024-01-17T23:39:47.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/453: write d4/f26 [349729,17255] 0 2024-01-17T23:39:47.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/400: unlink d3/d6/d11/d5c/f70 0 2024-01-17T23:39:47.645 INFO:tasks.workunit.client.0.smithi067.stdout:9/401: write d3/d6/d11/d5c/f6f [526714,101416] 0 2024-01-17T23:39:47.645 INFO:tasks.workunit.client.0.smithi067.stdout:9/402: creat d3/d25/d28/f91 x:0 0 0 2024-01-17T23:39:48.081 INFO:tasks.workunit.client.0.smithi067.stdout:1/452: unlink d0/d7/cb 0 2024-01-17T23:39:48.175 INFO:tasks.workunit.client.0.smithi067.stdout:0/482: getdents d3/d5/d32/d9f 0 2024-01-17T23:39:48.281 INFO:tasks.workunit.client.0.smithi067.stdout:3/500: rename d0/d12/d1b/f54 to d0/d13/d1a/f97 0 2024-01-17T23:39:48.286 INFO:tasks.workunit.client.0.smithi067.stdout:3/501: dread d0/f11 [0,4194304] 0 2024-01-17T23:39:48.451 INFO:tasks.workunit.client.0.smithi067.stdout:6/454: dwrite d6/d18/f33 [0,4194304] 0 2024-01-17T23:39:49.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/478: rename d6/db/d58/c61 to d6/d26/d3e/d87/ca5 0 2024-01-17T23:39:49.681 INFO:tasks.workunit.client.0.smithi067.stdout:8/479: write d6/d19/f4a [1640597,88500] 0 2024-01-17T23:39:49.897 INFO:tasks.workunit.client.0.smithi067.stdout:3/502: mkdir d0/d12/d98 0 2024-01-17T23:39:50.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/454: mkdir d4/de/d40/d84 0 2024-01-17T23:39:50.790 INFO:tasks.workunit.client.0.smithi067.stdout:5/362: rename d10/d24/d25/f4f to d10/d24/d59/d5d/d43/f76 0 2024-01-17T23:39:51.106 INFO:tasks.workunit.client.0.smithi067.stdout:8/480: mkdir d6/d26/d3e/da6 0 2024-01-17T23:39:51.107 INFO:tasks.workunit.client.0.smithi067.stdout:8/481: readlink d6/d19/d22/l7f 0 2024-01-17T23:39:52.074 INFO:tasks.workunit.client.0.smithi067.stdout:7/455: mknod d4/d25/d39/d46/d60/c85 0 2024-01-17T23:39:52.087 INFO:tasks.workunit.client.0.smithi067.stdout:7/456: dread d4/d16/f1e [0,4194304] 0 2024-01-17T23:39:52.088 INFO:tasks.workunit.client.0.smithi067.stdout:7/457: fsync d4/d25/f2c 0 2024-01-17T23:39:52.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/458: write d4/d16/f3f [951699,99297] 0 2024-01-17T23:39:52.387 INFO:tasks.workunit.client.0.smithi067.stdout:4/421: rename d3/d8/de/d38/c82 to d3/d8/de/d20/d3b/c83 0 2024-01-17T23:39:52.504 INFO:tasks.workunit.client.0.smithi067.stdout:5/363: mkdir d10/d24/d46/d4a/d50/d5a/d77 0 2024-01-17T23:39:52.504 INFO:tasks.workunit.client.0.smithi067.stdout:5/364: chown d10/d24/d46/f69 91674808 1 2024-01-17T23:39:52.505 INFO:tasks.workunit.client.0.smithi067.stdout:5/365: chown d10/d24/d59/d5d/d43 947215 1 2024-01-17T23:39:52.651 INFO:tasks.workunit.client.0.smithi067.stdout:8/482: truncate d6/d19/d22/f71 990861 0 2024-01-17T23:39:52.668 INFO:tasks.workunit.client.0.smithi067.stdout:8/483: dread d6/d19/d22/d25/f59 [0,4194304] 0 2024-01-17T23:39:52.668 INFO:tasks.workunit.client.0.smithi067.stdout:8/484: chown d6/d19/d22/d25/d53/d48 93708287 1 2024-01-17T23:39:52.687 INFO:tasks.workunit.client.0.smithi067.stdout:8/485: dread d6/d26/d56/f57 [4194304,4194304] 0 2024-01-17T23:39:52.992 INFO:tasks.workunit.client.0.smithi067.stdout:7/459: link d4/d4b/f7a d4/d25/d39/d46/d78/f86 0 2024-01-17T23:39:53.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/422: symlink d3/d8/de/d20/l84 0 2024-01-17T23:39:53.182 INFO:tasks.workunit.client.0.smithi067.stdout:4/423: creat d3/d4e/f85 x:0 0 0 2024-01-17T23:39:53.182 INFO:tasks.workunit.client.0.smithi067.stdout:4/424: fsync d3/d8/de/f77 0 2024-01-17T23:39:53.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/483: write d3/d5/d1a/f42 [4427509,3364] 0 2024-01-17T23:39:53.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/484: read - d3/d5/d1a/d1c/d1d/d2e/f85 zero size 2024-01-17T23:39:53.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/485: truncate d3/d6/dd/f69 846238 0 2024-01-17T23:39:53.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/486: read d3/d5/d1a/f42 [4850326,65911] 0 2024-01-17T23:39:53.200 INFO:tasks.workunit.client.0.smithi067.stdout:5/366: dread d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:39:53.208 INFO:tasks.workunit.client.0.smithi067.stdout:0/487: dread d3/d5/d1a/d1c/d4d/f97 [0,4194304] 0 2024-01-17T23:39:53.218 INFO:tasks.workunit.client.0.smithi067.stdout:0/488: dread d3/d5/d32/f78 [0,4194304] 0 2024-01-17T23:39:53.218 INFO:tasks.workunit.client.0.smithi067.stdout:0/489: chown d3/d5/d1a/d1c/d4d/f97 2676463 1 2024-01-17T23:39:53.413 INFO:tasks.workunit.client.0.smithi067.stdout:8/486: truncate d6/d19/d22/d25/d53/f17 8024357 0 2024-01-17T23:39:53.413 INFO:tasks.workunit.client.0.smithi067.stdout:8/487: chown d6/d19/f3f 9037 1 2024-01-17T23:39:53.590 INFO:tasks.workunit.client.0.smithi067.stdout:7/460: truncate d4/f6 2650730 0 2024-01-17T23:39:53.590 INFO:tasks.workunit.client.0.smithi067.stdout:7/461: write d4/f5d [932903,86384] 0 2024-01-17T23:39:53.908 INFO:tasks.workunit.client.0.smithi067.stdout:5/367: mkdir d10/d24/d59/d5d/d78 0 2024-01-17T23:39:53.908 INFO:tasks.workunit.client.0.smithi067.stdout:5/368: getdents d10/d24/d25/d5c 0 2024-01-17T23:39:53.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/369: dwrite d10/f2c [0,4194304] 0 2024-01-17T23:39:53.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/370: write d10/f3d [1772854,65999] 0 2024-01-17T23:39:54.004 INFO:tasks.workunit.client.0.smithi067.stdout:0/490: mkdir d3/d5/d32/dc5 0 2024-01-17T23:39:54.004 INFO:tasks.workunit.client.0.smithi067.stdout:0/491: readlink d3/d5/d1a/d1c/d1d/d2e/l93 0 2024-01-17T23:39:54.004 INFO:tasks.workunit.client.0.smithi067.stdout:0/492: write d3/d5/d1a/d1c/d4d/f97 [5094707,23397] 0 2024-01-17T23:39:54.381 INFO:tasks.workunit.client.0.smithi067.stdout:8/488: link d6/c30 d6/d26/d56/d89/ca7 0 2024-01-17T23:39:54.448 INFO:tasks.workunit.client.0.smithi067.stdout:9/403: truncate d3/d6/f7f 760926 0 2024-01-17T23:39:54.464 INFO:tasks.workunit.client.0.smithi067.stdout:9/404: write d3/d6/d11/d50/f43 [2673244,27413] 0 2024-01-17T23:39:54.582 INFO:tasks.workunit.client.0.smithi067.stdout:7/462: creat d4/d4b/d7f/f87 x:0 0 0 2024-01-17T23:39:54.772 INFO:tasks.workunit.client.0.smithi067.stdout:2/434: link d5/l53 d5/d1f/l97 0 2024-01-17T23:39:54.772 INFO:tasks.workunit.client.0.smithi067.stdout:2/435: write d5/d1f/d2a/d54/d25/f36 [5282446,7531] 0 2024-01-17T23:39:54.788 INFO:tasks.workunit.client.0.smithi067.stdout:2/436: dread d5/d1f/f64 [0,4194304] 0 2024-01-17T23:39:55.011 INFO:tasks.workunit.client.0.smithi067.stdout:5/371: creat d10/f79 x:0 0 0 2024-01-17T23:39:55.193 INFO:tasks.workunit.client.0.smithi067.stdout:0/493: mkdir d3/d5/d32/d7f/dc6 0 2024-01-17T23:39:55.608 INFO:tasks.workunit.client.0.smithi067.stdout:8/489: truncate d6/d19/d22/d25/d53/d65/f28 601049 0 2024-01-17T23:39:55.608 INFO:tasks.workunit.client.0.smithi067.stdout:8/490: creat d6/d19/d22/fa8 x:0 0 0 2024-01-17T23:39:55.619 INFO:tasks.workunit.client.0.smithi067.stdout:9/405: dread d3/f26 [0,4194304] 0 2024-01-17T23:39:55.619 INFO:tasks.workunit.client.0.smithi067.stdout:9/406: fsync d3/d6/d2a/d34/d42/f8e 0 2024-01-17T23:39:55.634 INFO:tasks.workunit.client.0.smithi067.stdout:9/407: write d3/d6/d2a/f3f [813153,50449] 0 2024-01-17T23:39:55.643 INFO:tasks.workunit.client.0.smithi067.stdout:8/491: dwrite d6/db/f55 [0,4194304] 0 2024-01-17T23:39:55.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/492: dread - d6/d19/d22/d25/f85 zero size 2024-01-17T23:39:55.645 INFO:tasks.workunit.client.0.smithi067.stdout:7/463: unlink d4/de/d40/l6a 0 2024-01-17T23:39:55.655 INFO:tasks.workunit.client.0.smithi067.stdout:2/437: mkdir d5/d1f/d98 0 2024-01-17T23:39:55.662 INFO:tasks.workunit.client.0.smithi067.stdout:5/372: link d10/d24/d46/c73 d10/d24/d59/c7a 0 2024-01-17T23:39:55.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/494: rmdir d3/d6/dd/d43/db2/db7 0 2024-01-17T23:39:55.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/495: fdatasync d3/d5/d1a/d1c/d4d/f97 0 2024-01-17T23:39:55.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/373: dwrite d10/d53/f62 [0,4194304] 0 2024-01-17T23:39:55.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/374: readlink d10/d53/l56 0 2024-01-17T23:39:55.714 INFO:tasks.workunit.client.0.smithi067.stdout:5/375: chown d10/c66 3556 1 2024-01-17T23:39:56.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/493: mknod d6/d26/d3e/ca9 0 2024-01-17T23:39:56.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/494: dwrite d6/f7b [0,4194304] 0 2024-01-17T23:39:56.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/495: chown d6/d19/d22/d25/d53/d65/f23 213888 1 2024-01-17T23:39:56.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/496: write d6/db/f55 [4654060,89261] 0 2024-01-17T23:39:56.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/497: chown d6/db/c6d 122389 1 2024-01-17T23:39:57.128 INFO:tasks.workunit.client.0.smithi067.stdout:2/438: link d5/f78 d5/d1f/d2a/d55/f99 0 2024-01-17T23:39:57.630 INFO:tasks.workunit.client.0.smithi067.stdout:5/376: link d10/d24/d46/d4a/f57 d10/f7b 0 2024-01-17T23:39:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/377: write d10/f6e [454267,103709] 0 2024-01-17T23:39:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/378: chown d10/d24/d46/d4a/d4b 156073200 1 2024-01-17T23:39:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/379: write fd [2405987,68215] 0 2024-01-17T23:39:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/380: chown d10/d24/d46/d4a 1888 1 2024-01-17T23:39:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/381: creat d10/d24/d46/f7c x:0 0 0 2024-01-17T23:39:58.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/455: unlink d6/l8f 0 2024-01-17T23:39:58.083 INFO:tasks.workunit.client.0.smithi067.stdout:6/456: dwrite d6/d9/d1c/f4b [0,4194304] 0 2024-01-17T23:39:58.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/457: chown d6/f88 5617 1 2024-01-17T23:39:58.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/458: write d6/d18/d2e/f77 [1611036,72750] 0 2024-01-17T23:39:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:2/439: creat d5/f9a x:0 0 0 2024-01-17T23:39:58.154 INFO:tasks.workunit.client.0.smithi067.stdout:2/440: write d5/d1f/d2a/d54/d8/d4c/f5f [3676837,40807] 0 2024-01-17T23:39:58.228 INFO:tasks.workunit.client.0.smithi067.stdout:0/496: getdents d3/d5/d1a/d1c/d4e/d6b 0 2024-01-17T23:39:58.738 INFO:tasks.workunit.client.0.smithi067.stdout:8/498: dread d6/d19/d22/d25/d53/f17 [0,4194304] 0 2024-01-17T23:39:58.972 INFO:tasks.workunit.client.0.smithi067.stdout:1/453: rename d0/d7/d13/f7e to d0/d7/d7f/f91 0 2024-01-17T23:39:59.156 INFO:tasks.workunit.client.0.smithi067.stdout:0/497: creat d3/d5/d1a/d1c/d4e/d6b/fc7 x:0 0 0 2024-01-17T23:39:59.156 INFO:tasks.workunit.client.0.smithi067.stdout:5/382: getdents d10/d53 0 2024-01-17T23:39:59.156 INFO:tasks.workunit.client.0.smithi067.stdout:0/498: write d3/d6/dd/f4a [3511573,62260] 0 2024-01-17T23:39:59.169 INFO:tasks.workunit.client.0.smithi067.stdout:5/383: dread d10/f19 [0,4194304] 0 2024-01-17T23:39:59.185 INFO:tasks.workunit.client.0.smithi067.stdout:5/384: dread d10/f2c [0,4194304] 0 2024-01-17T23:39:59.185 INFO:tasks.workunit.client.0.smithi067.stdout:5/385: read fa [646440,82522] 0 2024-01-17T23:39:59.185 INFO:tasks.workunit.client.0.smithi067.stdout:5/386: chown d10/d53/l6b 108697 1 2024-01-17T23:39:59.185 INFO:tasks.workunit.client.0.smithi067.stdout:5/387: fdatasync d10/d24/d59/d5d/d43/f70 0 2024-01-17T23:39:59.459 INFO:tasks.workunit.client.0.smithi067.stdout:8/499: symlink d6/db/d58/laa 0 2024-01-17T23:39:59.464 INFO:tasks.workunit.client.0.smithi067.stdout:8/500: dread d6/d19/f3a [0,4194304] 0 2024-01-17T23:39:59.673 INFO:tasks.workunit.client.0.smithi067.stdout:4/425: rename d3/d8/de/d20/d52/f76 to d3/d26/d34/d65/f86 0 2024-01-17T23:39:59.673 INFO:tasks.workunit.client.0.smithi067.stdout:4/426: chown d3/d8/d35/f3c 302036938 1 2024-01-17T23:39:59.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/427: fsync d3/d8/de/d20/f56 0 2024-01-17T23:39:59.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/454: creat d0/d7/d13/d2e/f92 x:0 0 0 2024-01-17T23:39:59.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/455: read d0/d7/d13/f5b [1232006,116149] 0 2024-01-17T23:39:59.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/456: chown d0/d7/d13/l6b 1 1 2024-01-17T23:39:59.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/457: dread - d0/d7/d13/d3d/f8e zero size 2024-01-17T23:40:00.145 INFO:tasks.workunit.client.0.smithi067.stdout:5/388: symlink d10/d24/d59/d5d/d43/l7d 0 2024-01-17T23:40:00.174 INFO:tasks.workunit.client.0.smithi067.stdout:5/389: dwrite d10/d24/f2d [4194304,4194304] 0 2024-01-17T23:40:00.174 INFO:tasks.workunit.client.0.smithi067.stdout:5/390: write d10/f79 [949774,55293] 0 2024-01-17T23:40:00.383 INFO:tasks.workunit.client.0.smithi067.stdout:2/441: rename d5/d1f/d2a/d54/d25/f59 to d5/d1f/d2a/d54/d8/d32/f9b 0 2024-01-17T23:40:00.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/391: mkdir d10/d24/d25/d5c/d7e 0 2024-01-17T23:40:00.859 INFO:tasks.workunit.client.0.smithi067.stdout:8/501: rename d6/db/d58/d5f/c80 to d6/d19/d22/d25/cab 0 2024-01-17T23:40:00.859 INFO:tasks.workunit.client.0.smithi067.stdout:8/502: fsync d6/d19/f4a 0 2024-01-17T23:40:01.018 INFO:tasks.workunit.client.0.smithi067.stdout:5/392: truncate d10/d24/d46/d4a/f57 708794 0 2024-01-17T23:40:01.018 INFO:tasks.workunit.client.0.smithi067.stdout:5/393: chown d10/d24/d59/d5d/l6d 40006321 1 2024-01-17T23:40:01.723 INFO:tasks.workunit.client.0.smithi067.stdout:5/394: unlink d10/c52 0 2024-01-17T23:40:01.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/503: truncate d6/d19/d22/d25/d53/d65/f28 704239 0 2024-01-17T23:40:01.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/504: write d6/db/f41 [3053369,96919] 0 2024-01-17T23:40:01.973 INFO:tasks.workunit.client.0.smithi067.stdout:8/505: dread - d6/d26/d9b/fa4 zero size 2024-01-17T23:40:02.205 INFO:tasks.workunit.client.0.smithi067.stdout:5/395: mkdir d10/d24/d25/d5c/d7e/d7f 0 2024-01-17T23:40:02.205 INFO:tasks.workunit.client.0.smithi067.stdout:5/396: write d10/f2c [3829322,130197] 0 2024-01-17T23:40:02.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/464: write d4/d25/d39/f35 [2086035,83997] 0 2024-01-17T23:40:02.229 INFO:tasks.workunit.client.0.smithi067.stdout:7/465: write d4/de/f4d [1792542,34119] 0 2024-01-17T23:40:02.544 INFO:tasks.workunit.client.0.smithi067.stdout:8/506: getdents d6/d26 0 2024-01-17T23:40:02.577 INFO:tasks.workunit.client.0.smithi067.stdout:8/507: dwrite d6/d19/d22/f72 [0,4194304] 0 2024-01-17T23:40:02.577 INFO:tasks.workunit.client.0.smithi067.stdout:8/508: write d6/f8e [457530,99700] 0 2024-01-17T23:40:02.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/509: dread d6/d19/f3a [0,4194304] 0 2024-01-17T23:40:02.655 INFO:tasks.workunit.client.0.smithi067.stdout:5/397: symlink d10/d24/d46/d4a/d4b/l80 0 2024-01-17T23:40:02.656 INFO:tasks.workunit.client.0.smithi067.stdout:7/466: mknod d4/d25/d39/d46/d60/c88 0 2024-01-17T23:40:02.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/467: dwrite d4/d16/f1e [0,4194304] 0 2024-01-17T23:40:02.732 INFO:tasks.workunit.client.0.smithi067.stdout:7/468: dwrite d4/d25/f33 [0,4194304] 0 2024-01-17T23:40:03.266 INFO:tasks.workunit.client.0.smithi067.stdout:8/510: mknod d6/d26/d3e/d87/cac 0 2024-01-17T23:40:03.266 INFO:tasks.workunit.client.0.smithi067.stdout:8/511: dread - d6/d19/d22/d25/d53/d65/f78 zero size 2024-01-17T23:40:03.267 INFO:tasks.workunit.client.0.smithi067.stdout:8/512: chown d6/d26/d3e/d87/f94 4 1 2024-01-17T23:40:03.268 INFO:tasks.workunit.client.0.smithi067.stdout:3/503: sync 2024-01-17T23:40:03.279 INFO:tasks.workunit.client.0.smithi067.stdout:3/504: dread d0/f1e [0,4194304] 0 2024-01-17T23:40:03.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/469: creat d4/d4b/d7f/d82/f89 x:0 0 0 2024-01-17T23:40:03.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/470: write d4/d4b/f61 [1627931,17162] 0 2024-01-17T23:40:03.676 INFO:tasks.workunit.client.0.smithi067.stdout:7/471: dread d4/d25/d39/d46/d60/f66 [0,4194304] 0 2024-01-17T23:40:03.769 INFO:tasks.workunit.client.0.smithi067.stdout:8/513: creat d6/d19/d22/d25/d53/d54/fad x:0 0 0 2024-01-17T23:40:03.769 INFO:tasks.workunit.client.0.smithi067.stdout:8/514: chown d6/d19/f2a 7 1 2024-01-17T23:40:04.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/459: dwrite d6/d9/d30/f7b [0,4194304] 0 2024-01-17T23:40:04.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/408: sync 2024-01-17T23:40:05.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/460: creat d6/d9/d30/d58/fa3 x:0 0 0 2024-01-17T23:40:05.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/461: write d6/d18/d2e/f77 [1836428,68117] 0 2024-01-17T23:40:05.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/462: chown d6/d18 0 1 2024-01-17T23:40:05.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/463: dread - d6/d9/f9c zero size 2024-01-17T23:40:05.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/499: dwrite d3/d5/d1a/d1c/d4e/f51 [0,4194304] 0 2024-01-17T23:40:05.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/500: chown d3/d6/dd/c52 4842135 1 2024-01-17T23:40:05.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/501: readlink d3/d5/d1a/d1c/d1d/d2e/d5a/l9c 0 2024-01-17T23:40:05.586 INFO:tasks.workunit.client.0.smithi067.stdout:9/409: link d3/d6/d11/d50/c6c d3/da/c92 0 2024-01-17T23:40:05.736 INFO:tasks.workunit.client.0.smithi067.stdout:6/464: mkdir d6/d9/d65/da4 0 2024-01-17T23:40:05.736 INFO:tasks.workunit.client.0.smithi067.stdout:6/465: fsync d6/d9/d30/f46 0 2024-01-17T23:40:05.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/466: dwrite d6/d9/d30/f4d [0,4194304] 0 2024-01-17T23:40:05.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/467: write d6/d9/d30/d58/fa2 [615303,71258] 0 2024-01-17T23:40:05.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/468: stat d6/d9/d3e/la0 0 2024-01-17T23:40:05.860 INFO:tasks.workunit.client.0.smithi067.stdout:0/502: dread d3/d6/dd/f5d [0,4194304] 0 2024-01-17T23:40:06.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/469: mkdir d6/d9/d1c/d1e/d43/d86/da5 0 2024-01-17T23:40:06.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/470: dread - d6/d9/d30/d4c/d8d/f93 zero size 2024-01-17T23:40:06.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/471: read d6/d18/f1d [805282,31293] 0 2024-01-17T23:40:06.631 INFO:tasks.workunit.client.0.smithi067.stdout:6/472: rename d6/d9/d30/d58/f6a to d6/d9/d30/d58/fa6 0 2024-01-17T23:40:06.658 INFO:tasks.workunit.client.0.smithi067.stdout:6/473: dwrite d6/f1f [0,4194304] 0 2024-01-17T23:40:06.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/474: creat d6/d9/d1c/d1e/d43/d86/da5/fa7 x:0 0 0 2024-01-17T23:40:06.861 INFO:tasks.workunit.client.0.smithi067.stdout:6/475: dwrite d6/d9/d30/f7b [0,4194304] 0 2024-01-17T23:40:06.861 INFO:tasks.workunit.client.0.smithi067.stdout:6/476: creat d6/d9/d30/d58/fa8 x:0 0 0 2024-01-17T23:40:06.864 INFO:tasks.workunit.client.0.smithi067.stdout:6/477: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:40:06.865 INFO:tasks.workunit.client.0.smithi067.stdout:6/478: write d6/d9/d65/f89 [287575,80697] 0 2024-01-17T23:40:06.865 INFO:tasks.workunit.client.0.smithi067.stdout:6/479: read - d6/d9/d30/d58/fa8 zero size 2024-01-17T23:40:07.306 INFO:tasks.workunit.client.0.smithi067.stdout:6/480: getdents d6/d9 0 2024-01-17T23:40:07.321 INFO:tasks.workunit.client.0.smithi067.stdout:6/481: read d6/d18/f41 [3507208,1762] 0 2024-01-17T23:40:07.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/482: dread d6/d9/d1c/d1e/f62 [0,4194304] 0 2024-01-17T23:40:07.984 INFO:tasks.workunit.client.0.smithi067.stdout:6/483: link d6/d9/d30/d4c/f54 d6/d9/d30/d58/fa9 0 2024-01-17T23:40:07.984 INFO:tasks.workunit.client.0.smithi067.stdout:6/484: write d6/d9/d1c/d1e/d43/f9f [752948,83014] 0 2024-01-17T23:40:08.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/505: dwrite d0/d12/d1b/d4d/f7f [0,4194304] 0 2024-01-17T23:40:08.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/428: rename d3/d8/d35/d36/f62 to d3/d8/de/f87 0 2024-01-17T23:40:08.707 INFO:tasks.workunit.client.0.smithi067.stdout:0/503: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:40:08.923 INFO:tasks.workunit.client.0.smithi067.stdout:3/506: creat d0/f99 x:0 0 0 2024-01-17T23:40:08.923 INFO:tasks.workunit.client.0.smithi067.stdout:3/507: creat d0/d12/d59/f9a x:0 0 0 2024-01-17T23:40:09.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/458: rename d0/d7/d1c/d73 to d0/d7/d93 0 2024-01-17T23:40:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/485: truncate d6/d18/d44/f9d 1144663 0 2024-01-17T23:40:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/486: write d6/d9/d1c/d1e/d43/d86/f97 [907125,31899] 0 2024-01-17T23:40:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/487: chown d6/d9/d3e/la0 48504096 1 2024-01-17T23:40:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/488: creat d6/d9/d1c/d1e/d43/d86/da5/faa x:0 0 0 2024-01-17T23:40:09.192 INFO:tasks.workunit.client.0.smithi067.stdout:4/429: read d3/d40/f70 [59493,21458] 0 2024-01-17T23:40:09.192 INFO:tasks.workunit.client.0.smithi067.stdout:4/430: read - d3/d4e/f85 zero size 2024-01-17T23:40:09.364 INFO:tasks.workunit.client.0.smithi067.stdout:0/504: link d3/d6/dd/f3b d3/d5/d32/d7f/dc6/fc8 0 2024-01-17T23:40:09.393 INFO:tasks.workunit.client.0.smithi067.stdout:0/505: dwrite d3/d5/d32/f7a [0,4194304] 0 2024-01-17T23:40:09.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/508: unlink d0/d12/d59/f76 0 2024-01-17T23:40:10.195 INFO:tasks.workunit.client.0.smithi067.stdout:4/431: creat d3/d26/f88 x:0 0 0 2024-01-17T23:40:10.195 INFO:tasks.workunit.client.0.smithi067.stdout:4/432: truncate d3/d8/de/f77 431545 0 2024-01-17T23:40:10.211 INFO:tasks.workunit.client.0.smithi067.stdout:4/433: read d3/d8/f13 [3996507,20210] 0 2024-01-17T23:40:10.211 INFO:tasks.workunit.client.0.smithi067.stdout:4/434: fdatasync d3/d5/f3f 0 2024-01-17T23:40:10.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/398: creat d10/d24/f81 x:0 0 0 2024-01-17T23:40:10.802 INFO:tasks.workunit.client.0.smithi067.stdout:8/515: creat d6/d19/d22/fae x:0 0 0 2024-01-17T23:40:10.802 INFO:tasks.workunit.client.0.smithi067.stdout:8/516: write d6/d19/d22/d25/f5d [251403,109083] 0 2024-01-17T23:40:11.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/459: mknod d0/d7/d13/d3d/d48/c94 0 2024-01-17T23:40:11.501 INFO:tasks.workunit.client.0.smithi067.stdout:4/435: creat d3/d8/de/d20/d3b/d7c/f89 x:0 0 0 2024-01-17T23:40:11.501 INFO:tasks.workunit.client.0.smithi067.stdout:4/436: chown d3/d8/de/f54 13088887 1 2024-01-17T23:40:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/437: dread d3/d26/d34/d3a/f5b [0,4194304] 0 2024-01-17T23:40:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/438: write d3/d8/de/f54 [342007,51287] 0 2024-01-17T23:40:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/439: stat d3/d8/d35/d36/c5d 0 2024-01-17T23:40:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/440: chown d3/d26/d34/d3a/d53/l7a 773818597 1 2024-01-17T23:40:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/441: readlink d3/d5/l1b 0 2024-01-17T23:40:11.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/442: dread - d3/d40/f73 zero size 2024-01-17T23:40:11.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/399: dread d10/f20 [0,4194304] 0 2024-01-17T23:40:11.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/400: write d10/d24/d59/d5d/f51 [963777,49339] 0 2024-01-17T23:40:11.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/509: symlink d0/d13/l9b 0 2024-01-17T23:40:11.889 INFO:tasks.workunit.client.0.smithi067.stdout:1/460: mkdir d0/d7/d13/d77/d95 0 2024-01-17T23:40:11.889 INFO:tasks.workunit.client.0.smithi067.stdout:1/461: dread - d0/d74/d31/f67 zero size 2024-01-17T23:40:11.889 INFO:tasks.workunit.client.0.smithi067.stdout:1/462: chown d0/d7/d13/l17 375849555 1 2024-01-17T23:40:12.106 INFO:tasks.workunit.client.0.smithi067.stdout:5/401: truncate d10/f2c 3574737 0 2024-01-17T23:40:12.223 INFO:tasks.workunit.client.0.smithi067.stdout:3/510: creat d0/d34/d35/d65/d6f/d70/f9c x:0 0 0 2024-01-17T23:40:12.484 INFO:tasks.workunit.client.0.smithi067.stdout:1/463: symlink d0/d7/d7f/d82/l96 0 2024-01-17T23:40:12.495 INFO:tasks.workunit.client.0.smithi067.stdout:1/464: write d0/f5 [3282372,33635] 0 2024-01-17T23:40:12.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/402: link d10/d24/c34 d10/d24/d46/d4a/d50/d5a/c82 0 2024-01-17T23:40:12.898 INFO:tasks.workunit.client.0.smithi067.stdout:3/511: creat d0/d34/d35/f9d x:0 0 0 2024-01-17T23:40:13.180 INFO:tasks.workunit.client.0.smithi067.stdout:1/465: symlink d0/d7/d7f/l97 0 2024-01-17T23:40:13.180 INFO:tasks.workunit.client.0.smithi067.stdout:1/466: write d0/d74/d31/f67 [887591,43730] 0 2024-01-17T23:40:13.194 INFO:tasks.workunit.client.0.smithi067.stdout:5/403: creat d10/d53/f83 x:0 0 0 2024-01-17T23:40:13.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:13.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:13.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/404: unlink d10/d24/c39 0 2024-01-17T23:40:13.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/405: dread - d10/d24/d46/d4a/f74 zero size 2024-01-17T23:40:13.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/406: read - d10/f38 zero size 2024-01-17T23:40:13.594 INFO:tasks.workunit.client.0.smithi067.stdout:1/467: dread d0/d7/d13/d3a/d3e/f88 [0,4194304] 0 2024-01-17T23:40:13.594 INFO:tasks.workunit.client.0.smithi067.stdout:1/468: chown d0/d7/c1a 16 1 2024-01-17T23:40:13.763 INFO:tasks.workunit.client.0.smithi067.stdout:7/472: sync 2024-01-17T23:40:13.763 INFO:tasks.workunit.client.0.smithi067.stdout:9/410: sync 2024-01-17T23:40:13.786 INFO:tasks.workunit.client.0.smithi067.stdout:9/411: dwrite d3/d6/d47/d6d/f8c [0,4194304] 0 2024-01-17T23:40:14.025 INFO:tasks.workunit.client.0.smithi067.stdout:5/407: fsync d10/f2c 0 2024-01-17T23:40:14.040 INFO:tasks.workunit.client.0.smithi067.stdout:4/443: write d3/d8/de/f87 [134231,36913] 0 2024-01-17T23:40:14.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/512: write d0/d12/f20 [211021,68033] 0 2024-01-17T23:40:14.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/513: fdatasync d0/d13/f8a 0 2024-01-17T23:40:14.246 INFO:tasks.workunit.client.0.smithi067.stdout:1/469: rmdir d0/d7/d13/d3a/d3e/d7c 0 2024-01-17T23:40:14.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/473: mkdir d4/d25/d39/d8a 0 2024-01-17T23:40:14.506 INFO:tasks.workunit.client.0.smithi067.stdout:9/412: mknod d3/d6/d11/d50/d84/c93 0 2024-01-17T23:40:14.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/474: fsync d4/de/f3b 0 2024-01-17T23:40:14.507 INFO:tasks.workunit.client.0.smithi067.stdout:9/413: read - d3/d6/d2a/d34/f45 zero size 2024-01-17T23:40:14.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/444: unlink d3/d5/l1b 0 2024-01-17T23:40:14.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/445: read d3/d8/f1f [4215493,8476] 0 2024-01-17T23:40:14.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/446: write d3/d4e/f63 [270072,118259] 0 2024-01-17T23:40:15.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/514: mknod d0/d13/d1a/c9e 0 2024-01-17T23:40:15.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/515: readlink d0/d37/l48 0 2024-01-17T23:40:15.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/516: dread d0/d13/d1a/f2e [0,4194304] 0 2024-01-17T23:40:15.376 INFO:tasks.workunit.client.0.smithi067.stdout:1/470: symlink d0/d74/l98 0 2024-01-17T23:40:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/475: mkdir d4/de/d40/d84/d8b 0 2024-01-17T23:40:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/476: chown d4/d4b/f7a 350 1 2024-01-17T23:40:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/477: chown d4/d25/d39/c7e 6974 1 2024-01-17T23:40:15.910 INFO:tasks.workunit.client.0.smithi067.stdout:2/442: rename d5/d1f/d2a/d54/d25 to d5/d1f/d2a/d54/d8/d32/d9c 0 2024-01-17T23:40:15.988 INFO:tasks.workunit.client.0.smithi067.stdout:4/447: mknod d3/d8/de/d20/d52/c8a 0 2024-01-17T23:40:16.445 INFO:tasks.workunit.client.0.smithi067.stdout:1/471: link d0/d7/c1a d0/d7/d13/d3a/c99 0 2024-01-17T23:40:16.810 INFO:tasks.workunit.client.0.smithi067.stdout:2/443: truncate d5/d1f/d2a/d54/f11 822607 0 2024-01-17T23:40:16.811 INFO:tasks.workunit.client.0.smithi067.stdout:2/444: write d5/d1f/d2a/f4a [322458,87403] 0 2024-01-17T23:40:17.048 INFO:tasks.workunit.client.0.smithi067.stdout:3/517: link d0/l30 d0/d12/d98/l9f 0 2024-01-17T23:40:18.169 INFO:tasks.workunit.client.0.smithi067.stdout:5/408: rename d10/f11 to d10/d24/d25/d5c/f84 0 2024-01-17T23:40:18.308 INFO:tasks.workunit.client.0.smithi067.stdout:2/445: symlink d5/d1f/d2a/d54/d8/l9d 0 2024-01-17T23:40:18.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/414: rename d3/f5e to d3/d6/d11/d50/f94 0 2024-01-17T23:40:18.643 INFO:tasks.workunit.client.0.smithi067.stdout:9/415: write d3/d6/d11/d50/f40 [1315060,16371] 0 2024-01-17T23:40:18.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/409: read d10/d24/d59/d5d/f4d [3936603,78474] 0 2024-01-17T23:40:18.698 INFO:tasks.workunit.client.0.smithi067.stdout:8/517: sync 2024-01-17T23:40:18.698 INFO:tasks.workunit.client.0.smithi067.stdout:0/506: sync 2024-01-17T23:40:18.698 INFO:tasks.workunit.client.0.smithi067.stdout:6/489: sync 2024-01-17T23:40:18.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/490: dread d6/d9/d30/d58/fa6 [0,4194304] 0 2024-01-17T23:40:18.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/491: truncate d6/d9/d30/d4c/d8d/f99 1007915 0 2024-01-17T23:40:18.805 INFO:tasks.workunit.client.0.smithi067.stdout:2/446: mknod d5/d1f/d2a/c9e 0 2024-01-17T23:40:18.805 INFO:tasks.workunit.client.0.smithi067.stdout:2/447: dread - d5/d1f/d2a/d54/d8/d4c/f51 zero size 2024-01-17T23:40:18.805 INFO:tasks.workunit.client.0.smithi067.stdout:2/448: read - d5/d1f/d2a/f7f zero size 2024-01-17T23:40:19.054 INFO:tasks.workunit.client.0.smithi067.stdout:7/478: rename d4/d4b/d63/d75 to d4/d25/d39/d79/d8c 0 2024-01-17T23:40:19.115 INFO:tasks.workunit.client.0.smithi067.stdout:9/416: symlink d3/d6/d47/d6d/l95 0 2024-01-17T23:40:19.115 INFO:tasks.workunit.client.0.smithi067.stdout:9/417: stat d3/d25 0 2024-01-17T23:40:19.479 INFO:tasks.workunit.client.0.smithi067.stdout:5/410: mkdir d10/d24/d46/d4a/d63/d85 0 2024-01-17T23:40:19.479 INFO:tasks.workunit.client.0.smithi067.stdout:6/492: mkdir d6/d9/d1c/d1e/d43/d78/dab 0 2024-01-17T23:40:19.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/411: read d10/d24/d25/f2a [737800,45427] 0 2024-01-17T23:40:19.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/448: symlink d3/d8/l8b 0 2024-01-17T23:40:19.549 INFO:tasks.workunit.client.0.smithi067.stdout:2/449: unlink d5/d1f/d2a/d54/d8/d32/d33/l5e 0 2024-01-17T23:40:20.083 INFO:tasks.workunit.client.0.smithi067.stdout:9/418: symlink d3/d58/l96 0 2024-01-17T23:40:20.083 INFO:tasks.workunit.client.0.smithi067.stdout:9/419: truncate d3/d6/d2a/d34/f8b 449017 0 2024-01-17T23:40:20.266 INFO:tasks.workunit.client.0.smithi067.stdout:6/493: creat d6/d18/d2e/d61/d9a/fac x:0 0 0 2024-01-17T23:40:20.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/412: symlink d10/d24/d59/l86 0 2024-01-17T23:40:20.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/413: write fd [7043067,93298] 0 2024-01-17T23:40:20.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/449: symlink d3/d8/de/d20/l8c 0 2024-01-17T23:40:20.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/450: read d3/d40/f70 [3858358,9737] 0 2024-01-17T23:40:20.468 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:08.685 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.475 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:08.692 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.519 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:08.830 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.519 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:08.831 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.528 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:08.839 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.529 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:08.841 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.565 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:08.782 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.641 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:08.953 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.646 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:08.957 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:20.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/518: rename d0/d13/f2f to d0/d34/d35/d57/fa0 0 2024-01-17T23:40:20.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/479: link d4/d25/d39/d46/f50 d4/de/f8d 0 2024-01-17T23:40:21.091 INFO:tasks.workunit.client.0.smithi067.stdout:1/472: mknod d0/c9a 0 2024-01-17T23:40:21.092 INFO:tasks.workunit.client.0.smithi067.stdout:1/473: dread - d0/d62/f65 zero size 2024-01-17T23:40:21.092 INFO:tasks.workunit.client.0.smithi067.stdout:1/474: read - d0/d7/d13/d2e/f92 zero size 2024-01-17T23:40:21.092 INFO:tasks.workunit.client.0.smithi067.stdout:1/475: write d0/d74/d31/f72 [954006,89424] 0 2024-01-17T23:40:21.092 INFO:tasks.workunit.client.0.smithi067.stdout:1/476: write d0/d7/d13/d3a/d3e/f5e [433186,93986] 0 2024-01-17T23:40:21.092 INFO:tasks.workunit.client.0.smithi067.stdout:1/477: write d0/d62/f65 [455155,29949] 0 2024-01-17T23:40:21.249 INFO:tasks.workunit.client.0.smithi067.stdout:5/414: dread d10/f6e [0,4194304] 0 2024-01-17T23:40:21.685 INFO:tasks.workunit.client.0.smithi067.stdout:8/518: rename d6/d19/d22/d25/d53/f76 to d6/d19/d22/d25/d53/d48/faf 0 2024-01-17T23:40:21.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/450: getdents d5/d1f/d2a 0 2024-01-17T23:40:21.685 INFO:tasks.workunit.client.0.smithi067.stdout:8/519: read d6/db/d58/f73 [2391502,22736] 0 2024-01-17T23:40:21.685 INFO:tasks.workunit.client.0.smithi067.stdout:8/520: stat d6/d19/d22/c52 0 2024-01-17T23:40:21.713 INFO:tasks.workunit.client.0.smithi067.stdout:8/521: dwrite d6/d19/d22/fa8 [0,4194304] 0 2024-01-17T23:40:21.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/519: dread d0/d17/f23 [0,4194304] 0 2024-01-17T23:40:21.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/520: dread - d0/d13/d4a/d82/f8c zero size 2024-01-17T23:40:21.844 INFO:tasks.workunit.client.0.smithi067.stdout:3/521: dwrite d0/d34/d35/d65/d6f/d70/f9c [0,4194304] 0 2024-01-17T23:40:21.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/478: creat d0/d7/d13/d3d/d48/f9b x:0 0 0 2024-01-17T23:40:21.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/479: stat d0/d7/d13/d3d/d48/f9b 0 2024-01-17T23:40:22.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/507: rename d3/d5/l1f to d3/d6/lc9 0 2024-01-17T23:40:22.261 INFO:tasks.workunit.client.0.smithi067.stdout:5/415: dread - d10/f38 zero size 2024-01-17T23:40:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/416: write d10/d24/d59/d5d/d43/f76 [1279230,24440] 0 2024-01-17T23:40:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/417: stat d10/f38 0 2024-01-17T23:40:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/418: fdatasync d10/f6e 0 2024-01-17T23:40:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/419: readlink d10/d24/d59/d5d/l6d 0 2024-01-17T23:40:22.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/420: stat d10/d24/d59/d5d/d43/c72 0 2024-01-17T23:40:22.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/451: getdents d5/d1f/d2a/d54/d8/d4c 0 2024-01-17T23:40:22.410 INFO:tasks.workunit.client.0.smithi067.stdout:4/451: creat d3/f8d x:0 0 0 2024-01-17T23:40:22.433 INFO:tasks.workunit.client.0.smithi067.stdout:2/452: write d5/d1f/d16/f20 [1016493,82938] 0 2024-01-17T23:40:22.475 INFO:tasks.workunit.client.0.smithi067.stdout:2/453: dwrite d5/d1f/d2a/f4a [0,4194304] 0 2024-01-17T23:40:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/480: unlink d0/c9a 0 2024-01-17T23:40:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/481: creat d0/d62/f9c x:0 0 0 2024-01-17T23:40:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/482: fdatasync d0/d74/f8c 0 2024-01-17T23:40:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:1/483: read - d0/d7/d13/d3a/f81 zero size 2024-01-17T23:40:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:3/522: truncate d0/d13/f33 1173397 0 2024-01-17T23:40:23.510 INFO:tasks.workunit.client.0.smithi067.stdout:3/523: dread d0/fd [0,4194304] 0 2024-01-17T23:40:23.738 INFO:tasks.workunit.client.0.smithi067.stdout:0/508: link d3/d6/f6d d3/d6/dd/d43/db0/dbc/fca 0 2024-01-17T23:40:23.966 INFO:tasks.workunit.client.0.smithi067.stdout:4/452: mkdir d3/d26/d34/d65/d8e 0 2024-01-17T23:40:23.966 INFO:tasks.workunit.client.0.smithi067.stdout:4/453: stat d3/d8/d35/f3c 0 2024-01-17T23:40:23.966 INFO:tasks.workunit.client.0.smithi067.stdout:4/454: fdatasync d3/d26/d34/d65/f68 0 2024-01-17T23:40:24.070 INFO:tasks.workunit.client.0.smithi067.stdout:2/454: mkdir d5/d1f/d98/d9f 0 2024-01-17T23:40:24.100 INFO:tasks.workunit.client.0.smithi067.stdout:2/455: dwrite d5/d1f/d2a/d55/f99 [0,4194304] 0 2024-01-17T23:40:24.587 INFO:tasks.workunit.client.0.smithi067.stdout:3/524: mknod d0/d37/ca1 0 2024-01-17T23:40:24.587 INFO:tasks.workunit.client.0.smithi067.stdout:3/525: read - d0/f80 zero size 2024-01-17T23:40:24.587 INFO:tasks.workunit.client.0.smithi067.stdout:3/526: dread - d0/d12/f8f zero size 2024-01-17T23:40:24.739 INFO:tasks.workunit.client.0.smithi067.stdout:0/509: symlink d3/d6/lcb 0 2024-01-17T23:40:25.429 INFO:tasks.workunit.client.0.smithi067.stdout:3/527: link d0/d12/d59/f9a d0/d34/d35/d65/d6f/fa2 0 2024-01-17T23:40:25.490 INFO:tasks.workunit.client.0.smithi067.stdout:0/510: creat d3/d6/dd/d43/db0/fcc x:0 0 0 2024-01-17T23:40:25.490 INFO:tasks.workunit.client.0.smithi067.stdout:0/511: write d3/d5/d1a/d1c/d4d/fb5 [696100,21632] 0 2024-01-17T23:40:25.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/455: rmdir d3/d8/de/d38 39 2024-01-17T23:40:25.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/456: creat d3/d8/de/d20/d3b/d7c/f8f x:0 0 0 2024-01-17T23:40:25.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/457: readlink d3/d8/l2b 0 2024-01-17T23:40:25.802 INFO:tasks.workunit.client.0.smithi067.stdout:9/420: sync 2024-01-17T23:40:25.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/421: write d3/d6/d2a/d34/d42/f4d [736842,66447] 0 2024-01-17T23:40:26.182 INFO:tasks.workunit.client.0.smithi067.stdout:3/528: chown d0/d13/l32 15 1 2024-01-17T23:40:26.359 INFO:tasks.workunit.client.0.smithi067.stdout:0/512: getdents d3/d64 0 2024-01-17T23:40:26.396 INFO:tasks.workunit.client.0.smithi067.stdout:0/513: dwrite d3/d5/f26 [4194304,4194304] 0 2024-01-17T23:40:26.931 INFO:tasks.workunit.client.0.smithi067.stdout:6/494: sync 2024-01-17T23:40:26.931 INFO:tasks.workunit.client.0.smithi067.stdout:6/495: stat d6/c3a 0 2024-01-17T23:40:26.949 INFO:tasks.workunit.client.0.smithi067.stdout:6/496: dread d6/d9/f27 [0,4194304] 0 2024-01-17T23:40:27.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/514: symlink d3/d5/d1a/d1c/d4d/lcd 0 2024-01-17T23:40:27.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/515: fsync d3/d6/dd/f5d 0 2024-01-17T23:40:27.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/497: mkdir d6/d18/d44/dad 0 2024-01-17T23:40:27.350 INFO:tasks.workunit.client.0.smithi067.stdout:6/498: creat d6/d9/d30/d4c/d82/fae x:0 0 0 2024-01-17T23:40:27.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/499: read d6/f3d [3610410,42785] 0 2024-01-17T23:40:27.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/500: chown d6/f1f 254492 1 2024-01-17T23:40:27.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/501: chown d6/d18/d44/dad 80 1 2024-01-17T23:40:27.590 INFO:tasks.workunit.client.0.smithi067.stdout:7/480: write d4/de/d40/f42 [819724,65673] 0 2024-01-17T23:40:27.628 INFO:tasks.workunit.client.0.smithi067.stdout:8/522: rename d6/d19/f2a to d6/d19/d22/d25/d53/d48/fb0 0 2024-01-17T23:40:27.628 INFO:tasks.workunit.client.0.smithi067.stdout:8/523: fdatasync d6/d19/d22/d25/f7d 0 2024-01-17T23:40:28.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/524: rmdir d6/d19 39 2024-01-17T23:40:28.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/525: truncate d6/d19/d22/d25/d53/d54/fad 897742 0 2024-01-17T23:40:28.841 INFO:tasks.workunit.client.0.smithi067.stdout:1/484: rmdir d0 39 2024-01-17T23:40:28.855 INFO:tasks.workunit.client.0.smithi067.stdout:1/485: dread d0/d74/f6a [0,4194304] 0 2024-01-17T23:40:28.855 INFO:tasks.workunit.client.0.smithi067.stdout:1/486: readlink d0/l1f 0 2024-01-17T23:40:29.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/421: rename d10/f3d to d10/d24/d25/d5c/d7e/f87 0 2024-01-17T23:40:29.481 INFO:tasks.workunit.client.0.smithi067.stdout:6/502: creat d6/d9/d1c/faf x:0 0 0 2024-01-17T23:40:29.694 INFO:tasks.workunit.client.0.smithi067.stdout:8/526: unlink d6/d19/d22/d25/d53/d48/faf 0 2024-01-17T23:40:29.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/527: write d6/d19/d22/d25/d53/f75 [4459281,64419] 0 2024-01-17T23:40:29.800 INFO:tasks.workunit.client.0.smithi067.stdout:1/487: symlink d0/d7/d1c/l9d 0 2024-01-17T23:40:29.915 INFO:tasks.workunit.client.0.smithi067.stdout:2/456: rename d5/d1f/d35/f63 to d5/d1f/d16/d61/fa0 0 2024-01-17T23:40:29.938 INFO:tasks.workunit.client.0.smithi067.stdout:2/457: read d5/d1f/d2a/d54/d8/d32/f9b [1146976,127153] 0 2024-01-17T23:40:29.996 INFO:tasks.workunit.client.0.smithi067.stdout:5/422: creat d10/f88 x:0 0 0 2024-01-17T23:40:29.996 INFO:tasks.workunit.client.0.smithi067.stdout:5/423: chown d10/d24/f2d 3 1 2024-01-17T23:40:30.247 INFO:tasks.workunit.client.0.smithi067.stdout:6/503: symlink d6/d9/d3e/d9e/lb0 0 2024-01-17T23:40:30.612 INFO:tasks.workunit.client.0.smithi067.stdout:8/528: creat d6/fb1 x:0 0 0 2024-01-17T23:40:30.612 INFO:tasks.workunit.client.0.smithi067.stdout:0/516: rename d3/d6/f56 to d3/d6/dd/fce 0 2024-01-17T23:40:30.613 INFO:tasks.workunit.client.0.smithi067.stdout:0/517: chown d3/d5/d1a/d1c/d4d/faa 6 1 2024-01-17T23:40:30.713 INFO:tasks.workunit.client.0.smithi067.stdout:2/458: creat d5/d1f/d35/fa1 x:0 0 0 2024-01-17T23:40:30.713 INFO:tasks.workunit.client.0.smithi067.stdout:2/459: readlink d5/d1f/d2a/d54/d8/d32/d9c/l46 0 2024-01-17T23:40:30.713 INFO:tasks.workunit.client.0.smithi067.stdout:2/460: write d5/d1f/d2a/d54/d8/f3e [2326051,90129] 0 2024-01-17T23:40:31.136 INFO:tasks.workunit.client.0.smithi067.stdout:6/504: mknod d6/d18/d44/dad/cb1 0 2024-01-17T23:40:31.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/529: link d6/d26/d56/f57 d6/d26/d3e/fb2 0 2024-01-17T23:40:31.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/530: read - d6/d19/d22/d25/f85 zero size 2024-01-17T23:40:31.461 INFO:tasks.workunit.client.0.smithi067.stdout:7/481: rename d4/d25/d39/f34 to d4/de/d41/d7d/f8e 0 2024-01-17T23:40:31.466 INFO:tasks.workunit.client.0.smithi067.stdout:7/482: dread d4/f5d [0,4194304] 0 2024-01-17T23:40:31.512 INFO:tasks.workunit.client.0.smithi067.stdout:0/518: creat d3/d6/fcf x:0 0 0 2024-01-17T23:40:32.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/488: rename d0/d7/d7f/d82/c3c to d0/c9e 0 2024-01-17T23:40:32.944 INFO:tasks.workunit.client.0.smithi067.stdout:2/461: rmdir d5/d1f/d2a 39 2024-01-17T23:40:32.948 INFO:tasks.workunit.client.0.smithi067.stdout:1/489: dread d0/d7/d13/d3a/d45/f5a [0,4194304] 0 2024-01-17T23:40:32.948 INFO:tasks.workunit.client.0.smithi067.stdout:1/490: write d0/d62/f64 [391379,35593] 0 2024-01-17T23:40:32.949 INFO:tasks.workunit.client.0.smithi067.stdout:1/491: chown d0/d7/d1c/f54 203989837 1 2024-01-17T23:40:32.949 INFO:tasks.workunit.client.0.smithi067.stdout:1/492: dread - d0/d69/f71 zero size 2024-01-17T23:40:32.949 INFO:tasks.workunit.client.0.smithi067.stdout:1/493: write d0/f5 [2854650,80509] 0 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:7/483: rename d4/d25/l62 to d4/d25/d39/d46/d60/l8f 0 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:7/484: fdatasync d4/de/f58 0 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:1/494: rmdir d0/d7/d13/d3d 39 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:1/495: chown d0/d62/f65 0 1 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:1/496: chown d0/d7/d13/d3a/f51 50994 1 2024-01-17T23:40:33.249 INFO:tasks.workunit.client.0.smithi067.stdout:1/497: fdatasync d0/d74/f84 0 2024-01-17T23:40:33.545 INFO:tasks.workunit.client.0.smithi067.stdout:4/458: rmdir d3/d40 39 2024-01-17T23:40:33.546 INFO:tasks.workunit.client.0.smithi067.stdout:3/529: sync 2024-01-17T23:40:33.547 INFO:tasks.workunit.client.0.smithi067.stdout:9/422: sync 2024-01-17T23:40:33.547 INFO:tasks.workunit.client.0.smithi067.stdout:5/424: sync 2024-01-17T23:40:33.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/530: chown d0/d12/d1b 6559900 1 2024-01-17T23:40:33.567 INFO:tasks.workunit.client.0.smithi067.stdout:6/505: write d6/d9/f31 [35399,75182] 0 2024-01-17T23:40:33.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/531: dwrite d0/d34/d35/d65/d6f/d70/f9c [0,4194304] 0 2024-01-17T23:40:33.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/532: readlink d0/d37/l48 0 2024-01-17T23:40:33.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/533: creat d0/d12/d59/fa3 x:0 0 0 2024-01-17T23:40:33.845 INFO:tasks.workunit.client.0.smithi067.stdout:1/498: link d0/d7/d13/d3a/d45/l53 d0/d7/d7f/d82/l9f 0 2024-01-17T23:40:34.154 INFO:tasks.workunit.client.0.smithi067.stdout:4/459: mknod d3/d8/de/c90 0 2024-01-17T23:40:34.187 INFO:tasks.workunit.client.0.smithi067.stdout:5/425: dwrite d10/f7b [0,4194304] 0 2024-01-17T23:40:34.187 INFO:tasks.workunit.client.0.smithi067.stdout:4/460: write d3/d26/d34/d3a/f4b [1152804,10347] 0 2024-01-17T23:40:34.225 INFO:tasks.workunit.client.0.smithi067.stdout:6/506: creat d6/d9/d3e/d9e/fb2 x:0 0 0 2024-01-17T23:40:34.584 INFO:tasks.workunit.client.0.smithi067.stdout:1/499: getdents d0/d7/d7f/d82/d35 0 2024-01-17T23:40:34.664 INFO:tasks.workunit.client.0.smithi067.stdout:8/531: symlink d6/d19/lb3 0 2024-01-17T23:40:34.664 INFO:tasks.workunit.client.0.smithi067.stdout:8/532: getdents d6/d26 0 2024-01-17T23:40:34.759 INFO:tasks.workunit.client.0.smithi067.stdout:5/426: rmdir d10/d24/d46/d4a/d4b 39 2024-01-17T23:40:34.913 INFO:tasks.workunit.client.0.smithi067.stdout:4/461: creat d3/d8/de/d20/f91 x:0 0 0 2024-01-17T23:40:35.025 INFO:tasks.workunit.client.0.smithi067.stdout:9/423: symlink d3/d6/d11/l97 0 2024-01-17T23:40:35.329 INFO:tasks.workunit.client.0.smithi067.stdout:6/507: symlink d6/d9/d30/d4c/d8d/lb3 0 2024-01-17T23:40:35.334 INFO:tasks.workunit.client.0.smithi067.stdout:3/534: symlink d0/d13/la4 0 2024-01-17T23:40:35.334 INFO:tasks.workunit.client.0.smithi067.stdout:3/535: chown d0/d17/f29 1404263 1 2024-01-17T23:40:35.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/536: dread - d0/d17/d69/d6e/f84 zero size 2024-01-17T23:40:35.347 INFO:tasks.workunit.client.0.smithi067.stdout:3/537: write d0/d13/d1a/f2e [4108757,108208] 0 2024-01-17T23:40:35.614 INFO:tasks.workunit.client.0.smithi067.stdout:0/519: rename d3/d6/dd/d43/db0 to d3/d5/d1a/d1c/d4e/d7c/dd0 0 2024-01-17T23:40:35.614 INFO:tasks.workunit.client.0.smithi067.stdout:0/520: stat d3/d5/d1a/d1c/d4e/d7c 0 2024-01-17T23:40:35.796 INFO:tasks.workunit.client.0.smithi067.stdout:1/500: creat d0/d7/d7f/d82/d35/fa0 x:0 0 0 2024-01-17T23:40:35.979 INFO:tasks.workunit.client.0.smithi067.stdout:5/427: truncate d10/d53/f83 415638 0 2024-01-17T23:40:35.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/533: truncate d6/d19/d22/d25/d53/f2d 417189 0 2024-01-17T23:40:36.000 INFO:tasks.workunit.client.0.smithi067.stdout:8/534: write d6/d19/d22/d25/d53/f75 [72300,85326] 0 2024-01-17T23:40:36.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/462: mkdir d3/d8/de/d20/d3b/d7c/d92 0 2024-01-17T23:40:36.104 INFO:tasks.workunit.client.0.smithi067.stdout:4/463: chown d3/d8/de/d38/c6f 166283732 1 2024-01-17T23:40:36.281 INFO:tasks.workunit.client.0.smithi067.stdout:6/508: link d6/d9/d1c/c5b d6/d18/d44/d51/cb4 0 2024-01-17T23:40:36.281 INFO:tasks.workunit.client.0.smithi067.stdout:6/509: chown d6/d9/d30/d58/fa6 3 1 2024-01-17T23:40:36.442 INFO:tasks.workunit.client.0.smithi067.stdout:3/538: symlink d0/d12/d59/la5 0 2024-01-17T23:40:36.442 INFO:tasks.workunit.client.0.smithi067.stdout:3/539: readlink d0/lf 0 2024-01-17T23:40:36.442 INFO:tasks.workunit.client.0.smithi067.stdout:3/540: readlink d0/d17/d69/d6e/l88 0 2024-01-17T23:40:37.022 INFO:tasks.workunit.client.0.smithi067.stdout:2/462: rename d5/d1f/d35/fa1 to d5/d1f/d16/d7d/fa2 0 2024-01-17T23:40:37.022 INFO:tasks.workunit.client.0.smithi067.stdout:2/463: truncate d5/d1f/d2a/d54/d8/d4c/d84/f8c 5109443 0 2024-01-17T23:40:37.022 INFO:tasks.workunit.client.0.smithi067.stdout:2/464: chown d5/f78 7587 1 2024-01-17T23:40:37.049 INFO:tasks.workunit.client.0.smithi067.stdout:2/465: dwrite d5/d1f/d16/d7d/fa2 [0,4194304] 0 2024-01-17T23:40:37.497 INFO:tasks.workunit.client.0.smithi067.stdout:0/521: rmdir d3/d6/dd/d43 39 2024-01-17T23:40:37.498 INFO:tasks.workunit.client.0.smithi067.stdout:1/501: mkdir d0/d7/d13/d3a/d75/da1 0 2024-01-17T23:40:37.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/428: creat d10/d24/d46/d4a/d50/f89 x:0 0 0 2024-01-17T23:40:37.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/485: sync 2024-01-17T23:40:37.927 INFO:tasks.workunit.client.0.smithi067.stdout:8/535: mkdir d6/d19/db4 0 2024-01-17T23:40:37.927 INFO:tasks.workunit.client.0.smithi067.stdout:8/536: write d6/d19/d22/d25/d53/f7e [972170,117762] 0 2024-01-17T23:40:37.927 INFO:tasks.workunit.client.0.smithi067.stdout:8/537: fdatasync d6/db/f84 0 2024-01-17T23:40:37.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/538: write d6/d19/d22/d25/f7d [824575,21735] 0 2024-01-17T23:40:37.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/539: creat d6/d26/d3e/d8d/fb5 x:0 0 0 2024-01-17T23:40:38.259 INFO:tasks.workunit.client.0.smithi067.stdout:3/541: mkdir d0/d13/d4a/d82/da6 0 2024-01-17T23:40:38.373 INFO:tasks.workunit.client.0.smithi067.stdout:9/424: rename d3/d6/d10/l78 to d3/d25/d28/l98 0 2024-01-17T23:40:38.373 INFO:tasks.workunit.client.0.smithi067.stdout:9/425: stat d3/d6/f9 0 2024-01-17T23:40:38.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/466: rmdir d5/d1f/d2a/d73 39 2024-01-17T23:40:38.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/467: stat d5/d1f/d2a/d54/lc 0 2024-01-17T23:40:38.824 INFO:tasks.workunit.client.0.smithi067.stdout:0/522: creat d3/d6/dd/fd1 x:0 0 0 2024-01-17T23:40:39.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/502: creat d0/d7/d13/d3a/d75/da1/fa2 x:0 0 0 2024-01-17T23:40:39.068 INFO:tasks.workunit.client.0.smithi067.stdout:5/429: mknod d10/d24/d46/c8a 0 2024-01-17T23:40:40.483 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:28.700 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.486 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:28.703 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.510 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:41:28.727 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.625 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:28.936 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.627 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:28.938 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.633 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:28.944 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.634 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:28.945 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.658 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:41:28.969 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.669 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:41:28.980 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:40:40.733 INFO:tasks.workunit.client.0.smithi067.stdout:4/464: getdents d3/d26/d34/d65 0 2024-01-17T23:40:40.919 INFO:tasks.workunit.client.0.smithi067.stdout:9/426: creat d3/d6/d2e/f99 x:0 0 0 2024-01-17T23:40:40.967 INFO:tasks.workunit.client.0.smithi067.stdout:2/468: symlink d5/d1f/d35/la3 0 2024-01-17T23:40:40.974 INFO:tasks.workunit.client.0.smithi067.stdout:2/469: read d5/d1f/d2a/f52 [1908920,98801] 0 2024-01-17T23:40:40.974 INFO:tasks.workunit.client.0.smithi067.stdout:2/470: fdatasync d5/d1f/f1e 0 2024-01-17T23:40:41.006 INFO:tasks.workunit.client.0.smithi067.stdout:0/523: dread d3/d5/d1a/f71 [0,4194304] 0 2024-01-17T23:40:41.208 INFO:tasks.workunit.client.0.smithi067.stdout:4/465: dread d3/d8/de/f54 [0,4194304] 0 2024-01-17T23:40:41.448 INFO:tasks.workunit.client.0.smithi067.stdout:2/471: mknod d5/d1f/d2a/d54/d8/ca4 0 2024-01-17T23:40:41.811 INFO:tasks.workunit.client.0.smithi067.stdout:4/466: mkdir d3/d5/d93 0 2024-01-17T23:40:41.960 INFO:tasks.workunit.client.0.smithi067.stdout:2/472: mkdir d5/d1f/d2a/d54/d8/d4c/d84/da5 0 2024-01-17T23:40:41.960 INFO:tasks.workunit.client.0.smithi067.stdout:2/473: readlink d5/d1f/l93 0 2024-01-17T23:40:42.351 INFO:tasks.workunit.client.0.smithi067.stdout:4/467: creat d3/d8/de/d20/d52/f94 x:0 0 0 2024-01-17T23:40:42.351 INFO:tasks.workunit.client.0.smithi067.stdout:4/468: creat d3/d8/de/d20/d52/f95 x:0 0 0 2024-01-17T23:40:42.531 INFO:tasks.workunit.client.0.smithi067.stdout:2/474: link d5/d1f/d2a/d54/d8/d32/d9c/l7a d5/d1f/d98/d9f/la6 0 2024-01-17T23:40:42.671 INFO:tasks.workunit.client.0.smithi067.stdout:6/510: unlink d6/c3a 0 2024-01-17T23:40:42.671 INFO:tasks.workunit.client.0.smithi067.stdout:6/511: dread - d6/d9/d30/d4c/f54 zero size 2024-01-17T23:40:42.862 INFO:tasks.workunit.client.0.smithi067.stdout:4/469: creat d3/d5/d93/f96 x:0 0 0 2024-01-17T23:40:42.862 INFO:tasks.workunit.client.0.smithi067.stdout:4/470: fdatasync d3/d26/d34/d3a/f47 0 2024-01-17T23:40:42.863 INFO:tasks.workunit.client.0.smithi067.stdout:4/471: dread - d3/d8/de/d20/d52/f94 zero size 2024-01-17T23:40:43.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/475: mknod d5/d1f/d16/ca7 0 2024-01-17T23:40:43.215 INFO:tasks.workunit.client.0.smithi067.stdout:6/512: link d6/d9/d30/f70 d6/d18/d44/fb5 0 2024-01-17T23:40:43.215 INFO:tasks.workunit.client.0.smithi067.stdout:6/513: read - d6/d9/d3e/f92 zero size 2024-01-17T23:40:43.215 INFO:tasks.workunit.client.0.smithi067.stdout:6/514: creat d6/d18/d44/fb6 x:0 0 0 2024-01-17T23:40:43.301 INFO:tasks.workunit.client.0.smithi067.stdout:8/540: dwrite d6/d26/d3e/fb2 [4194304,4194304] 0 2024-01-17T23:40:43.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:43.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:40:43.658 INFO:tasks.workunit.client.0.smithi067.stdout:6/515: unlink d6/d18/d2e/f76 0 2024-01-17T23:40:43.658 INFO:tasks.workunit.client.0.smithi067.stdout:6/516: creat d6/d9/d1c/d1e/d43/d78/fb7 x:0 0 0 2024-01-17T23:40:43.802 INFO:tasks.workunit.client.0.smithi067.stdout:8/541: dread d6/d19/d22/d25/d53/f75 [0,4194304] 0 2024-01-17T23:40:44.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/517: creat d6/d9/d65/da4/fb8 x:0 0 0 2024-01-17T23:40:44.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/518: write d6/d18/f1d [1274036,2269] 0 2024-01-17T23:40:44.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/542: mkdir d6/d19/d22/d25/d53/d65/db6 0 2024-01-17T23:40:44.485 INFO:tasks.workunit.client.0.smithi067.stdout:3/542: write d0/d12/d1b/d4d/f71 [129482,119707] 0 2024-01-17T23:40:44.767 INFO:tasks.workunit.client.0.smithi067.stdout:8/543: dread d6/d19/d22/d25/d53/d54/fad [0,4194304] 0 2024-01-17T23:40:44.775 INFO:tasks.workunit.client.0.smithi067.stdout:0/524: write d3/d6/dd/fce [513752,32980] 0 2024-01-17T23:40:44.780 INFO:tasks.workunit.client.0.smithi067.stdout:5/430: dwrite d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:40:44.780 INFO:tasks.workunit.client.0.smithi067.stdout:5/431: write d10/d24/d46/f5b [839190,57889] 0 2024-01-17T23:40:44.788 INFO:tasks.workunit.client.0.smithi067.stdout:1/503: dwrite d0/d7/f29 [0,4194304] 0 2024-01-17T23:40:44.788 INFO:tasks.workunit.client.0.smithi067.stdout:1/504: write d0/d7/d13/f5b [3970565,116530] 0 2024-01-17T23:40:44.796 INFO:tasks.workunit.client.0.smithi067.stdout:9/427: dwrite d3/f26 [0,4194304] 0 2024-01-17T23:40:44.796 INFO:tasks.workunit.client.0.smithi067.stdout:0/525: dread d3/d6/dd/d43/fb9 [0,4194304] 0 2024-01-17T23:40:44.796 INFO:tasks.workunit.client.0.smithi067.stdout:0/526: chown d3/d5/d1a/d1c/d4e/fb6 28014412 1 2024-01-17T23:40:44.818 INFO:tasks.workunit.client.0.smithi067.stdout:1/505: dwrite d0/d7/d13/d3a/f59 [4194304,4194304] 0 2024-01-17T23:40:45.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/544: creat d6/db/d58/d5f/fb7 x:0 0 0 2024-01-17T23:40:45.033 INFO:tasks.workunit.client.0.smithi067.stdout:7/486: sync 2024-01-17T23:40:45.567 INFO:tasks.workunit.client.0.smithi067.stdout:5/432: creat d10/d24/d46/d4a/d63/f8b x:0 0 0 2024-01-17T23:40:45.801 INFO:tasks.workunit.client.0.smithi067.stdout:4/472: sync 2024-01-17T23:40:45.805 INFO:tasks.workunit.client.0.smithi067.stdout:4/473: dread d3/d26/d34/f7b [0,4194304] 0 2024-01-17T23:40:46.050 INFO:tasks.workunit.client.0.smithi067.stdout:9/428: creat d3/d25/f9a x:0 0 0 2024-01-17T23:40:46.078 INFO:tasks.workunit.client.0.smithi067.stdout:9/429: dwrite d3/d6/d11/d5c/f6f [0,4194304] 0 2024-01-17T23:40:46.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/545: mknod d6/d26/d3e/d87/cb8 0 2024-01-17T23:40:46.365 INFO:tasks.workunit.client.0.smithi067.stdout:5/433: mkdir d10/d24/d59/d8c 0 2024-01-17T23:40:46.365 INFO:tasks.workunit.client.0.smithi067.stdout:4/474: truncate d3/d8/de/d20/d3b/f51 820879 0 2024-01-17T23:40:46.365 INFO:tasks.workunit.client.0.smithi067.stdout:4/475: chown d3/d26/l30 3 1 2024-01-17T23:40:46.562 INFO:tasks.workunit.client.0.smithi067.stdout:2/476: dwrite d5/d1f/d2a/f52 [0,4194304] 0 2024-01-17T23:40:46.656 INFO:tasks.workunit.client.0.smithi067.stdout:9/430: creat d3/d6/d2e/f9b x:0 0 0 2024-01-17T23:40:46.839 INFO:tasks.workunit.client.0.smithi067.stdout:0/527: link d3/d6/l10 d3/d5/d1a/d90/ld2 0 2024-01-17T23:40:46.840 INFO:tasks.workunit.client.0.smithi067.stdout:0/528: creat d3/d5/d32/fd3 x:0 0 0 2024-01-17T23:40:47.045 INFO:tasks.workunit.client.0.smithi067.stdout:8/546: rename d6/db/f63 to d6/db/d58/fb9 0 2024-01-17T23:40:47.086 INFO:tasks.workunit.client.0.smithi067.stdout:5/434: getdents d10/d24/d25/d5c/d7e 0 2024-01-17T23:40:47.097 INFO:tasks.workunit.client.0.smithi067.stdout:5/435: dread d10/d24/d59/f67 [0,4194304] 0 2024-01-17T23:40:47.127 INFO:tasks.workunit.client.0.smithi067.stdout:5/436: dwrite f9 [0,4194304] 0 2024-01-17T23:40:47.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/476: symlink d3/d26/d34/d3a/d53/l97 0 2024-01-17T23:40:47.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/477: creat d3/d5/f98 x:0 0 0 2024-01-17T23:40:47.205 INFO:tasks.workunit.client.0.smithi067.stdout:4/478: chown d3/d4e/f85 8 1 2024-01-17T23:40:47.673 INFO:tasks.workunit.client.0.smithi067.stdout:6/519: sync 2024-01-17T23:40:47.673 INFO:tasks.workunit.client.0.smithi067.stdout:6/520: chown d6/d18/d44/f48 11 1 2024-01-17T23:40:47.673 INFO:tasks.workunit.client.0.smithi067.stdout:6/521: chown d6/cc 31398 1 2024-01-17T23:40:47.673 INFO:tasks.workunit.client.0.smithi067.stdout:6/522: fsync d6/d9/d30/f4d 0 2024-01-17T23:40:47.691 INFO:tasks.workunit.client.0.smithi067.stdout:6/523: read d6/d18/d2e/f40 [2108653,105490] 0 2024-01-17T23:40:47.717 INFO:tasks.workunit.client.0.smithi067.stdout:6/524: dwrite d6/d9/d30/f5a [4194304,4194304] 0 2024-01-17T23:40:47.746 INFO:tasks.workunit.client.0.smithi067.stdout:6/525: dwrite d6/d9/d1c/f2f [0,4194304] 0 2024-01-17T23:40:47.867 INFO:tasks.workunit.client.0.smithi067.stdout:9/431: dread d3/d6/d10/f66 [0,4194304] 0 2024-01-17T23:40:48.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/529: truncate d3/d5/d1a/d1c/d1d/d2e/f89 100558 0 2024-01-17T23:40:48.032 INFO:tasks.workunit.client.0.smithi067.stdout:0/530: chown d3/d5/d1a/d1c/d4d/l99 28 1 2024-01-17T23:40:48.391 INFO:tasks.workunit.client.0.smithi067.stdout:5/437: symlink d10/d24/d46/d4a/d50/d5a/l8d 0 2024-01-17T23:40:48.412 INFO:tasks.workunit.client.0.smithi067.stdout:5/438: dwrite d10/d24/d25/f2b [0,4194304] 0 2024-01-17T23:40:48.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/526: symlink d6/d9/d1c/d1e/d7e/lb9 0 2024-01-17T23:40:48.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/527: readlink d6/d9/d30/d4c/l80 0 2024-01-17T23:40:49.087 INFO:tasks.workunit.client.0.smithi067.stdout:9/432: truncate d3/d6/d2e/f63 722005 0 2024-01-17T23:40:49.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/531: mkdir d3/d5/d1a/d1c/dd4 0 2024-01-17T23:40:49.412 INFO:tasks.workunit.client.0.smithi067.stdout:3/543: sync 2024-01-17T23:40:49.412 INFO:tasks.workunit.client.0.smithi067.stdout:3/544: creat d0/d13/d4a/d82/fa7 x:0 0 0 2024-01-17T23:40:49.443 INFO:tasks.workunit.client.0.smithi067.stdout:3/545: dwrite d0/d13/d4a/d82/fa7 [0,4194304] 0 2024-01-17T23:40:49.443 INFO:tasks.workunit.client.0.smithi067.stdout:3/546: chown d0/d13/d1a/d38/c43 35 1 2024-01-17T23:40:49.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/477: creat d5/d1f/d2a/d73/d95/fa8 x:0 0 0 2024-01-17T23:40:49.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/478: truncate d5/d1f/d2a/d54/d8/d4c/f51 748657 0 2024-01-17T23:40:49.739 INFO:tasks.workunit.client.0.smithi067.stdout:1/506: dwrite d0/f6f [0,4194304] 0 2024-01-17T23:40:49.834 INFO:tasks.workunit.client.0.smithi067.stdout:6/528: mknod d6/d18/d44/d51/cba 0 2024-01-17T23:40:49.834 INFO:tasks.workunit.client.0.smithi067.stdout:6/529: creat d6/d18/d44/d51/fbb x:0 0 0 2024-01-17T23:40:49.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/530: dread d6/f3d [4194304,4194304] 0 2024-01-17T23:40:49.884 INFO:tasks.workunit.client.0.smithi067.stdout:7/487: sync 2024-01-17T23:40:49.915 INFO:tasks.workunit.client.0.smithi067.stdout:7/488: dwrite d4/d16/f1e [4194304,4194304] 0 2024-01-17T23:40:49.915 INFO:tasks.workunit.client.0.smithi067.stdout:7/489: chown d4/de/d41/l52 3198 1 2024-01-17T23:40:49.915 INFO:tasks.workunit.client.0.smithi067.stdout:7/490: write d4/d16/f29 [1163920,113144] 0 2024-01-17T23:40:50.011 INFO:tasks.workunit.client.0.smithi067.stdout:9/433: mkdir d3/d6/d2a/d34/d42/d9c 0 2024-01-17T23:40:50.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/532: fsync d3/d5/d1a/d1c/d4e/d6b/f8f 0 2024-01-17T23:40:50.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/533: readlink d3/d5/d1a/d1c/d1d/d2e/l67 0 2024-01-17T23:40:50.297 INFO:tasks.workunit.client.0.smithi067.stdout:3/547: link d0/d17/d69/d6e/f89 d0/d17/fa8 0 2024-01-17T23:40:50.298 INFO:tasks.workunit.client.0.smithi067.stdout:3/548: read - d0/f7c zero size 2024-01-17T23:40:50.298 INFO:tasks.workunit.client.0.smithi067.stdout:3/549: write d0/f99 [326791,50596] 0 2024-01-17T23:40:50.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/550: dwrite d0/d13/d1a/f2e [0,4194304] 0 2024-01-17T23:40:50.443 INFO:tasks.workunit.client.0.smithi067.stdout:5/439: getdents d10/d24/d59/d5d/d43 0 2024-01-17T23:40:50.443 INFO:tasks.workunit.client.0.smithi067.stdout:5/440: fdatasync d10/d24/d59/f67 0 2024-01-17T23:40:50.463 INFO:tasks.workunit.client.0.smithi067.stdout:2/479: mkdir d5/d1f/d2a/d54/d8/d4c/d84/da9 0 2024-01-17T23:40:50.467 INFO:tasks.workunit.client.0.smithi067.stdout:5/441: write d10/d24/d25/f2b [3921160,91408] 0 2024-01-17T23:40:50.709 INFO:tasks.workunit.client.0.smithi067.stdout:1/507: unlink d0/d62/l63 0 2024-01-17T23:40:51.140 INFO:tasks.workunit.client.0.smithi067.stdout:6/531: creat d6/d9/d84/fbc x:0 0 0 2024-01-17T23:40:51.270 INFO:tasks.workunit.client.0.smithi067.stdout:7/491: creat d4/d25/f90 x:0 0 0 2024-01-17T23:40:51.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/492: chown d4/de/d40/d84/d8b 44835 1 2024-01-17T23:40:51.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/493: chown d4/de/f8d 101554470 1 2024-01-17T23:40:51.287 INFO:tasks.workunit.client.0.smithi067.stdout:7/494: dread d4/f27 [0,4194304] 0 2024-01-17T23:40:51.292 INFO:tasks.workunit.client.0.smithi067.stdout:7/495: dread d4/de/f58 [0,4194304] 0 2024-01-17T23:40:51.334 INFO:tasks.workunit.client.0.smithi067.stdout:7/496: dwrite d4/de/f3a [0,4194304] 0 2024-01-17T23:40:51.334 INFO:tasks.workunit.client.0.smithi067.stdout:7/497: write d4/d25/f38 [122610,1169] 0 2024-01-17T23:40:51.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/479: rmdir d3/d26/d34/d3a 39 2024-01-17T23:40:51.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/480: fdatasync d3/d26/d34/d3a/f47 0 2024-01-17T23:40:51.628 INFO:tasks.workunit.client.0.smithi067.stdout:4/481: fdatasync d3/d5/f2e 0 2024-01-17T23:40:51.977 INFO:tasks.workunit.client.0.smithi067.stdout:5/442: mknod d10/d24/d46/d4a/d50/d5a/c8e 0 2024-01-17T23:40:51.977 INFO:tasks.workunit.client.0.smithi067.stdout:3/551: creat d0/d13/fa9 x:0 0 0 2024-01-17T23:40:51.977 INFO:tasks.workunit.client.0.smithi067.stdout:5/443: chown d10/d24/d59/d5d/d43/c44 26869349 1 2024-01-17T23:40:51.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/444: dread d10/d24/d59/d5d/f4d [0,4194304] 0 2024-01-17T23:40:52.117 INFO:tasks.workunit.client.0.smithi067.stdout:1/508: creat d0/d7/d13/d77/d95/fa3 x:0 0 0 2024-01-17T23:40:52.418 INFO:tasks.workunit.client.0.smithi067.stdout:6/532: mkdir d6/d9/d30/dbd 0 2024-01-17T23:40:52.419 INFO:tasks.workunit.client.0.smithi067.stdout:6/533: stat d6/d9/f31 0 2024-01-17T23:40:52.954 INFO:tasks.workunit.client.0.smithi067.stdout:7/498: link d4/de/l12 d4/d4b/d7f/l91 0 2024-01-17T23:40:53.157 INFO:tasks.workunit.client.0.smithi067.stdout:9/434: rmdir d3/d25/d28 39 2024-01-17T23:40:53.355 INFO:tasks.workunit.client.0.smithi067.stdout:4/482: creat d3/d8/de/d20/d3b/d7c/d92/f99 x:0 0 0 2024-01-17T23:40:53.459 INFO:tasks.workunit.client.0.smithi067.stdout:3/552: creat d0/d34/d35/d57/d87/faa x:0 0 0 2024-01-17T23:40:53.459 INFO:tasks.workunit.client.0.smithi067.stdout:3/553: write d0/d13/fa9 [500304,11615] 0 2024-01-17T23:40:53.743 INFO:tasks.workunit.client.0.smithi067.stdout:1/509: mkdir d0/d7/d13/d3d/d48/da4 0 2024-01-17T23:40:53.775 INFO:tasks.workunit.client.0.smithi067.stdout:1/510: dwrite d0/d74/f6a [4194304,4194304] 0 2024-01-17T23:40:53.972 INFO:tasks.workunit.client.0.smithi067.stdout:7/499: mkdir d4/d25/d39/d8a/d92 0 2024-01-17T23:40:54.092 INFO:tasks.workunit.client.0.smithi067.stdout:7/500: readlink d4/d16/l21 0 2024-01-17T23:40:54.328 INFO:tasks.workunit.client.0.smithi067.stdout:4/483: truncate d3/d5/f2e 3318563 0 2024-01-17T23:40:54.328 INFO:tasks.workunit.client.0.smithi067.stdout:4/484: readlink d3/d8/l1d 0 2024-01-17T23:40:54.328 INFO:tasks.workunit.client.0.smithi067.stdout:4/485: truncate d3/d8/de/d20/f5e 468579 0 2024-01-17T23:40:54.571 INFO:tasks.workunit.client.0.smithi067.stdout:1/511: link d0/d7/f29 d0/fa5 0 2024-01-17T23:40:54.924 INFO:tasks.workunit.client.0.smithi067.stdout:3/554: link d0/d13/d1a/c9e d0/d34/d35/cab 0 2024-01-17T23:40:54.925 INFO:tasks.workunit.client.0.smithi067.stdout:3/555: dread - d0/d34/d35/d65/d6f/fa2 zero size 2024-01-17T23:40:54.925 INFO:tasks.workunit.client.0.smithi067.stdout:3/556: fsync d0/d12/d1b/f1d 0 2024-01-17T23:40:54.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/557: dwrite d0/d34/d35/d65/d6f/fa2 [0,4194304] 0 2024-01-17T23:40:54.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/558: chown d0/l24 53 1 2024-01-17T23:40:55.074 INFO:tasks.workunit.client.0.smithi067.stdout:1/512: rmdir d0/d74 39 2024-01-17T23:40:55.520 INFO:tasks.workunit.client.0.smithi067.stdout:3/559: chown d0/d34/d35/l40 730 1 2024-01-17T23:40:55.520 INFO:tasks.workunit.client.0.smithi067.stdout:3/560: fdatasync d0/d17/d69/d6e/f89 0 2024-01-17T23:40:55.520 INFO:tasks.workunit.client.0.smithi067.stdout:3/561: fdatasync d0/d12/d1b/f26 0 2024-01-17T23:40:55.828 INFO:tasks.workunit.client.0.smithi067.stdout:1/513: creat d0/d7/d13/d3a/fa6 x:0 0 0 2024-01-17T23:40:55.854 INFO:tasks.workunit.client.0.smithi067.stdout:1/514: dwrite d0/d69/f71 [0,4194304] 0 2024-01-17T23:40:55.887 INFO:tasks.workunit.client.0.smithi067.stdout:1/515: dwrite d0/d7/f36 [0,4194304] 0 2024-01-17T23:40:55.888 INFO:tasks.workunit.client.0.smithi067.stdout:1/516: readlink d0/d7/d7f/d82/l96 0 2024-01-17T23:40:55.903 INFO:tasks.workunit.client.0.smithi067.stdout:1/517: dread d0/d7/f4c [0,4194304] 0 2024-01-17T23:40:55.903 INFO:tasks.workunit.client.0.smithi067.stdout:1/518: read - d0/d7/d13/d3d/d48/f9b zero size 2024-01-17T23:40:55.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/519: dwrite d0/d74/f84 [0,4194304] 0 2024-01-17T23:40:55.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/520: write d0/d7/d13/d3d/d48/f9b [959266,24038] 0 2024-01-17T23:40:55.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/521: fdatasync d0/d7/d7f/d82/d35/fa0 0 2024-01-17T23:40:55.949 INFO:tasks.workunit.client.0.smithi067.stdout:1/522: dread d0/d69/f71 [0,4194304] 0 2024-01-17T23:40:56.300 INFO:tasks.workunit.client.0.smithi067.stdout:3/562: getdents d0/d34/d35/d57 0 2024-01-17T23:40:56.454 INFO:tasks.workunit.client.0.smithi067.stdout:8/547: rename d6/d19/d22/d25/f7d to d6/d19/d22/fba 0 2024-01-17T23:40:56.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/548: chown d6/d26/d3e/d6c/ca3 43237128 1 2024-01-17T23:40:56.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/549: write d6/d19/d22/f4f [484550,19394] 0 2024-01-17T23:40:56.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/550: readlink d6/d26/d56/d89/l98 0 2024-01-17T23:40:56.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/523: dread d0/d7/d13/d2e/f46 [0,4194304] 0 2024-01-17T23:40:57.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/445: unlink d10/f38 0 2024-01-17T23:40:57.680 INFO:tasks.workunit.client.0.smithi067.stdout:5/446: write d10/d24/d59/d5d/f41 [420419,43042] 0 2024-01-17T23:40:57.698 INFO:tasks.workunit.client.0.smithi067.stdout:5/447: dread d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:40:58.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/448: rmdir d10/d24 39 2024-01-17T23:40:58.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/449: readlink d10/d24/d46/d4a/d50/d5a/l8d 0 2024-01-17T23:40:58.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/450: write d10/d24/f81 [2941,73827] 0 2024-01-17T23:40:58.241 INFO:tasks.workunit.client.0.smithi067.stdout:5/451: chown d10/d24/f81 142344 1 2024-01-17T23:40:58.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/452: getdents d10/d24/d25 0 2024-01-17T23:40:58.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/453: write d10/d24/d46/d4a/d63/f8b [935560,34627] 0 2024-01-17T23:40:58.922 INFO:tasks.workunit.client.0.smithi067.stdout:5/454: dread d10/f1c [0,4194304] 0 2024-01-17T23:40:58.922 INFO:tasks.workunit.client.0.smithi067.stdout:5/455: write d10/d24/d46/f6a [5726156,40644] 0 2024-01-17T23:40:58.929 INFO:tasks.workunit.client.0.smithi067.stdout:9/435: dwrite d3/d6/d2a/d34/d42/f6b [0,4194304] 0 2024-01-17T23:40:58.929 INFO:tasks.workunit.client.0.smithi067.stdout:5/456: read d10/d24/d46/f5b [646955,44813] 0 2024-01-17T23:40:59.097 INFO:tasks.workunit.client.0.smithi067.stdout:4/486: symlink d3/d8/de/d20/l9a 0 2024-01-17T23:40:59.281 INFO:tasks.workunit.client.0.smithi067.stdout:3/563: creat d0/d17/fac x:0 0 0 2024-01-17T23:40:59.281 INFO:tasks.workunit.client.0.smithi067.stdout:3/564: write d0/d17/d69/d6e/f84 [978400,47220] 0 2024-01-17T23:40:59.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/436: unlink d3/d6/d11/d50/c6c 0 2024-01-17T23:40:59.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/437: fsync d3/d6/d11/d50/f40 0 2024-01-17T23:40:59.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/438: fsync d3/d58/f81 0 2024-01-17T23:40:59.882 INFO:tasks.workunit.client.0.smithi067.stdout:5/457: truncate d10/d24/d59/d5d/f4d 3884708 0 2024-01-17T23:41:00.014 INFO:tasks.workunit.client.0.smithi067.stdout:3/565: unlink d0/d13/d4a/c7d 0 2024-01-17T23:41:00.015 INFO:tasks.workunit.client.0.smithi067.stdout:3/566: truncate d0/f99 941050 0 2024-01-17T23:41:00.031 INFO:tasks.workunit.client.0.smithi067.stdout:3/567: dread d0/d12/d59/f9a [0,4194304] 0 2024-01-17T23:41:00.032 INFO:tasks.workunit.client.0.smithi067.stdout:3/568: write d0/d13/f8a [886729,100544] 0 2024-01-17T23:41:00.032 INFO:tasks.workunit.client.0.smithi067.stdout:3/569: getdents d0/d13/d4a/d82/da6 0 2024-01-17T23:41:00.078 INFO:tasks.workunit.client.0.smithi067.stdout:8/551: dwrite d6/d19/d22/fba [0,4194304] 0 2024-01-17T23:41:00.098 INFO:tasks.workunit.client.0.smithi067.stdout:8/552: dread d6/db/d58/f51 [0,4194304] 0 2024-01-17T23:41:00.098 INFO:tasks.workunit.client.0.smithi067.stdout:8/553: fsync d6/d19/d22/f91 0 2024-01-17T23:41:00.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/439: dread d3/d6/f56 [0,4194304] 0 2024-01-17T23:41:00.171 INFO:tasks.workunit.client.0.smithi067.stdout:9/440: dread d3/d15/f86 [0,4194304] 0 2024-01-17T23:41:00.261 INFO:tasks.workunit.client.0.smithi067.stdout:5/458: mknod d10/d24/d46/d4a/d63/c8f 0 2024-01-17T23:41:00.340 INFO:tasks.workunit.client.0.smithi067.stdout:3/570: mknod d0/d17/d69/d6e/cad 0 2024-01-17T23:41:00.539 INFO:tasks.workunit.client.0.smithi067.stdout:8/554: mkdir d6/d26/d56/dbb 0 2024-01-17T23:41:00.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/555: dwrite d6/db/f84 [0,4194304] 0 2024-01-17T23:41:00.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/459: readlink d10/l1d 0 2024-01-17T23:41:01.146 INFO:tasks.workunit.client.0.smithi067.stdout:3/571: getdents d0/d13/d1a 0 2024-01-17T23:41:01.146 INFO:tasks.workunit.client.0.smithi067.stdout:3/572: readlink d0/d13/d1a/l51 0 2024-01-17T23:41:01.678 INFO:tasks.workunit.client.0.smithi067.stdout:8/556: dread d6/d26/d7c/f8b [0,4194304] 0 2024-01-17T23:41:01.802 INFO:tasks.workunit.client.0.smithi067.stdout:5/460: link d10/d24/d46/d4a/d50/d5a/c8e d10/d24/d46/d4a/d4b/c90 0 2024-01-17T23:41:01.803 INFO:tasks.workunit.client.0.smithi067.stdout:5/461: fdatasync d10/d24/d25/f2b 0 2024-01-17T23:41:02.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/573: mkdir d0/d12/d59/dae 0 2024-01-17T23:41:02.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/574: chown d0 164608 1 2024-01-17T23:41:03.796 INFO:tasks.workunit.client.0.smithi067.stdout:4/487: symlink d3/d8/de/l9b 0 2024-01-17T23:41:03.796 INFO:tasks.workunit.client.0.smithi067.stdout:4/488: chown d3/d8/de/d38/c44 600052534 1 2024-01-17T23:41:03.796 INFO:tasks.workunit.client.0.smithi067.stdout:0/534: rename d3/d64/d82/cbd to d3/cd5 0 2024-01-17T23:41:03.809 INFO:tasks.workunit.client.0.smithi067.stdout:3/575: write d0/f3 [3327912,61260] 0 2024-01-17T23:41:04.187 INFO:tasks.workunit.client.0.smithi067.stdout:5/462: creat d10/f91 x:0 0 0 2024-01-17T23:41:04.342 INFO:tasks.workunit.client.0.smithi067.stdout:2/480: rename d5/f9a to d5/d1f/d16/faa 0 2024-01-17T23:41:04.546 INFO:tasks.workunit.client.0.smithi067.stdout:4/489: creat d3/d26/d34/d65/d8e/f9c x:0 0 0 2024-01-17T23:41:04.546 INFO:tasks.workunit.client.0.smithi067.stdout:4/490: readlink d3/d8/de/d20/l8c 0 2024-01-17T23:41:04.637 INFO:tasks.workunit.client.0.smithi067.stdout:1/524: sync 2024-01-17T23:41:04.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/441: sync 2024-01-17T23:41:04.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/442: chown d3/d25/l6e 312637 1 2024-01-17T23:41:04.656 INFO:tasks.workunit.client.0.smithi067.stdout:9/443: read d3/d6/f56 [1356650,28326] 0 2024-01-17T23:41:04.656 INFO:tasks.workunit.client.0.smithi067.stdout:9/444: write d3/d6/d2e/f99 [424245,81032] 0 2024-01-17T23:41:04.705 INFO:tasks.workunit.client.0.smithi067.stdout:3/576: truncate d0/d13/f2c 1423132 0 2024-01-17T23:41:04.716 INFO:tasks.workunit.client.0.smithi067.stdout:3/577: dread d0/fd [0,4194304] 0 2024-01-17T23:41:04.807 INFO:tasks.workunit.client.0.smithi067.stdout:5/463: mkdir d10/d24/d25/d5c/d7e/d7f/d92 0 2024-01-17T23:41:04.941 INFO:tasks.workunit.client.0.smithi067.stdout:6/534: rename d6/d18/f41 to d6/d18/d44/fbe 0 2024-01-17T23:41:04.941 INFO:tasks.workunit.client.0.smithi067.stdout:6/535: truncate d6/d9/d30/d4c/d82/f95 941397 0 2024-01-17T23:41:05.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/491: mknod d3/d4e/c9d 0 2024-01-17T23:41:05.306 INFO:tasks.workunit.client.0.smithi067.stdout:3/578: mknod d0/d13/d4a/d75/caf 0 2024-01-17T23:41:05.313 INFO:tasks.workunit.client.0.smithi067.stdout:3/579: dread d0/d12/f21 [0,4194304] 0 2024-01-17T23:41:05.328 INFO:tasks.workunit.client.0.smithi067.stdout:5/464: dread d10/d24/d25/d5c/f84 [0,4194304] 0 2024-01-17T23:41:05.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/481: link d5/d1f/d35/l8b d5/d1f/d2a/d73/lab 0 2024-01-17T23:41:05.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/482: chown d5/d1f/d2a/d54/d8/d32/d9c/l46 481660963 1 2024-01-17T23:41:05.702 INFO:tasks.workunit.client.0.smithi067.stdout:0/535: truncate d3/d5/d1a/f44 1330997 0 2024-01-17T23:41:05.778 INFO:tasks.workunit.client.0.smithi067.stdout:3/580: creat d0/d13/d4a/fb0 x:0 0 0 2024-01-17T23:41:05.918 INFO:tasks.workunit.client.0.smithi067.stdout:5/465: creat d10/d24/f93 x:0 0 0 2024-01-17T23:41:06.080 INFO:tasks.workunit.client.0.smithi067.stdout:1/525: sync 2024-01-17T23:41:06.080 INFO:tasks.workunit.client.0.smithi067.stdout:1/526: chown d0/d7/d1c/c24 322285 1 2024-01-17T23:41:06.113 INFO:tasks.workunit.client.0.smithi067.stdout:1/527: dwrite d0/d74/d31/f86 [4194304,4194304] 0 2024-01-17T23:41:06.135 INFO:tasks.workunit.client.0.smithi067.stdout:1/528: write d0/d7/f29 [660859,11915] 0 2024-01-17T23:41:06.135 INFO:tasks.workunit.client.0.smithi067.stdout:1/529: truncate d0/d7/f66 714244 0 2024-01-17T23:41:06.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/536: creat d3/d64/fd6 x:0 0 0 2024-01-17T23:41:06.670 INFO:tasks.workunit.client.0.smithi067.stdout:7/501: rename d4/d25/d56 to d4/d25/d39/d46/d78/d93 0 2024-01-17T23:41:07.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/557: rename d6/db/f1b to d6/d26/d56/dbb/fbc 0 2024-01-17T23:41:07.363 INFO:tasks.workunit.client.0.smithi067.stdout:7/502: mkdir d4/d25/d39/d46/d78/d93/d94 0 2024-01-17T23:41:07.389 INFO:tasks.workunit.client.0.smithi067.stdout:7/503: dwrite d4/d16/f4e [0,4194304] 0 2024-01-17T23:41:07.389 INFO:tasks.workunit.client.0.smithi067.stdout:7/504: truncate d4/d25/d39/d46/d78/f86 693513 0 2024-01-17T23:41:07.416 INFO:tasks.workunit.client.0.smithi067.stdout:7/505: dwrite d4/de/d40/f42 [0,4194304] 0 2024-01-17T23:41:07.443 INFO:tasks.workunit.client.0.smithi067.stdout:7/506: dwrite d4/f5b [0,4194304] 0 2024-01-17T23:41:07.610 INFO:tasks.workunit.client.0.smithi067.stdout:0/537: getdents d3/d5/d1a/d1c/d4e/d6b 0 2024-01-17T23:41:07.934 INFO:tasks.workunit.client.0.smithi067.stdout:8/558: mkdir d6/d19/d22/d25/d53/dbd 0 2024-01-17T23:41:08.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/581: sync 2024-01-17T23:41:08.547 INFO:tasks.workunit.client.0.smithi067.stdout:2/483: sync 2024-01-17T23:41:08.547 INFO:tasks.workunit.client.0.smithi067.stdout:6/536: sync 2024-01-17T23:41:08.567 INFO:tasks.workunit.client.0.smithi067.stdout:3/582: dread d0/d12/f1c [0,4194304] 0 2024-01-17T23:41:08.601 INFO:tasks.workunit.client.0.smithi067.stdout:1/530: dwrite d0/d7/d13/d2e/f49 [0,4194304] 0 2024-01-17T23:41:08.706 INFO:tasks.workunit.client.0.smithi067.stdout:7/507: mkdir d4/d4b/d63/d95 0 2024-01-17T23:41:08.802 INFO:tasks.workunit.client.0.smithi067.stdout:0/538: creat d3/d75/fd7 x:0 0 0 2024-01-17T23:41:09.095 INFO:tasks.workunit.client.0.smithi067.stdout:2/484: symlink d5/d86/lac 0 2024-01-17T23:41:09.159 INFO:tasks.workunit.client.0.smithi067.stdout:6/537: truncate d6/d9/d30/d4c/f6d 891335 0 2024-01-17T23:41:09.175 INFO:tasks.workunit.client.0.smithi067.stdout:6/538: dread d6/d9/d1c/d1e/f5e [0,4194304] 0 2024-01-17T23:41:09.427 INFO:tasks.workunit.client.0.smithi067.stdout:3/583: mknod d0/d12/d59/cb1 0 2024-01-17T23:41:09.427 INFO:tasks.workunit.client.0.smithi067.stdout:3/584: write d0/f94 [1044629,60632] 0 2024-01-17T23:41:09.541 INFO:tasks.workunit.client.0.smithi067.stdout:1/531: link d0/d7/d1c/c24 d0/d7/d13/ca7 0 2024-01-17T23:41:09.541 INFO:tasks.workunit.client.0.smithi067.stdout:1/532: stat d0/d7/d13/d77/d95 0 2024-01-17T23:41:09.705 INFO:tasks.workunit.client.0.smithi067.stdout:9/445: rename d3/d25/l6e to d3/d6/l9d 0 2024-01-17T23:41:09.705 INFO:tasks.workunit.client.0.smithi067.stdout:7/508: symlink d4/d25/d39/d79/d8c/l96 0 2024-01-17T23:41:09.705 INFO:tasks.workunit.client.0.smithi067.stdout:9/446: truncate d3/d6/d11/d50/f94 689530 0 2024-01-17T23:41:09.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/539: mknod d3/d6/dd/d43/cd8 0 2024-01-17T23:41:09.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/540: chown d3/d5/d32/f73 45 1 2024-01-17T23:41:09.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/541: truncate d3/d6/dd/f4a 5653665 0 2024-01-17T23:41:09.793 INFO:tasks.workunit.client.0.smithi067.stdout:0/542: write d3/d5/d32/d9f/fad [291691,126766] 0 2024-01-17T23:41:09.972 INFO:tasks.workunit.client.0.smithi067.stdout:2/485: symlink d5/d1f/d2a/d55/lad 0 2024-01-17T23:41:10.526 INFO:tasks.workunit.client.0.smithi067.stdout:3/585: link d0/d13/f33 d0/d34/d35/d65/d6f/fb2 0 2024-01-17T23:41:10.611 INFO:tasks.workunit.client.0.smithi067.stdout:1/533: mknod d0/d7/d13/d3a/d75/ca8 0 2024-01-17T23:41:10.806 INFO:tasks.workunit.client.0.smithi067.stdout:8/559: write d6/db/f27 [157721,21122] 0 2024-01-17T23:41:10.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/509: creat d4/d25/d39/d8a/f97 x:0 0 0 2024-01-17T23:41:11.056 INFO:tasks.workunit.client.0.smithi067.stdout:0/543: fsync d3/d5/d1a/f2c 0 2024-01-17T23:41:11.057 INFO:tasks.workunit.client.0.smithi067.stdout:0/544: chown d3/d5/d1a/d1c/d4d 33769047 1 2024-01-17T23:41:11.057 INFO:tasks.workunit.client.0.smithi067.stdout:0/545: readlink d3/d5/d1a/d1c/d4d/l99 0 2024-01-17T23:41:11.210 INFO:tasks.workunit.client.0.smithi067.stdout:2/486: creat d5/d1f/d98/d9f/fae x:0 0 0 2024-01-17T23:41:11.892 INFO:tasks.workunit.client.0.smithi067.stdout:6/539: sync 2024-01-17T23:41:11.911 INFO:tasks.workunit.client.0.smithi067.stdout:6/540: dread d6/d9/f94 [0,4194304] 0 2024-01-17T23:41:11.925 INFO:tasks.workunit.client.0.smithi067.stdout:6/541: write d6/f1f [435075,105501] 0 2024-01-17T23:41:12.103 INFO:tasks.workunit.client.0.smithi067.stdout:3/586: fsync d0/d34/d35/d65/d6f/fb2 0 2024-01-17T23:41:12.130 INFO:tasks.workunit.client.0.smithi067.stdout:3/587: dwrite d0/d17/f4c [0,4194304] 0 2024-01-17T23:41:12.130 INFO:tasks.workunit.client.0.smithi067.stdout:3/588: readlink d0/d12/l6c 0 2024-01-17T23:41:12.368 INFO:tasks.workunit.client.0.smithi067.stdout:9/447: write d3/d6/d11/f1b [4212162,72018] 0 2024-01-17T23:41:12.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/560: creat d6/db/d58/fbe x:0 0 0 2024-01-17T23:41:12.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/561: chown d6/d19/d22/d25/d53/d65/f60 8205 1 2024-01-17T23:41:12.939 INFO:tasks.workunit.client.0.smithi067.stdout:7/510: mknod d4/de/d40/d84/d8b/c98 0 2024-01-17T23:41:13.210 INFO:tasks.workunit.client.0.smithi067.stdout:0/546: symlink d3/d5/d1a/d1c/d4e/ld9 0 2024-01-17T23:41:13.681 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:13.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:13.762 INFO:tasks.workunit.client.0.smithi067.stdout:6/542: getdents d6/d18/d2e/d7c 0 2024-01-17T23:41:13.763 INFO:tasks.workunit.client.0.smithi067.stdout:6/543: write d6/d18/d2e/f40 [1835744,46164] 0 2024-01-17T23:41:14.268 INFO:tasks.workunit.client.0.smithi067.stdout:4/492: rename d3/d26/d34/d65/d8e to d3/d5/d93/d9e 0 2024-01-17T23:41:14.268 INFO:tasks.workunit.client.0.smithi067.stdout:8/562: mknod d6/db/cbf 0 2024-01-17T23:41:14.268 INFO:tasks.workunit.client.0.smithi067.stdout:8/563: chown d6/d26/d56/dbb 6326 1 2024-01-17T23:41:14.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/547: symlink d3/d5/d1a/d1c/d4e/lda 0 2024-01-17T23:41:14.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/548: read - d3/d5/d1a/d1c/d1d/d2e/f85 zero size 2024-01-17T23:41:14.643 INFO:tasks.workunit.client.0.smithi067.stdout:6/544: mknod d6/d9/d1c/d1e/d43/cbf 0 2024-01-17T23:41:14.643 INFO:tasks.workunit.client.0.smithi067.stdout:6/545: creat d6/d9/d1c/d1e/d7e/fc0 x:0 0 0 2024-01-17T23:41:14.643 INFO:tasks.workunit.client.0.smithi067.stdout:6/546: chown d6/d9/l22 225820 1 2024-01-17T23:41:14.644 INFO:tasks.workunit.client.0.smithi067.stdout:6/547: fdatasync d6/d9/f27 0 2024-01-17T23:41:14.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/589: symlink d0/lb3 0 2024-01-17T23:41:15.061 INFO:tasks.workunit.client.0.smithi067.stdout:4/493: mkdir d3/d26/d34/d3a/d9f 0 2024-01-17T23:41:15.215 INFO:tasks.workunit.client.0.smithi067.stdout:7/511: getdents d4/de/d40 0 2024-01-17T23:41:15.343 INFO:tasks.workunit.client.0.smithi067.stdout:0/549: truncate d3/d6/dd/f4a 5094964 0 2024-01-17T23:41:15.464 INFO:tasks.workunit.client.0.smithi067.stdout:6/548: stat d6/d9/d1c/d1e/d7e/f8c 0 2024-01-17T23:41:15.822 INFO:tasks.workunit.client.0.smithi067.stdout:5/466: rename d10/l1e to d10/d24/d46/d4a/d63/d85/l94 0 2024-01-17T23:41:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/467: readlink d10/d24/d59/d5d/d43/l55 0 2024-01-17T23:41:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/468: fdatasync d10/f91 0 2024-01-17T23:41:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/469: fdatasync d10/d24/d46/d4a/f74 0 2024-01-17T23:41:15.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/470: dread d10/d24/d59/f67 [0,4194304] 0 2024-01-17T23:41:15.914 INFO:tasks.workunit.client.0.smithi067.stdout:4/494: creat d3/d26/d34/d3a/fa0 x:0 0 0 2024-01-17T23:41:16.240 INFO:tasks.workunit.client.0.smithi067.stdout:0/550: symlink d3/d5/d1a/d1c/d4d/ldb 0 2024-01-17T23:41:16.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/551: dread d3/d5/f36 [0,4194304] 0 2024-01-17T23:41:16.258 INFO:tasks.workunit.client.0.smithi067.stdout:9/448: write d3/d6/d11/f4f [3115568,34738] 0 2024-01-17T23:41:16.360 INFO:tasks.workunit.client.0.smithi067.stdout:6/549: creat d6/d9/d1c/d1e/d43/d78/dab/fc1 x:0 0 0 2024-01-17T23:41:16.361 INFO:tasks.workunit.client.0.smithi067.stdout:6/550: stat d6/d9/d30/d4c/d8d/f99 0 2024-01-17T23:41:16.459 INFO:tasks.workunit.client.0.smithi067.stdout:1/534: sync 2024-01-17T23:41:16.459 INFO:tasks.workunit.client.0.smithi067.stdout:2/487: sync 2024-01-17T23:41:16.467 INFO:tasks.workunit.client.0.smithi067.stdout:1/535: dread d0/d7/d13/d3d/d48/f9b [0,4194304] 0 2024-01-17T23:41:17.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/495: symlink d3/d8/d35/la1 0 2024-01-17T23:41:17.051 INFO:tasks.workunit.client.0.smithi067.stdout:4/496: chown d3/d8/de/c23 126620701 1 2024-01-17T23:41:17.216 INFO:tasks.workunit.client.0.smithi067.stdout:0/552: creat d3/d6/fdc x:0 0 0 2024-01-17T23:41:17.216 INFO:tasks.workunit.client.0.smithi067.stdout:0/553: read - d3/d75/fd7 zero size 2024-01-17T23:41:17.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/554: dwrite d3/d75/fd7 [0,4194304] 0 2024-01-17T23:41:17.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/555: fdatasync d3/d64/fd6 0 2024-01-17T23:41:17.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/556: fdatasync d3/d6/dd/f4a 0 2024-01-17T23:41:17.283 INFO:tasks.workunit.client.0.smithi067.stdout:6/551: creat d6/d9/d30/fc2 x:0 0 0 2024-01-17T23:41:17.283 INFO:tasks.workunit.client.0.smithi067.stdout:6/552: write d6/d9/f9c [85949,57264] 0 2024-01-17T23:41:17.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/553: dread - d6/d18/d44/fb5 zero size 2024-01-17T23:41:17.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/554: chown d6/d9/d1c/c8a 59 1 2024-01-17T23:41:17.291 INFO:tasks.workunit.client.0.smithi067.stdout:0/557: dwrite d3/f47 [0,4194304] 0 2024-01-17T23:41:17.291 INFO:tasks.workunit.client.0.smithi067.stdout:0/558: write d3/d5/d32/d9f/fad [4102639,38845] 0 2024-01-17T23:41:17.298 INFO:tasks.workunit.client.0.smithi067.stdout:6/555: dread d6/d9/f31 [0,4194304] 0 2024-01-17T23:41:17.298 INFO:tasks.workunit.client.0.smithi067.stdout:6/556: creat d6/d9/d1c/d1e/d43/d86/da5/fc3 x:0 0 0 2024-01-17T23:41:17.298 INFO:tasks.workunit.client.0.smithi067.stdout:6/557: stat d6/d9/d1c/f2f 0 2024-01-17T23:41:17.367 INFO:tasks.workunit.client.0.smithi067.stdout:2/488: mknod d5/d86/caf 0 2024-01-17T23:41:17.367 INFO:tasks.workunit.client.0.smithi067.stdout:2/489: write d5/d1f/d16/faa [892172,56700] 0 2024-01-17T23:41:17.718 INFO:tasks.workunit.client.0.smithi067.stdout:5/471: unlink d10/f14 0 2024-01-17T23:41:17.718 INFO:tasks.workunit.client.0.smithi067.stdout:5/472: read - d10/d24/f93 zero size 2024-01-17T23:41:17.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/497: mknod d3/d40/ca2 0 2024-01-17T23:41:17.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/498: dread - d3/d8/de/d20/d52/f94 zero size 2024-01-17T23:41:17.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/499: fdatasync d3/d8/de/d38/f7e 0 2024-01-17T23:41:17.816 INFO:tasks.workunit.client.0.smithi067.stdout:4/500: stat d3/d8/de/c90 0 2024-01-17T23:41:17.857 INFO:tasks.workunit.client.0.smithi067.stdout:4/501: dwrite d3/d5/f2e [0,4194304] 0 2024-01-17T23:41:18.138 INFO:tasks.workunit.client.0.smithi067.stdout:3/590: write d0/d13/d1a/d38/f47 [892319,63851] 0 2024-01-17T23:41:18.430 INFO:tasks.workunit.client.0.smithi067.stdout:0/559: symlink d3/d5/d32/d7f/dc6/ldd 0 2024-01-17T23:41:19.019 INFO:tasks.workunit.client.0.smithi067.stdout:6/558: link d6/d9/d3e/la0 d6/d9/d30/d4c/d82/lc4 0 2024-01-17T23:41:19.019 INFO:tasks.workunit.client.0.smithi067.stdout:6/559: dread - d6/d9/d3e/d9e/fb2 zero size 2024-01-17T23:41:19.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/512: write d4/d4b/f7a [495616,95939] 0 2024-01-17T23:41:19.109 INFO:tasks.workunit.client.0.smithi067.stdout:2/490: link d5/d1f/l97 d5/d1f/d2a/d54/d8/d4c/d84/da5/lb0 0 2024-01-17T23:41:19.431 INFO:tasks.workunit.client.0.smithi067.stdout:8/564: rename d6/d26/d3e/d8d to d6/db/d58/d5f/dc0 0 2024-01-17T23:41:19.460 INFO:tasks.workunit.client.0.smithi067.stdout:5/473: creat d10/d24/d59/d5d/f95 x:0 0 0 2024-01-17T23:41:19.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/502: dwrite d3/d26/d34/d3a/f47 [0,4194304] 0 2024-01-17T23:41:19.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/503: read - d3/d8/de/d20/d3b/d7c/f8f zero size 2024-01-17T23:41:19.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/504: fdatasync d3/d8/de/f14 0 2024-01-17T23:41:19.523 INFO:tasks.workunit.client.0.smithi067.stdout:4/505: creat d3/d4e/fa3 x:0 0 0 2024-01-17T23:41:19.523 INFO:tasks.workunit.client.0.smithi067.stdout:4/506: dread - d3/d26/d34/d3a/fa0 zero size 2024-01-17T23:41:20.030 INFO:tasks.workunit.client.0.smithi067.stdout:0/560: rmdir d3 39 2024-01-17T23:41:20.030 INFO:tasks.workunit.client.0.smithi067.stdout:0/561: chown d3/d75/l62 30472 1 2024-01-17T23:41:20.045 INFO:tasks.workunit.client.0.smithi067.stdout:6/560: mknod d6/d9/d1c/d1e/d43/d78/cc5 0 2024-01-17T23:41:20.045 INFO:tasks.workunit.client.0.smithi067.stdout:6/561: stat d6/d9/d1c/d1e/f5e 0 2024-01-17T23:41:20.046 INFO:tasks.workunit.client.0.smithi067.stdout:0/562: write d3/d5/d1a/f71 [5694786,80238] 0 2024-01-17T23:41:20.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/491: link d5/d1f/d2a/d54/d8/c6e d5/d1f/d2a/d54/d8/d4c/d84/cb1 0 2024-01-17T23:41:20.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/565: link d6/db/l32 d6/d26/d56/dbb/lc1 0 2024-01-17T23:41:20.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/566: dread - d6/db/d58/fbe zero size 2024-01-17T23:41:20.352 INFO:tasks.workunit.client.0.smithi067.stdout:8/567: dread d6/db/f41 [4194304,4194304] 0 2024-01-17T23:41:20.365 INFO:tasks.workunit.client.0.smithi067.stdout:8/568: write d6/d19/d22/d25/d53/d65/f44 [300472,38004] 0 2024-01-17T23:41:20.365 INFO:tasks.workunit.client.0.smithi067.stdout:8/569: read - d6/db/d58/d5f/fb7 zero size 2024-01-17T23:41:20.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/507: creat d3/d8/fa4 x:0 0 0 2024-01-17T23:41:20.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/508: write d3/d5/f98 [465060,64578] 0 2024-01-17T23:41:20.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/513: truncate d4/d25/d39/d46/f50 845355 0 2024-01-17T23:41:20.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/514: chown d4/d25/d39/f35 39388043 1 2024-01-17T23:41:21.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/492: creat d5/d1f/d2a/d54/fb2 x:0 0 0 2024-01-17T23:41:21.178 INFO:tasks.workunit.client.0.smithi067.stdout:2/493: write d5/d1f/f1e [910767,41007] 0 2024-01-17T23:41:21.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/449: rename d3/da/l17 to d3/d6/d2a/d34/d42/d9c/l9e 0 2024-01-17T23:41:21.338 INFO:tasks.workunit.client.0.smithi067.stdout:9/450: read d3/d6/d11/f1b [3304443,82538] 0 2024-01-17T23:41:21.338 INFO:tasks.workunit.client.0.smithi067.stdout:9/451: write d3/d15/f67 [343567,26704] 0 2024-01-17T23:41:21.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/452: write d3/d15/f44 [5040488,69182] 0 2024-01-17T23:41:21.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/570: link d6/d19/d22/d25/d53/d48/c6a d6/d19/d22/d25/d53/d54/cc2 0 2024-01-17T23:41:21.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/571: readlink d6/d19/d22/d25/d53/l3b 0 2024-01-17T23:41:21.630 INFO:tasks.workunit.client.0.smithi067.stdout:4/509: dread d3/d8/de/d20/f5e [0,4194304] 0 2024-01-17T23:41:21.631 INFO:tasks.workunit.client.0.smithi067.stdout:4/510: truncate d3/d5/f6c 722681 0 2024-01-17T23:41:21.631 INFO:tasks.workunit.client.0.smithi067.stdout:4/511: readlink d3/d8/l2b 0 2024-01-17T23:41:22.025 INFO:tasks.workunit.client.0.smithi067.stdout:3/591: write d0/d17/f23 [4189248,986] 0 2024-01-17T23:41:22.025 INFO:tasks.workunit.client.0.smithi067.stdout:3/592: getdents d0/d34/d35/d57 0 2024-01-17T23:41:22.025 INFO:tasks.workunit.client.0.smithi067.stdout:3/593: readlink d0/d13/d4a/d55/l61 0 2024-01-17T23:41:22.112 INFO:tasks.workunit.client.0.smithi067.stdout:2/494: unlink d5/d1f/d2a/d54/d8/d32/d9c/f36 0 2024-01-17T23:41:22.225 INFO:tasks.workunit.client.0.smithi067.stdout:1/536: unlink d0/d7/f20 0 2024-01-17T23:41:22.229 INFO:tasks.workunit.client.0.smithi067.stdout:1/537: dread d0/d7/d13/d3a/d45/f5a [0,4194304] 0 2024-01-17T23:41:22.258 INFO:tasks.workunit.client.0.smithi067.stdout:1/538: dwrite d0/d62/f64 [0,4194304] 0 2024-01-17T23:41:22.492 INFO:tasks.workunit.client.0.smithi067.stdout:5/474: rename d10/d24/d25/l5e to d10/d24/d59/d5d/l96 0 2024-01-17T23:41:22.717 INFO:tasks.workunit.client.0.smithi067.stdout:8/572: dread d6/d19/d22/f71 [0,4194304] 0 2024-01-17T23:41:22.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/573: dread d6/f7b [0,4194304] 0 2024-01-17T23:41:22.737 INFO:tasks.workunit.client.0.smithi067.stdout:8/574: write d6/d19/d22/d25/d53/d65/f44 [3899976,50855] 0 2024-01-17T23:41:22.749 INFO:tasks.workunit.client.0.smithi067.stdout:8/575: read d6/db/f41 [5964815,129880] 0 2024-01-17T23:41:22.861 INFO:tasks.workunit.client.0.smithi067.stdout:4/512: symlink d3/d26/la5 0 2024-01-17T23:41:23.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/515: link d4/d16/f29 d4/d25/d39/d46/f99 0 2024-01-17T23:41:23.206 INFO:tasks.workunit.client.0.smithi067.stdout:3/594: symlink d0/d12/d1b/d4d/lb4 0 2024-01-17T23:41:23.283 INFO:tasks.workunit.client.0.smithi067.stdout:2/495: mkdir d5/d1f/d2a/d54/d8/d4c/db3 0 2024-01-17T23:41:23.613 INFO:tasks.workunit.client.0.smithi067.stdout:6/562: dwrite d6/f1f [4194304,4194304] 0 2024-01-17T23:41:23.822 INFO:tasks.workunit.client.0.smithi067.stdout:1/539: creat d0/d7/d13/fa9 x:0 0 0 2024-01-17T23:41:23.822 INFO:tasks.workunit.client.0.smithi067.stdout:0/563: rename d3/d5/d32/d7f/dc6/ldd to d3/d5/d32/d9f/lde 0 2024-01-17T23:41:23.822 INFO:tasks.workunit.client.0.smithi067.stdout:0/564: chown d3/d5/d1a/d1c/d1d/d2e/f85 55 1 2024-01-17T23:41:23.822 INFO:tasks.workunit.client.0.smithi067.stdout:0/565: chown d3/d5/d1a/d1c/d4d/faa 761 1 2024-01-17T23:41:23.822 INFO:tasks.workunit.client.0.smithi067.stdout:0/566: chown d3/d5/d1a/d1c/d4e/d7c/dd0/fcc 55197327 1 2024-01-17T23:41:23.947 INFO:tasks.workunit.client.0.smithi067.stdout:5/475: symlink d10/d24/d59/l97 0 2024-01-17T23:41:23.947 INFO:tasks.workunit.client.0.smithi067.stdout:5/476: write d10/d24/d59/d5d/d43/f70 [463392,56196] 0 2024-01-17T23:41:23.983 INFO:tasks.workunit.client.0.smithi067.stdout:8/576: mknod d6/d19/d22/cc3 0 2024-01-17T23:41:23.984 INFO:tasks.workunit.client.0.smithi067.stdout:8/577: write d6/d19/d22/f4f [1245520,97375] 0 2024-01-17T23:41:23.984 INFO:tasks.workunit.client.0.smithi067.stdout:8/578: readlink d6/d19/d22/d25/d53/d54/la0 0 2024-01-17T23:41:23.984 INFO:tasks.workunit.client.0.smithi067.stdout:8/579: fdatasync d6/d19/d22/d25/f5d 0 2024-01-17T23:41:24.001 INFO:tasks.workunit.client.0.smithi067.stdout:8/580: read d6/d19/f3f [3924713,21559] 0 2024-01-17T23:41:24.083 INFO:tasks.workunit.client.0.smithi067.stdout:4/513: mkdir d3/d8/de/da6 0 2024-01-17T23:41:24.392 INFO:tasks.workunit.client.0.smithi067.stdout:7/516: creat d4/f9a x:0 0 0 2024-01-17T23:41:24.525 INFO:tasks.workunit.client.0.smithi067.stdout:3/595: truncate d0/d13/d4a/d55/f72 1805470 0 2024-01-17T23:41:25.052 INFO:tasks.workunit.client.0.smithi067.stdout:6/563: link d6/d9/d1c/d1e/d43/d86/da5/fc3 d6/d9/d1c/d1e/d43/d86/da5/fc6 0 2024-01-17T23:41:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:1/540: symlink d0/d7/d13/d3a/laa 0 2024-01-17T23:41:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/564: dread - d6/d9/d1c/d1e/d43/d78/fa1 zero size 2024-01-17T23:41:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/565: chown d6/d9/d30/d4c/d8d 98 1 2024-01-17T23:41:25.069 INFO:tasks.workunit.client.0.smithi067.stdout:1/541: dread d0/d7/f29 [0,4194304] 0 2024-01-17T23:41:25.071 INFO:tasks.workunit.client.0.smithi067.stdout:6/566: dread d6/d9/d30/f4d [0,4194304] 0 2024-01-17T23:41:25.085 INFO:tasks.workunit.client.0.smithi067.stdout:6/567: dread d6/d9/d1c/f2f [0,4194304] 0 2024-01-17T23:41:25.099 INFO:tasks.workunit.client.0.smithi067.stdout:1/542: dwrite d0/d7/d13/f50 [0,4194304] 0 2024-01-17T23:41:25.343 INFO:tasks.workunit.client.0.smithi067.stdout:0/567: symlink d3/d5/d1a/d1c/d4d/ldf 0 2024-01-17T23:41:25.343 INFO:tasks.workunit.client.0.smithi067.stdout:0/568: chown d3/d5/d1a/f42 1598 1 2024-01-17T23:41:25.371 INFO:tasks.workunit.client.0.smithi067.stdout:0/569: dwrite d3/d6/dd/fd1 [0,4194304] 0 2024-01-17T23:41:25.528 INFO:tasks.workunit.client.0.smithi067.stdout:5/477: creat d10/d24/d25/d5c/d7e/d7f/f98 x:0 0 0 2024-01-17T23:41:25.528 INFO:tasks.workunit.client.0.smithi067.stdout:5/478: write d10/d24/d46/f5b [1286882,70086] 0 2024-01-17T23:41:25.712 INFO:tasks.workunit.client.0.smithi067.stdout:8/581: creat d6/d26/d7c/fc4 x:0 0 0 2024-01-17T23:41:25.833 INFO:tasks.workunit.client.0.smithi067.stdout:4/514: symlink d3/d26/d34/la7 0 2024-01-17T23:41:25.985 INFO:tasks.workunit.client.0.smithi067.stdout:7/517: truncate d4/f5b 3283016 0 2024-01-17T23:41:25.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/596: creat d0/d13/d1a/fb5 x:0 0 0 2024-01-17T23:41:25.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/597: chown d0/d13/d4a/d82/l92 6 1 2024-01-17T23:41:26.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/518: dwrite d4/d16/f4e [0,4194304] 0 2024-01-17T23:41:26.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/496: rmdir d5/d1f/d98/d9f 39 2024-01-17T23:41:26.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/497: dwrite d5/d1f/d35/f5c [0,4194304] 0 2024-01-17T23:41:26.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/498: fsync d5/d1f/d98/d9f/fae 0 2024-01-17T23:41:26.845 INFO:tasks.workunit.client.0.smithi067.stdout:6/568: mkdir d6/d81/dc7 0 2024-01-17T23:41:27.226 INFO:tasks.workunit.client.0.smithi067.stdout:1/543: mknod d0/d7/d13/d77/cab 0 2024-01-17T23:41:27.725 INFO:tasks.workunit.client.0.smithi067.stdout:0/570: mknod d3/d5/d1a/d1c/d1d/ce0 0 2024-01-17T23:41:27.871 INFO:tasks.workunit.client.0.smithi067.stdout:5/479: stat d10/d24/d46/d4a/d50/d5a/c8e 0 2024-01-17T23:41:28.173 INFO:tasks.workunit.client.0.smithi067.stdout:8/582: mknod d6/d26/d3e/d6c/cc5 0 2024-01-17T23:41:28.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/598: link d0/d13/d4a/fb0 d0/d12/d98/fb6 0 2024-01-17T23:41:28.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/599: chown d0/d12/d1b/d4d/f7f 716671 1 2024-01-17T23:41:28.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/600: dwrite d0/f14 [0,4194304] 0 2024-01-17T23:41:28.603 INFO:tasks.workunit.client.0.smithi067.stdout:3/601: dwrite d0/d17/fac [0,4194304] 0 2024-01-17T23:41:28.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/519: unlink d4/d25/d39/d46/d78/d93/f7c 0 2024-01-17T23:41:28.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/520: fsync d4/d25/d39/f30 0 2024-01-17T23:41:28.752 INFO:tasks.workunit.client.0.smithi067.stdout:7/521: creat d4/d4b/d7f/d82/f9b x:0 0 0 2024-01-17T23:41:28.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/522: dwrite d4/fb [0,4194304] 0 2024-01-17T23:41:28.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/523: readlink d4/d25/l6c 0 2024-01-17T23:41:29.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/569: mknod d6/d18/d2e/d61/d9a/cc8 0 2024-01-17T23:41:29.333 INFO:tasks.workunit.client.0.smithi067.stdout:6/570: creat d6/d9/d1c/d1e/d43/d78/dab/fc9 x:0 0 0 2024-01-17T23:41:29.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/571: write d6/d9/f10 [2275176,4533] 0 2024-01-17T23:41:29.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/572: dread - d6/d9/d1c/d1e/d43/d86/da5/faa zero size 2024-01-17T23:41:29.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/573: truncate d6/d9/d1c/d1e/d43/d78/fb7 417241 0 2024-01-17T23:41:29.523 INFO:tasks.workunit.client.0.smithi067.stdout:9/453: rename d3/d6/d11/d50/f40 to d3/d6/f9f 0 2024-01-17T23:41:29.564 INFO:tasks.workunit.client.0.smithi067.stdout:1/544: chown d0/d7/f29 36023 1 2024-01-17T23:41:29.564 INFO:tasks.workunit.client.0.smithi067.stdout:1/545: read - d0/d62/f9c zero size 2024-01-17T23:41:29.801 INFO:tasks.workunit.client.0.smithi067.stdout:0/571: symlink d3/d5/le1 0 2024-01-17T23:41:29.921 INFO:tasks.workunit.client.0.smithi067.stdout:5/480: rmdir d10/d24/d46/d4a/d50/d5a/d77 0 2024-01-17T23:41:29.922 INFO:tasks.workunit.client.0.smithi067.stdout:5/481: fdatasync d10/f91 0 2024-01-17T23:41:30.116 INFO:tasks.workunit.client.0.smithi067.stdout:8/583: mknod d6/d19/d22/d25/d53/d54/cc6 0 2024-01-17T23:41:30.797 INFO:tasks.workunit.client.0.smithi067.stdout:7/524: truncate d4/de/f58 558237 0 2024-01-17T23:41:30.797 INFO:tasks.workunit.client.0.smithi067.stdout:7/525: fsync d4/d16/f1e 0 2024-01-17T23:41:31.358 INFO:tasks.workunit.client.0.smithi067.stdout:6/574: symlink d6/d9/d1c/d1e/lca 0 2024-01-17T23:41:31.492 INFO:tasks.workunit.client.0.smithi067.stdout:9/454: rename d3/d6/d11/f82 to d3/d6/d11/d50/d84/fa0 0 2024-01-17T23:41:31.549 INFO:tasks.workunit.client.0.smithi067.stdout:9/455: dwrite d3/d15/f44 [4194304,4194304] 0 2024-01-17T23:41:31.855 INFO:tasks.workunit.client.0.smithi067.stdout:0/572: creat d3/d5/d32/dc5/fe2 x:0 0 0 2024-01-17T23:41:31.860 INFO:tasks.workunit.client.0.smithi067.stdout:0/573: dread d3/d5/d1a/d1c/d4d/fb5 [0,4194304] 0 2024-01-17T23:41:31.983 INFO:tasks.workunit.client.0.smithi067.stdout:5/482: getdents d10/d24/d25 0 2024-01-17T23:41:32.111 INFO:tasks.workunit.client.0.smithi067.stdout:8/584: creat d6/d26/d3e/d6c/fc7 x:0 0 0 2024-01-17T23:41:32.111 INFO:tasks.workunit.client.0.smithi067.stdout:8/585: readlink d6/d26/l64 0 2024-01-17T23:41:32.111 INFO:tasks.workunit.client.0.smithi067.stdout:8/586: read - d6/d19/d22/f91 zero size 2024-01-17T23:41:32.562 INFO:tasks.workunit.client.0.smithi067.stdout:3/602: symlink d0/d34/d35/lb7 0 2024-01-17T23:41:32.746 INFO:tasks.workunit.client.0.smithi067.stdout:7/526: dread d4/f6 [0,4194304] 0 2024-01-17T23:41:33.106 INFO:tasks.workunit.client.0.smithi067.stdout:2/499: creat d5/d1f/d2a/d54/d39/d68/fb4 x:0 0 0 2024-01-17T23:41:33.266 INFO:tasks.workunit.client.0.smithi067.stdout:9/456: mkdir d3/d15/d55/da1 0 2024-01-17T23:41:33.357 INFO:tasks.workunit.client.0.smithi067.stdout:1/546: dread d0/d7/d13/d3a/f51 [0,4194304] 0 2024-01-17T23:41:33.687 INFO:tasks.workunit.client.0.smithi067.stdout:5/483: symlink d10/d24/d25/d5c/d7e/d7f/d92/l99 0 2024-01-17T23:41:33.752 INFO:tasks.workunit.client.0.smithi067.stdout:8/587: creat d6/d19/fc8 x:0 0 0 2024-01-17T23:41:33.752 INFO:tasks.workunit.client.0.smithi067.stdout:8/588: chown d6/d26/d56/d89/l98 1259946 1 2024-01-17T23:41:33.754 INFO:tasks.workunit.client.0.smithi067.stdout:8/589: dread d6/d19/d22/f71 [0,4194304] 0 2024-01-17T23:41:33.754 INFO:tasks.workunit.client.0.smithi067.stdout:8/590: creat d6/d26/d3e/d6c/fc9 x:0 0 0 2024-01-17T23:41:34.102 INFO:tasks.workunit.client.0.smithi067.stdout:7/527: truncate d4/f26 270743 0 2024-01-17T23:41:34.102 INFO:tasks.workunit.client.0.smithi067.stdout:7/528: chown d4/f8 7 1 2024-01-17T23:41:34.150 INFO:tasks.workunit.client.0.smithi067.stdout:7/529: dwrite d4/fd [0,4194304] 0 2024-01-17T23:41:34.191 INFO:tasks.workunit.client.0.smithi067.stdout:7/530: dwrite d4/de/f3a [0,4194304] 0 2024-01-17T23:41:34.195 INFO:tasks.workunit.client.0.smithi067.stdout:7/531: write d4/f5d [507792,70304] 0 2024-01-17T23:41:34.195 INFO:tasks.workunit.client.0.smithi067.stdout:7/532: write d4/de/f4d [2906900,110826] 0 2024-01-17T23:41:34.196 INFO:tasks.workunit.client.0.smithi067.stdout:7/533: chown d4/d16/c22 1718757 1 2024-01-17T23:41:34.216 INFO:tasks.workunit.client.0.smithi067.stdout:7/534: read d4/d16/f4e [3777382,123974] 0 2024-01-17T23:41:34.223 INFO:tasks.workunit.client.0.smithi067.stdout:7/535: dread f1 [0,4194304] 0 2024-01-17T23:41:34.296 INFO:tasks.workunit.client.0.smithi067.stdout:2/500: mkdir d5/d1f/d2a/d54/d8/db5 0 2024-01-17T23:41:34.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/575: rmdir d6/d9/d30/d4c/d8d 39 2024-01-17T23:41:34.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/576: dread - d6/d9/d1c/d1e/d43/d86/da5/fa7 zero size 2024-01-17T23:41:34.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/457: rename d3/d25/d28 to d3/d6/d2a/da2 0 2024-01-17T23:41:34.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/458: write d3/d6/d2a/f71 [5169769,19180] 0 2024-01-17T23:41:34.383 INFO:tasks.workunit.client.0.smithi067.stdout:9/459: write d3/d6/d11/d50/f43 [2227882,80339] 0 2024-01-17T23:41:35.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/603: link d0/d13/d1a/f2e d0/d34/d35/fb8 0 2024-01-17T23:41:35.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/515: write d3/d40/f70 [5147051,103019] 0 2024-01-17T23:41:35.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/516: fsync d3/d26/f88 0 2024-01-17T23:41:35.283 INFO:tasks.workunit.client.0.smithi067.stdout:4/517: readlink d3/d8/l25 0 2024-01-17T23:41:35.550 INFO:tasks.workunit.client.0.smithi067.stdout:6/577: unlink d6/d9/d1c/c8a 0 2024-01-17T23:41:35.607 INFO:tasks.workunit.client.0.smithi067.stdout:6/578: dwrite d6/d9/d1c/d1e/d43/d86/da5/faa [0,4194304] 0 2024-01-17T23:41:35.725 INFO:tasks.workunit.client.0.smithi067.stdout:5/484: rename d10/d24/d59/d5d/d78 to d10/d53/d9a 0 2024-01-17T23:41:35.924 INFO:tasks.workunit.client.0.smithi067.stdout:9/460: creat d3/d15/d55/fa3 x:0 0 0 2024-01-17T23:41:36.137 INFO:tasks.workunit.client.0.smithi067.stdout:8/591: getdents d6/d19/d22/d25/d53/d54 0 2024-01-17T23:41:36.433 INFO:tasks.workunit.client.0.smithi067.stdout:4/518: symlink d3/d26/la8 0 2024-01-17T23:41:36.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/519: chown d3/d5/c2c 96068 1 2024-01-17T23:41:36.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/520: read - d3/d26/d34/d65/f86 zero size 2024-01-17T23:41:36.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/521: creat d3/d26/fa9 x:0 0 0 2024-01-17T23:41:36.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/522: truncate d3/d26/d34/d65/f68 950258 0 2024-01-17T23:41:36.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/579: link d6/d9/d1c/d1e/c37 d6/d18/d44/d51/ccb 0 2024-01-17T23:41:36.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/580: dread d6/d9/d30/f4d [4194304,4194304] 0 2024-01-17T23:41:36.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/581: fdatasync d6/d18/d44/f4e 0 2024-01-17T23:41:36.855 INFO:tasks.workunit.client.0.smithi067.stdout:6/582: dread d6/d9/d1c/d1e/f62 [0,4194304] 0 2024-01-17T23:41:37.195 INFO:tasks.workunit.client.0.smithi067.stdout:2/501: rename d5/d86/lac to d5/d1f/d2a/d54/d8/d32/lb6 0 2024-01-17T23:41:37.212 INFO:tasks.workunit.client.0.smithi067.stdout:2/502: dread d5/d1f/d2a/f52 [0,4194304] 0 2024-01-17T23:41:37.400 INFO:tasks.workunit.client.0.smithi067.stdout:5/485: truncate d10/d24/d46/f54 2359877 0 2024-01-17T23:41:37.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/486: dwrite d10/d24/f36 [4194304,4194304] 0 2024-01-17T23:41:37.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/487: stat d10/d24/c6c 0 2024-01-17T23:41:37.492 INFO:tasks.workunit.client.0.smithi067.stdout:8/592: creat d6/d19/d22/d25/d53/fca x:0 0 0 2024-01-17T23:41:37.492 INFO:tasks.workunit.client.0.smithi067.stdout:8/593: write d6/d26/d3e/d6c/fc7 [215317,119500] 0 2024-01-17T23:41:37.820 INFO:tasks.workunit.client.0.smithi067.stdout:4/523: mknod d3/d26/caa 0 2024-01-17T23:41:38.007 INFO:tasks.workunit.client.0.smithi067.stdout:1/547: dwrite d0/d7/d13/d2e/f4b [4194304,4194304] 0 2024-01-17T23:41:38.038 INFO:tasks.workunit.client.0.smithi067.stdout:1/548: dwrite d0/fa5 [0,4194304] 0 2024-01-17T23:41:38.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/583: link d6/d9/d30/d4c/d82/lc4 d6/d9/d3e/lcc 0 2024-01-17T23:41:38.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/584: truncate d6/d9/d1c/d1e/d43/d86/f97 1077441 0 2024-01-17T23:41:38.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/488: creat d10/d24/d25/f9b x:0 0 0 2024-01-17T23:41:38.768 INFO:tasks.workunit.client.0.smithi067.stdout:7/536: write d4/f2d [1563449,66610] 0 2024-01-17T23:41:38.768 INFO:tasks.workunit.client.0.smithi067.stdout:7/537: fsync d4/f8 0 2024-01-17T23:41:38.915 INFO:tasks.workunit.client.0.smithi067.stdout:8/594: mknod d6/d26/d3e/ccb 0 2024-01-17T23:41:39.076 INFO:tasks.workunit.client.0.smithi067.stdout:4/524: mkdir d3/d8/de/d38/dab 0 2024-01-17T23:41:39.156 INFO:tasks.workunit.client.0.smithi067.stdout:0/574: rmdir d3/d5/d32/dc5 39 2024-01-17T23:41:39.261 INFO:tasks.workunit.client.0.smithi067.stdout:1/549: dread - d0/d7/d7f/d82/d35/fa0 zero size 2024-01-17T23:41:39.448 INFO:tasks.workunit.client.0.smithi067.stdout:6/585: mknod d6/d18/d44/d51/ccd 0 2024-01-17T23:41:39.470 INFO:tasks.workunit.client.0.smithi067.stdout:6/586: dwrite d6/d9/d65/f89 [0,4194304] 0 2024-01-17T23:41:39.530 INFO:tasks.workunit.client.0.smithi067.stdout:2/503: creat d5/d1f/d2a/d73/d95/fb7 x:0 0 0 2024-01-17T23:41:39.675 INFO:tasks.workunit.client.0.smithi067.stdout:5/489: symlink d10/d24/d25/l9c 0 2024-01-17T23:41:39.675 INFO:tasks.workunit.client.0.smithi067.stdout:5/490: dread - d10/f91 zero size 2024-01-17T23:41:39.716 INFO:tasks.workunit.client.0.smithi067.stdout:5/491: dwrite d10/d24/d46/d4a/f74 [0,4194304] 0 2024-01-17T23:41:39.716 INFO:tasks.workunit.client.0.smithi067.stdout:5/492: write d10/d24/d46/f7c [807920,37561] 0 2024-01-17T23:41:39.749 INFO:tasks.workunit.client.0.smithi067.stdout:7/538: mkdir d4/d4b/d63/d9c 0 2024-01-17T23:41:39.896 INFO:tasks.workunit.client.0.smithi067.stdout:8/595: symlink d6/d26/lcc 0 2024-01-17T23:41:39.932 INFO:tasks.workunit.client.0.smithi067.stdout:3/604: dwrite d0/d13/f2c [0,4194304] 0 2024-01-17T23:41:39.933 INFO:tasks.workunit.client.0.smithi067.stdout:3/605: fsync d0/d17/fa8 0 2024-01-17T23:41:39.965 INFO:tasks.workunit.client.0.smithi067.stdout:3/606: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:41:40.246 INFO:tasks.workunit.client.0.smithi067.stdout:0/575: creat d3/d6/dd/dc4/fe3 x:0 0 0 2024-01-17T23:41:40.274 INFO:tasks.workunit.client.0.smithi067.stdout:0/576: dwrite d3/d5/d32/dc5/fe2 [0,4194304] 0 2024-01-17T23:41:40.408 INFO:tasks.workunit.client.0.smithi067.stdout:6/587: mknod d6/d9/d65/da4/cce 0 2024-01-17T23:41:41.101 INFO:tasks.workunit.client.0.smithi067.stdout:5/493: symlink d10/d53/l9d 0 2024-01-17T23:41:41.179 INFO:tasks.workunit.client.0.smithi067.stdout:7/539: link d4/c3c d4/d4b/d63/d9c/c9d 0 2024-01-17T23:41:41.179 INFO:tasks.workunit.client.0.smithi067.stdout:8/596: creat d6/d93/fcd x:0 0 0 2024-01-17T23:41:41.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/607: truncate d0/d12/d59/f9a 3108436 0 2024-01-17T23:41:41.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/608: read - d0/d12/d59/fa3 zero size 2024-01-17T23:41:41.196 INFO:tasks.workunit.client.0.smithi067.stdout:8/597: dread d6/d19/d22/fa8 [0,4194304] 0 2024-01-17T23:41:41.197 INFO:tasks.workunit.client.0.smithi067.stdout:8/598: getdents d6/d19/db4 0 2024-01-17T23:41:43.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:43.840 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:41:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:2/504: dwrite d5/d1f/f3c [0,4194304] 0 2024-01-17T23:41:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:2/505: chown d5/d1f/d2a/d54/d8/d32/d9c/l3a 124265 1 2024-01-17T23:41:45.278 INFO:tasks.workunit.client.0.smithi067.stdout:6/588: creat d6/d9/d30/d4c/d8d/fcf x:0 0 0 2024-01-17T23:41:45.291 INFO:tasks.workunit.client.0.smithi067.stdout:6/589: dread d6/d9/f27 [0,4194304] 0 2024-01-17T23:41:45.291 INFO:tasks.workunit.client.0.smithi067.stdout:6/590: chown d6/d9/d1c/d1e/l63 3 1 2024-01-17T23:41:45.430 INFO:tasks.workunit.client.0.smithi067.stdout:7/540: getdents d4/d25 0 2024-01-17T23:41:45.431 INFO:tasks.workunit.client.0.smithi067.stdout:7/541: fdatasync d4/d16/f3f 0 2024-01-17T23:41:45.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/609: link d0/d13/d4a/f5c d0/d12/d1b/d4d/fb9 0 2024-01-17T23:41:45.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/610: fsync d0/d17/fac 0 2024-01-17T23:41:45.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/611: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:41:45.690 INFO:tasks.workunit.client.0.smithi067.stdout:3/612: dwrite d0/d34/d35/f96 [0,4194304] 0 2024-01-17T23:41:45.894 INFO:tasks.workunit.client.0.smithi067.stdout:2/506: mknod d5/d1f/d2a/d54/d8/d32/d9c/cb8 0 2024-01-17T23:41:46.004 INFO:tasks.workunit.client.0.smithi067.stdout:6/591: symlink d6/d9/d1c/d1e/d43/ld0 0 2024-01-17T23:41:46.157 INFO:tasks.workunit.client.0.smithi067.stdout:7/542: dwrite d4/d25/d39/d46/d78/f86 [0,4194304] 0 2024-01-17T23:41:46.486 INFO:tasks.workunit.client.0.smithi067.stdout:3/613: unlink d0/d37/c44 0 2024-01-17T23:41:46.486 INFO:tasks.workunit.client.0.smithi067.stdout:3/614: fdatasync d0/d13/d4a/fb0 0 2024-01-17T23:41:46.695 INFO:tasks.workunit.client.0.smithi067.stdout:2/507: dread d5/d1f/d2a/d54/d8/f3f [0,4194304] 0 2024-01-17T23:41:46.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/592: truncate d6/d9/f94 1146558 0 2024-01-17T23:41:46.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/593: chown d6/d9/d30/d4c/d82/fae 147 1 2024-01-17T23:41:46.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/594: read d6/d18/f1d [594534,107317] 0 2024-01-17T23:41:46.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/543: mknod d4/de/d41/d7d/d81/c9e 0 2024-01-17T23:41:46.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/544: stat d4/d25/d39/d46/d78/d93 0 2024-01-17T23:41:47.506 INFO:tasks.workunit.client.0.smithi067.stdout:2/508: symlink d5/d1f/d2a/d54/d8/d32/lb9 0 2024-01-17T23:41:47.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/595: write d6/d9/d1c/d1e/d43/d78/fb7 [1315407,78759] 0 2024-01-17T23:41:47.749 INFO:tasks.workunit.client.0.smithi067.stdout:7/545: mknod d4/d25/d39/d8a/d92/c9f 0 2024-01-17T23:41:48.145 INFO:tasks.workunit.client.0.smithi067.stdout:9/461: rename d3/d15 to d3/d6/da4 0 2024-01-17T23:41:48.203 INFO:tasks.workunit.client.0.smithi067.stdout:9/462: dwrite d3/d6/d2a/d34/d42/f6b [4194304,4194304] 0 2024-01-17T23:41:48.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/509: dread d5/d1f/f64 [0,4194304] 0 2024-01-17T23:41:48.236 INFO:tasks.workunit.client.0.smithi067.stdout:2/510: write d5/d1f/d16/d7d/fa2 [2345356,67259] 0 2024-01-17T23:41:48.306 INFO:tasks.workunit.client.0.smithi067.stdout:6/596: getdents d6/d9/d84 0 2024-01-17T23:41:48.306 INFO:tasks.workunit.client.0.smithi067.stdout:6/597: chown d6/d9/d3e/f92 20 1 2024-01-17T23:41:48.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/598: dwrite d6/d9/d30/d58/fa3 [0,4194304] 0 2024-01-17T23:41:48.406 INFO:tasks.workunit.client.0.smithi067.stdout:7/546: symlink d4/d4b/d63/d9c/la0 0 2024-01-17T23:41:48.406 INFO:tasks.workunit.client.0.smithi067.stdout:7/547: write d4/de/f14 [5185446,124634] 0 2024-01-17T23:41:48.415 INFO:tasks.workunit.client.0.smithi067.stdout:7/548: dread d4/d16/f1e [0,4194304] 0 2024-01-17T23:41:48.415 INFO:tasks.workunit.client.0.smithi067.stdout:7/549: fsync d4/d25/f90 0 2024-01-17T23:41:48.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/525: rename d3/d8/l22 to d3/d5/d93/lac 0 2024-01-17T23:41:48.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/526: dwrite d3/d4e/f85 [0,4194304] 0 2024-01-17T23:41:48.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/527: stat d3/d8/f13 0 2024-01-17T23:41:48.742 INFO:tasks.workunit.client.0.smithi067.stdout:9/463: mkdir d3/d6/d2a/d34/d42/d9c/da5 0 2024-01-17T23:41:48.742 INFO:tasks.workunit.client.0.smithi067.stdout:9/464: dread - d3/d6/d2a/d34/d42/f8e zero size 2024-01-17T23:41:48.905 INFO:tasks.workunit.client.0.smithi067.stdout:2/511: creat d5/d1f/d2a/d55/fba x:0 0 0 2024-01-17T23:41:48.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/512: dwrite d5/d1f/d2a/d55/fba [0,4194304] 0 2024-01-17T23:41:48.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/513: fsync d5/d1f/d2a/d54/d8/f45 0 2024-01-17T23:41:49.519 INFO:tasks.workunit.client.0.smithi067.stdout:7/550: creat d4/d25/d39/d46/d78/d93/fa1 x:0 0 0 2024-01-17T23:41:49.536 INFO:tasks.workunit.client.0.smithi067.stdout:7/551: write d4/d25/f33 [3504702,114708] 0 2024-01-17T23:41:49.536 INFO:tasks.workunit.client.0.smithi067.stdout:7/552: truncate d4/d25/d39/d8a/f97 427524 0 2024-01-17T23:41:49.647 INFO:tasks.workunit.client.0.smithi067.stdout:4/528: symlink d3/d5/d93/d9e/lad 0 2024-01-17T23:41:49.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/465: stat d3/d6/l8 0 2024-01-17T23:41:49.979 INFO:tasks.workunit.client.0.smithi067.stdout:2/514: mkdir d5/d1f/d98/d9f/dbb 0 2024-01-17T23:41:49.979 INFO:tasks.workunit.client.0.smithi067.stdout:2/515: dread - d5/d1f/d2a/d54/d8/d4c/d84/f89 zero size 2024-01-17T23:41:50.294 INFO:tasks.workunit.client.0.smithi067.stdout:4/529: unlink d3/d8/de/d20/l9a 0 2024-01-17T23:41:50.471 INFO:tasks.workunit.client.0.smithi067.stdout:9/466: mkdir d3/d6/d2a/d34/d42/d9c/da5/da6 0 2024-01-17T23:41:50.524 INFO:tasks.workunit.client.0.smithi067.stdout:2/516: truncate d5/d1f/d35/f5c 133720 0 2024-01-17T23:41:51.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/577: sync 2024-01-17T23:41:51.224 INFO:tasks.workunit.client.0.smithi067.stdout:0/578: chown d3/d5/d1a/d1c/d4e/lda 0 1 2024-01-17T23:41:51.681 INFO:tasks.workunit.client.0.smithi067.stdout:0/579: mknod d3/d6/dd/dc4/ce4 0 2024-01-17T23:41:52.191 INFO:tasks.workunit.client.0.smithi067.stdout:6/599: dwrite d6/d9/d30/d4c/d8d/f99 [0,4194304] 0 2024-01-17T23:41:52.458 INFO:tasks.workunit.client.0.smithi067.stdout:5/494: rename d10/d24/d25/c33 to d10/d24/d46/c9e 0 2024-01-17T23:41:52.458 INFO:tasks.workunit.client.0.smithi067.stdout:4/530: getdents d3/d8/de/d20 0 2024-01-17T23:41:52.474 INFO:tasks.workunit.client.0.smithi067.stdout:5/495: dread d10/d24/d25/d5c/d7e/f87 [0,4194304] 0 2024-01-17T23:41:52.474 INFO:tasks.workunit.client.0.smithi067.stdout:5/496: stat d10/d24/d46/d4a/d50/d5a/c8e 0 2024-01-17T23:41:52.474 INFO:tasks.workunit.client.0.smithi067.stdout:7/553: dwrite d4/f5d [0,4194304] 0 2024-01-17T23:41:52.488 INFO:tasks.workunit.client.0.smithi067.stdout:5/497: dread d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:41:52.504 INFO:tasks.workunit.client.0.smithi067.stdout:5/498: dread d10/d24/f2d [4194304,4194304] 0 2024-01-17T23:41:53.322 INFO:tasks.workunit.client.0.smithi067.stdout:6/600: mkdir d6/d18/d2e/d61/d9a/dd1 0 2024-01-17T23:41:53.364 INFO:tasks.workunit.client.0.smithi067.stdout:2/517: write d5/d1f/d2a/d54/f11 [1043272,33875] 0 2024-01-17T23:41:53.380 INFO:tasks.workunit.client.0.smithi067.stdout:2/518: dread d5/d1f/d2a/d55/f71 [0,4194304] 0 2024-01-17T23:41:53.380 INFO:tasks.workunit.client.0.smithi067.stdout:2/519: truncate d5/d1f/d2a/d54/d8/d32/f81 1027342 0 2024-01-17T23:41:53.380 INFO:tasks.workunit.client.0.smithi067.stdout:2/520: write d5/d1f/d2a/d54/d8/d4c/d84/f89 [869081,41279] 0 2024-01-17T23:41:53.473 INFO:tasks.workunit.client.0.smithi067.stdout:1/550: rename d0/d7/d1c/c24 to d0/d7/d93/cac 0 2024-01-17T23:41:53.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/531: fsync d3/d26/d34/d3a/f7f 0 2024-01-17T23:41:53.540 INFO:tasks.workunit.client.0.smithi067.stdout:4/532: dwrite d3/d26/f43 [0,4194304] 0 2024-01-17T23:41:53.674 INFO:tasks.workunit.client.0.smithi067.stdout:0/580: dwrite d3/d5/d1a/f71 [4194304,4194304] 0 2024-01-17T23:41:53.692 INFO:tasks.workunit.client.0.smithi067.stdout:0/581: dread d3/d6/f1e [0,4194304] 0 2024-01-17T23:41:53.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/554: mkdir d4/de/d41/da2 0 2024-01-17T23:41:53.942 INFO:tasks.workunit.client.0.smithi067.stdout:5/499: write d10/f1f [5975245,54150] 0 2024-01-17T23:41:53.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/500: dwrite d10/f88 [0,4194304] 0 2024-01-17T23:41:54.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/521: truncate d5/d1f/d2a/d54/d8/d4c/d84/f8c 5138245 0 2024-01-17T23:41:54.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/599: rename d6/fb1 to d6/d19/d22/d25/d53/fce 0 2024-01-17T23:41:54.416 INFO:tasks.workunit.client.0.smithi067.stdout:1/551: rename d0/d7/d13/d3d/d48/f9b to d0/d7/d13/d3d/d48/fad 0 2024-01-17T23:41:54.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/552: dread d0/d7/d13/d2e/f46 [0,4194304] 0 2024-01-17T23:41:54.664 INFO:tasks.workunit.client.0.smithi067.stdout:4/533: creat d3/d40/fae x:0 0 0 2024-01-17T23:41:54.879 INFO:tasks.workunit.client.0.smithi067.stdout:0/582: rmdir d3/d6/dd/d43/db2 0 2024-01-17T23:41:55.031 INFO:tasks.workunit.client.0.smithi067.stdout:7/555: creat d4/d4b/d63/d9c/fa3 x:0 0 0 2024-01-17T23:41:55.121 INFO:tasks.workunit.client.0.smithi067.stdout:6/601: rmdir d6/d9/d30/d4c/d82 39 2024-01-17T23:41:55.129 INFO:tasks.workunit.client.0.smithi067.stdout:6/602: dread d6/d18/d2e/f77 [0,4194304] 0 2024-01-17T23:41:55.129 INFO:tasks.workunit.client.0.smithi067.stdout:6/603: chown d6/d9/d30 27905947 1 2024-01-17T23:41:55.307 INFO:tasks.workunit.client.0.smithi067.stdout:2/522: rmdir d5/d1f/d16/d7d 39 2024-01-17T23:41:55.915 INFO:tasks.workunit.client.0.smithi067.stdout:1/553: unlink d0/d74/f6a 0 2024-01-17T23:41:55.915 INFO:tasks.workunit.client.0.smithi067.stdout:1/554: readlink d0/d7/d7f/l97 0 2024-01-17T23:41:55.929 INFO:tasks.workunit.client.0.smithi067.stdout:4/534: read d3/d5/f2e [3686671,80779] 0 2024-01-17T23:41:55.941 INFO:tasks.workunit.client.0.smithi067.stdout:1/555: dwrite d0/d74/f8c [0,4194304] 0 2024-01-17T23:41:55.943 INFO:tasks.workunit.client.0.smithi067.stdout:4/535: dread d3/d8/f13 [0,4194304] 0 2024-01-17T23:41:56.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/556: creat d4/d25/d39/d46/d78/d93/fa4 x:0 0 0 2024-01-17T23:41:56.104 INFO:tasks.workunit.client.0.smithi067.stdout:7/557: chown d4/d25/d39/f70 12794901 1 2024-01-17T23:41:56.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/615: rename d0/fd to d0/d13/d4a/fba 0 2024-01-17T23:41:56.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/523: stat d5/l1c 0 2024-01-17T23:41:56.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/556: truncate d0/d7/d13/d3a/f51 2052807 0 2024-01-17T23:41:56.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/557: fsync d0/d7/d13/d3a/d3e/f57 0 2024-01-17T23:41:57.157 INFO:tasks.workunit.client.0.smithi067.stdout:0/583: creat d3/d5/fe5 x:0 0 0 2024-01-17T23:41:57.176 INFO:tasks.workunit.client.0.smithi067.stdout:0/584: dread d3/f11 [0,4194304] 0 2024-01-17T23:41:57.176 INFO:tasks.workunit.client.0.smithi067.stdout:0/585: chown d3/d6/dd/d43/f59 5 1 2024-01-17T23:41:57.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/586: write d3/d6/dd/fd1 [2104269,58289] 0 2024-01-17T23:41:57.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/587: stat d3/d5/l18 0 2024-01-17T23:41:58.737 INFO:tasks.workunit.client.0.smithi067.stdout:9/467: rename d3/l39 to d3/d6/da4/d57/d6a/la7 0 2024-01-17T23:41:58.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/524: rmdir d5/d1f/d98/d9f 39 2024-01-17T23:41:58.793 INFO:tasks.workunit.client.0.smithi067.stdout:2/525: write d5/d1f/d2a/d54/d8/d32/d33/f6f [76929,71048] 0 2024-01-17T23:41:58.793 INFO:tasks.workunit.client.0.smithi067.stdout:2/526: stat d5/d1f/d16/faa 0 2024-01-17T23:41:58.994 INFO:tasks.workunit.client.0.smithi067.stdout:1/558: mknod d0/d7/d1c/cae 0 2024-01-17T23:41:59.147 INFO:tasks.workunit.client.0.smithi067.stdout:4/536: mknod d3/d26/d34/d3a/caf 0 2024-01-17T23:41:59.215 INFO:tasks.workunit.client.0.smithi067.stdout:0/588: mkdir d3/d64/d7d/de6 0 2024-01-17T23:41:59.490 INFO:tasks.workunit.client.0.smithi067.stdout:8/600: dwrite d6/d19/f3a [0,4194304] 0 2024-01-17T23:41:59.590 INFO:tasks.workunit.client.0.smithi067.stdout:3/616: unlink d0/l2b 0 2024-01-17T23:41:59.892 INFO:tasks.workunit.client.0.smithi067.stdout:6/604: write d6/fb [9378718,81868] 0 2024-01-17T23:41:59.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/501: rename d10/d24/d25/d5c/f84 to d10/d24/d59/d5d/f9f 0 2024-01-17T23:41:59.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/502: fsync d10/d24/d25/f35 0 2024-01-17T23:41:59.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/503: getdents d10/d24/d59/d8c 0 2024-01-17T23:42:00.239 INFO:tasks.workunit.client.0.smithi067.stdout:2/527: rmdir d5/d1f/d2a/d54/d8 39 2024-01-17T23:42:00.384 INFO:tasks.workunit.client.0.smithi067.stdout:4/537: mkdir d3/d8/d35/db0 0 2024-01-17T23:42:00.384 INFO:tasks.workunit.client.0.smithi067.stdout:0/589: symlink d3/d64/d7d/de6/le7 0 2024-01-17T23:42:00.751 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:42:48.968 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.754 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:42:48.972 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.793 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:42:49.011 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.810 INFO:tasks.workunit.client.0.smithi067.stdout:8/601: mkdir d6/d19/dcf 0 2024-01-17T23:42:00.810 INFO:tasks.workunit.client.0.smithi067.stdout:3/617: mkdir d0/d37/dbb 0 2024-01-17T23:42:00.810 INFO:tasks.workunit.client.0.smithi067.stdout:8/602: dread - d6/d19/fc8 zero size 2024-01-17T23:42:00.810 INFO:tasks.workunit.client.0.smithi067.stdout:3/618: chown d0/d13/d4a/d75/caf 6853973 1 2024-01-17T23:42:00.879 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:42:49.190 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.886 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:42:49.197 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.890 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:42:49.201 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.894 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:42:49.206 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.930 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:42:49.241 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:00.957 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:42:49.269 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:42:01.017 INFO:tasks.workunit.client.0.smithi067.stdout:6/605: mknod d6/d9/d30/d4c/d82/cd2 0 2024-01-17T23:42:01.326 INFO:tasks.workunit.client.0.smithi067.stdout:5/504: mknod d10/d24/d59/d5d/d43/ca0 0 2024-01-17T23:42:01.343 INFO:tasks.workunit.client.0.smithi067.stdout:5/505: dread d10/d53/f62 [0,4194304] 0 2024-01-17T23:42:01.458 INFO:tasks.workunit.client.0.smithi067.stdout:2/528: symlink d5/d1f/d2a/d54/d8/d4c/lbc 0 2024-01-17T23:42:01.923 INFO:tasks.workunit.client.0.smithi067.stdout:6/606: mknod d6/d9/d1c/d1e/d43/d86/da5/cd3 0 2024-01-17T23:42:02.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/559: rename d0/d7/c43 to d0/d7/d93/caf 0 2024-01-17T23:42:02.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/560: chown d0/d7/d1c/l9d 2 1 2024-01-17T23:42:02.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/506: creat d10/d24/d46/d4a/fa1 x:0 0 0 2024-01-17T23:42:02.211 INFO:tasks.workunit.client.0.smithi067.stdout:2/529: readlink d5/d1f/d2a/d54/d39/l50 0 2024-01-17T23:42:02.211 INFO:tasks.workunit.client.0.smithi067.stdout:2/530: chown d5/d1f/d35/f6d 10463598 1 2024-01-17T23:42:02.289 INFO:tasks.workunit.client.0.smithi067.stdout:7/558: sync 2024-01-17T23:42:02.683 INFO:tasks.workunit.client.0.smithi067.stdout:9/468: rename d3/d6/da4/d57 to d3/d6/d11/d50/d84/da8 0 2024-01-17T23:42:02.683 INFO:tasks.workunit.client.0.smithi067.stdout:9/469: chown d3/d6/d2a/d34/d42/d9c/da5/da6 639429 1 2024-01-17T23:42:03.011 INFO:tasks.workunit.client.0.smithi067.stdout:5/507: creat d10/d24/d46/d4a/d50/d5a/fa2 x:0 0 0 2024-01-17T23:42:03.529 INFO:tasks.workunit.client.0.smithi067.stdout:2/531: mkdir d5/d1f/d2a/d55/dbd 0 2024-01-17T23:42:03.529 INFO:tasks.workunit.client.0.smithi067.stdout:7/559: unlink d4/d25/d39/d46/d60/l8f 0 2024-01-17T23:42:03.559 INFO:tasks.workunit.client.0.smithi067.stdout:7/560: dwrite d4/d16/f6e [0,4194304] 0 2024-01-17T23:42:03.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/470: mkdir d3/d6/d11/d50/d84/da8/da9 0 2024-01-17T23:42:03.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/471: write d3/d6/d2e/f99 [1084053,86085] 0 2024-01-17T23:42:03.994 INFO:tasks.workunit.client.0.smithi067.stdout:2/532: unlink d5/d1f/d2a/d54/d8/ca4 0 2024-01-17T23:42:04.220 INFO:tasks.workunit.client.0.smithi067.stdout:7/561: creat d4/de/fa5 x:0 0 0 2024-01-17T23:42:04.260 INFO:tasks.workunit.client.0.smithi067.stdout:7/562: dwrite d4/d16/f29 [0,4194304] 0 2024-01-17T23:42:04.260 INFO:tasks.workunit.client.0.smithi067.stdout:7/563: creat d4/d25/d39/d8a/fa6 x:0 0 0 2024-01-17T23:42:04.260 INFO:tasks.workunit.client.0.smithi067.stdout:7/564: dread - d4/de/fa5 zero size 2024-01-17T23:42:04.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/472: readlink d3/da/l14 0 2024-01-17T23:42:04.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/473: chown d3/d6/d2a/da2/l65 236701708 1 2024-01-17T23:42:04.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/474: stat d3/d6/d11/d50/l2f 0 2024-01-17T23:42:04.534 INFO:tasks.workunit.client.0.smithi067.stdout:5/508: unlink d10/f79 0 2024-01-17T23:42:04.534 INFO:tasks.workunit.client.0.smithi067.stdout:5/509: fdatasync d10/d24/d46/d4a/d63/f8b 0 2024-01-17T23:42:04.651 INFO:tasks.workunit.client.0.smithi067.stdout:2/533: creat d5/d1f/d2a/d54/d8/db5/fbe x:0 0 0 2024-01-17T23:42:05.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/565: unlink d4/de/d41/d7d/d81/c9e 0 2024-01-17T23:42:05.658 INFO:tasks.workunit.client.0.smithi067.stdout:9/475: creat d3/d6/d11/faa x:0 0 0 2024-01-17T23:42:05.696 INFO:tasks.workunit.client.0.smithi067.stdout:9/476: dwrite d3/d6/d11/d50/d84/fa0 [4194304,4194304] 0 2024-01-17T23:42:05.707 INFO:tasks.workunit.client.0.smithi067.stdout:9/477: dread d3/d6/f56 [0,4194304] 0 2024-01-17T23:42:05.707 INFO:tasks.workunit.client.0.smithi067.stdout:9/478: dread - d3/f85 zero size 2024-01-17T23:42:05.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/510: link d10/d53/l56 d10/d24/d25/d5c/la3 0 2024-01-17T23:42:05.835 INFO:tasks.workunit.client.0.smithi067.stdout:2/534: mkdir d5/d1f/d2a/d54/d8/d4c/dbf 0 2024-01-17T23:42:06.118 INFO:tasks.workunit.client.0.smithi067.stdout:4/538: write d3/d8/de/d20/f5e [1435329,31475] 0 2024-01-17T23:42:06.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/479: rename d3/d6/d2a/d34/f3e to d3/d6/d11/d50/d84/da8/fab 0 2024-01-17T23:42:06.303 INFO:tasks.workunit.client.0.smithi067.stdout:0/590: dwrite d3/d5/d1a/d1c/d4d/f65 [0,4194304] 0 2024-01-17T23:42:06.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/511: mkdir d10/d53/da4 0 2024-01-17T23:42:06.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/512: stat d10/d24/f5f 0 2024-01-17T23:42:06.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/619: sync 2024-01-17T23:42:06.538 INFO:tasks.workunit.client.0.smithi067.stdout:3/620: stat d0/d13/d4a/d82/da6 0 2024-01-17T23:42:06.538 INFO:tasks.workunit.client.0.smithi067.stdout:8/603: sync 2024-01-17T23:42:06.654 INFO:tasks.workunit.client.0.smithi067.stdout:4/539: creat d3/d8/d35/fb1 x:0 0 0 2024-01-17T23:42:06.654 INFO:tasks.workunit.client.0.smithi067.stdout:4/540: readlink d3/d26/la5 0 2024-01-17T23:42:07.103 INFO:tasks.workunit.client.0.smithi067.stdout:0/591: mkdir d3/d64/d82/de8 0 2024-01-17T23:42:07.236 INFO:tasks.workunit.client.0.smithi067.stdout:5/513: mknod d10/d53/d9a/ca5 0 2024-01-17T23:42:07.851 INFO:tasks.workunit.client.0.smithi067.stdout:0/592: link d3/d5/d1a/d1c/d4e/d7c/l81 d3/d6/dd/le9 0 2024-01-17T23:42:07.851 INFO:tasks.workunit.client.0.smithi067.stdout:0/593: fdatasync d3/d5/f9 0 2024-01-17T23:42:08.127 INFO:tasks.workunit.client.0.smithi067.stdout:0/594: unlink d3/d6/f6d 0 2024-01-17T23:42:08.635 INFO:tasks.workunit.client.0.smithi067.stdout:3/621: creat d0/fbc x:0 0 0 2024-01-17T23:42:08.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/566: truncate d4/d16/f29 1639955 0 2024-01-17T23:42:08.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/567: fsync d4/d25/d39/f54 0 2024-01-17T23:42:09.095 INFO:tasks.workunit.client.0.smithi067.stdout:0/595: link d3/d6/c79 d3/d64/cea 0 2024-01-17T23:42:09.540 INFO:tasks.workunit.client.0.smithi067.stdout:3/622: symlink d0/lbd 0 2024-01-17T23:42:10.167 INFO:tasks.workunit.client.0.smithi067.stdout:3/623: truncate d0/d17/f29 1786303 0 2024-01-17T23:42:10.167 INFO:tasks.workunit.client.0.smithi067.stdout:4/541: creat d3/d26/d34/fb2 x:0 0 0 2024-01-17T23:42:10.547 INFO:tasks.workunit.client.0.smithi067.stdout:7/568: mknod d4/d25/ca7 0 2024-01-17T23:42:10.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/624: creat d0/d12/d59/dae/fbe x:0 0 0 2024-01-17T23:42:10.555 INFO:tasks.workunit.client.0.smithi067.stdout:3/625: dread d0/d17/d69/d6e/f84 [0,4194304] 0 2024-01-17T23:42:10.555 INFO:tasks.workunit.client.0.smithi067.stdout:3/626: write d0/f94 [1271595,102997] 0 2024-01-17T23:42:10.939 INFO:tasks.workunit.client.0.smithi067.stdout:2/535: rename d5/d1f/d2a/d54/d39/l50 to d5/d1f/lc0 0 2024-01-17T23:42:11.001 INFO:tasks.workunit.client.0.smithi067.stdout:1/561: rmdir d0/d69 39 2024-01-17T23:42:11.001 INFO:tasks.workunit.client.0.smithi067.stdout:6/607: sync 2024-01-17T23:42:11.001 INFO:tasks.workunit.client.0.smithi067.stdout:1/562: write d0/d62/f9c [958463,73553] 0 2024-01-17T23:42:11.001 INFO:tasks.workunit.client.0.smithi067.stdout:1/563: stat d0/d74/d31/l56 0 2024-01-17T23:42:11.021 INFO:tasks.workunit.client.0.smithi067.stdout:7/569: dread d4/d25/d39/d46/d78/f86 [0,4194304] 0 2024-01-17T23:42:11.202 INFO:tasks.workunit.client.0.smithi067.stdout:3/627: truncate d0/f2a 3814005 0 2024-01-17T23:42:11.489 INFO:tasks.workunit.client.0.smithi067.stdout:8/604: rename d6/d26/d9b to d6/d26/d7c/dd0 0 2024-01-17T23:42:11.489 INFO:tasks.workunit.client.0.smithi067.stdout:5/514: rename d10/d24/d25 to d10/d24/d25/d5c/d7e/d7f/da6 22 2024-01-17T23:42:11.489 INFO:tasks.workunit.client.0.smithi067.stdout:5/515: truncate d10/f6e 4250207 0 2024-01-17T23:42:11.685 INFO:tasks.workunit.client.0.smithi067.stdout:1/564: creat d0/d7/d7f/d82/d35/fb0 x:0 0 0 2024-01-17T23:42:11.685 INFO:tasks.workunit.client.0.smithi067.stdout:1/565: fdatasync d0/fa5 0 2024-01-17T23:42:12.114 INFO:tasks.workunit.client.0.smithi067.stdout:0/596: rename d3/d6/dd/d43/fb9 to d3/d5/d32/d7f/dc6/feb 0 2024-01-17T23:42:12.152 INFO:tasks.workunit.client.0.smithi067.stdout:5/516: creat d10/d24/d25/d5c/d7e/fa7 x:0 0 0 2024-01-17T23:42:12.164 INFO:tasks.workunit.client.0.smithi067.stdout:5/517: dread d10/d24/d25/f35 [0,4194304] 0 2024-01-17T23:42:12.164 INFO:tasks.workunit.client.0.smithi067.stdout:5/518: write d10/d24/d59/d5d/f95 [547035,2518] 0 2024-01-17T23:42:12.266 INFO:tasks.workunit.client.0.smithi067.stdout:2/536: creat d5/d1f/d2a/d54/d39/d68/fc1 x:0 0 0 2024-01-17T23:42:12.266 INFO:tasks.workunit.client.0.smithi067.stdout:2/537: chown d5/d1f/l4d 503533 1 2024-01-17T23:42:12.300 INFO:tasks.workunit.client.0.smithi067.stdout:4/542: dwrite d3/d8/de/f54 [0,4194304] 0 2024-01-17T23:42:12.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/570: mkdir d4/d25/d39/d46/da8 0 2024-01-17T23:42:12.811 INFO:tasks.workunit.client.0.smithi067.stdout:9/480: sync 2024-01-17T23:42:13.413 INFO:tasks.workunit.client.0.smithi067.stdout:2/538: creat d5/d1f/d2a/d54/d8/d4c/fc2 x:0 0 0 2024-01-17T23:42:13.644 INFO:tasks.workunit.client.0.smithi067.stdout:3/628: sync 2024-01-17T23:42:13.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/605: write d6/d19/d22/d25/d53/d54/fad [1648728,106130] 0 2024-01-17T23:42:13.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/606: write d6/db/d58/d5f/dc0/fb5 [638304,60007] 0 2024-01-17T23:42:13.695 INFO:tasks.workunit.client.0.smithi067.stdout:3/629: dwrite d0/d17/fa8 [0,4194304] 0 2024-01-17T23:42:13.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:13.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:14.183 INFO:tasks.workunit.client.0.smithi067.stdout:1/566: getdents d0/d7/d13/d77/d95 0 2024-01-17T23:42:14.183 INFO:tasks.workunit.client.0.smithi067.stdout:1/567: chown d0/d7/d13/f50 31 1 2024-01-17T23:42:14.551 INFO:tasks.workunit.client.0.smithi067.stdout:7/571: mkdir d4/de/d41/d7d/d81/da9 0 2024-01-17T23:42:14.551 INFO:tasks.workunit.client.0.smithi067.stdout:7/572: chown d4/d4b 20 1 2024-01-17T23:42:14.597 INFO:tasks.workunit.client.0.smithi067.stdout:7/573: dwrite d4/d25/d39/f70 [0,4194304] 0 2024-01-17T23:42:14.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/481: dread d3/d6/d11/d50/f77 [0,4194304] 0 2024-01-17T23:42:14.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/482: dread - d3/d6/d2e/f9b zero size 2024-01-17T23:42:14.844 INFO:tasks.workunit.client.0.smithi067.stdout:9/483: dwrite d3/d6/d2a/da2/f91 [0,4194304] 0 2024-01-17T23:42:14.844 INFO:tasks.workunit.client.0.smithi067.stdout:9/484: chown d3/d6/l9d 3957 1 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:2/539: mknod d5/d86/cc3 0 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/543: write d3/d5/fc [2760447,51306] 0 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/607: dread - d6/d26/d7c/dd0/fa4 zero size 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:2/540: getdents d5/d1f/d2a 0 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/608: truncate d6/d26/d7c/fc4 348 0 2024-01-17T23:42:15.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/609: read d6/db/f41 [789614,61242] 0 2024-01-17T23:42:15.199 INFO:tasks.workunit.client.0.smithi067.stdout:2/541: dwrite d5/d1f/f43 [4194304,4194304] 0 2024-01-17T23:42:15.199 INFO:tasks.workunit.client.0.smithi067.stdout:2/542: write d5/d1f/d2a/d54/d8/d4c/d84/f89 [1811285,126113] 0 2024-01-17T23:42:15.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/630: unlink d0/d13/d1a/f2e 0 2024-01-17T23:42:15.832 INFO:tasks.workunit.client.0.smithi067.stdout:1/568: fsync d0/d7/f36 0 2024-01-17T23:42:16.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/574: truncate d4/fd 3472188 0 2024-01-17T23:42:16.154 INFO:tasks.workunit.client.0.smithi067.stdout:7/575: dwrite d4/f65 [0,4194304] 0 2024-01-17T23:42:16.440 INFO:tasks.workunit.client.0.smithi067.stdout:9/485: symlink d3/d6/d47/d6d/lac 0 2024-01-17T23:42:16.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/608: rename d6/d9/d3e/d9e to d6/d9/d1c/d1e/dd4 0 2024-01-17T23:42:16.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/609: write d6/d9/d30/f70 [471678,21218] 0 2024-01-17T23:42:16.812 INFO:tasks.workunit.client.0.smithi067.stdout:8/610: link d6/db/d58/fbe d6/d26/fd1 0 2024-01-17T23:42:16.844 INFO:tasks.workunit.client.0.smithi067.stdout:8/611: dwrite d6/d19/d22/d25/d53/f75 [0,4194304] 0 2024-01-17T23:42:16.844 INFO:tasks.workunit.client.0.smithi067.stdout:8/612: dread - d6/d19/d22/d25/d53/d65/f78 zero size 2024-01-17T23:42:16.857 INFO:tasks.workunit.client.0.smithi067.stdout:8/613: write d6/d19/d22/fa8 [395958,81861] 0 2024-01-17T23:42:17.103 INFO:tasks.workunit.client.0.smithi067.stdout:3/631: mknod d0/d13/d4a/d82/da6/cbf 0 2024-01-17T23:42:17.203 INFO:tasks.workunit.client.0.smithi067.stdout:1/569: mknod d0/d7/d13/d3a/d75/cb1 0 2024-01-17T23:42:17.689 INFO:tasks.workunit.client.0.smithi067.stdout:0/597: rename d3/d5/d1a/d1c/d4e/d7c/l81 to d3/d75/lec 0 2024-01-17T23:42:17.689 INFO:tasks.workunit.client.0.smithi067.stdout:0/598: write d3/d6/dd/fb8 [37285,28743] 0 2024-01-17T23:42:17.998 INFO:tasks.workunit.client.0.smithi067.stdout:4/544: creat d3/d26/d34/d3a/d53/fb3 x:0 0 0 2024-01-17T23:42:18.034 INFO:tasks.workunit.client.0.smithi067.stdout:4/545: dwrite d3/d5/fc [4194304,4194304] 0 2024-01-17T23:42:18.139 INFO:tasks.workunit.client.0.smithi067.stdout:5/519: sync 2024-01-17T23:42:18.447 INFO:tasks.workunit.client.0.smithi067.stdout:2/543: write d5/d1f/d16/d7d/fa2 [487775,79914] 0 2024-01-17T23:42:18.501 INFO:tasks.workunit.client.0.smithi067.stdout:8/614: mknod d6/d26/d3e/da6/cd2 0 2024-01-17T23:42:18.854 INFO:tasks.workunit.client.0.smithi067.stdout:3/632: chown d0/d13/f19 4990965 1 2024-01-17T23:42:18.983 INFO:tasks.workunit.client.0.smithi067.stdout:1/570: mkdir d0/d7/d13/d3a/d3e/db2 0 2024-01-17T23:42:18.983 INFO:tasks.workunit.client.0.smithi067.stdout:1/571: dread - d0/d7/d13/d3a/d3e/f57 zero size 2024-01-17T23:42:18.996 INFO:tasks.workunit.client.0.smithi067.stdout:1/572: dread d0/d7/d13/d3a/f59 [0,4194304] 0 2024-01-17T23:42:19.030 INFO:tasks.workunit.client.0.smithi067.stdout:7/576: dwrite d4/f5b [0,4194304] 0 2024-01-17T23:42:19.062 INFO:tasks.workunit.client.0.smithi067.stdout:9/486: write d3/d6/d11/d50/f77 [728441,45010] 0 2024-01-17T23:42:20.017 INFO:tasks.workunit.client.0.smithi067.stdout:0/599: mknod d3/d5/d32/d7f/dc6/ced 0 2024-01-17T23:42:20.017 INFO:tasks.workunit.client.0.smithi067.stdout:0/600: fsync d3/d6/dd/f69 0 2024-01-17T23:42:20.017 INFO:tasks.workunit.client.0.smithi067.stdout:0/601: dread - d3/d5/d1a/d1c/d4e/f6f zero size 2024-01-17T23:42:20.117 INFO:tasks.workunit.client.0.smithi067.stdout:6/610: getdents d6/d9/d30/d4c/d8d 0 2024-01-17T23:42:20.117 INFO:tasks.workunit.client.0.smithi067.stdout:6/611: write d6/d9/f31 [223133,40981] 0 2024-01-17T23:42:20.118 INFO:tasks.workunit.client.0.smithi067.stdout:6/612: dread - d6/d18/d44/d51/fbb zero size 2024-01-17T23:42:20.118 INFO:tasks.workunit.client.0.smithi067.stdout:6/613: truncate d6/d9/d30/d4c/d8d/f93 149833 0 2024-01-17T23:42:20.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/614: dread d6/d9/d30/d58/fa2 [0,4194304] 0 2024-01-17T23:42:20.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/615: fsync d6/d9/d1c/faf 0 2024-01-17T23:42:20.152 INFO:tasks.workunit.client.0.smithi067.stdout:6/616: dwrite d6/d9/d1c/d1e/d43/d86/da5/fc6 [0,4194304] 0 2024-01-17T23:42:20.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/617: dwrite d6/d9/d65/da4/fb8 [0,4194304] 0 2024-01-17T23:42:20.183 INFO:tasks.workunit.client.0.smithi067.stdout:6/618: chown d6/d9/d30/d4c/d8d/fcf 453249 1 2024-01-17T23:42:20.792 INFO:tasks.workunit.client.0.smithi067.stdout:8/615: symlink d6/d19/d22/d25/d53/dbd/ld3 0 2024-01-17T23:42:20.793 INFO:tasks.workunit.client.0.smithi067.stdout:8/616: write d6/d19/d22/d25/d53/d65/f78 [343613,117769] 0 2024-01-17T23:42:20.793 INFO:tasks.workunit.client.0.smithi067.stdout:8/617: creat d6/d19/d22/d25/d53/d65/fd4 x:0 0 0 2024-01-17T23:42:20.952 INFO:tasks.workunit.client.0.smithi067.stdout:1/573: symlink d0/d7/d13/d77/lb3 0 2024-01-17T23:42:20.955 INFO:tasks.workunit.client.0.smithi067.stdout:1/574: read d0/d7/d13/d3a/d45/f5a [241685,128886] 0 2024-01-17T23:42:20.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/575: dwrite d0/d7/d13/d3a/f5d [0,4194304] 0 2024-01-17T23:42:21.013 INFO:tasks.workunit.client.0.smithi067.stdout:1/576: dwrite d0/f27 [4194304,4194304] 0 2024-01-17T23:42:21.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/577: truncate d4/d25/f33 2745397 0 2024-01-17T23:42:21.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/487: mknod d3/d6/d2a/d34/cad 0 2024-01-17T23:42:21.583 INFO:tasks.workunit.client.0.smithi067.stdout:0/602: mkdir d3/d5/d32/d9f/dee 0 2024-01-17T23:42:21.583 INFO:tasks.workunit.client.0.smithi067.stdout:0/603: fsync d3/d6/fdc 0 2024-01-17T23:42:22.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/619: creat d6/d9/d1c/d1e/d43/d86/fd5 x:0 0 0 2024-01-17T23:42:22.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/546: getdents d3/d8/d35/d36 0 2024-01-17T23:42:22.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/547: write d3/d26/d34/f7b [642212,24649] 0 2024-01-17T23:42:22.260 INFO:tasks.workunit.client.0.smithi067.stdout:2/544: mknod d5/d1f/d2a/d54/d39/d68/cc4 0 2024-01-17T23:42:22.448 INFO:tasks.workunit.client.0.smithi067.stdout:8/618: mkdir d6/d26/d56/dd5 0 2024-01-17T23:42:22.448 INFO:tasks.workunit.client.0.smithi067.stdout:8/619: write d6/d26/d3e/d87/f94 [612608,67067] 0 2024-01-17T23:42:22.539 INFO:tasks.workunit.client.0.smithi067.stdout:3/633: mknod d0/d34/d35/d65/cc0 0 2024-01-17T23:42:22.565 INFO:tasks.workunit.client.0.smithi067.stdout:3/634: dwrite d0/f5 [4194304,4194304] 0 2024-01-17T23:42:22.798 INFO:tasks.workunit.client.0.smithi067.stdout:1/577: dread d0/d7/f61 [0,4194304] 0 2024-01-17T23:42:22.951 INFO:tasks.workunit.client.0.smithi067.stdout:7/578: creat d4/d25/d39/d8a/d92/faa x:0 0 0 2024-01-17T23:42:23.216 INFO:tasks.workunit.client.0.smithi067.stdout:9/488: truncate d3/d6/d11/d50/d84/fa0 285808 0 2024-01-17T23:42:23.216 INFO:tasks.workunit.client.0.smithi067.stdout:9/489: write d3/d6/f9f [2054400,120267] 0 2024-01-17T23:42:23.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/520: dwrite d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:42:23.642 INFO:tasks.workunit.client.0.smithi067.stdout:4/548: link d3/d8/fa4 d3/d8/de/d20/fb4 0 2024-01-17T23:42:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/545: rename d5/d1f/d16/f20 to d5/d1f/d98/fc5 0 2024-01-17T23:42:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/546: fsync f4 0 2024-01-17T23:42:23.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/547: dread - d5/d1f/d2a/d73/d95/fb7 zero size 2024-01-17T23:42:23.791 INFO:tasks.workunit.client.0.smithi067.stdout:8/620: symlink d6/d26/d3e/d6c/ld6 0 2024-01-17T23:42:23.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/621: write d6/f8e [410330,111160] 0 2024-01-17T23:42:23.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/622: write d6/d26/d3e/d87/f94 [1098304,32451] 0 2024-01-17T23:42:23.919 INFO:tasks.workunit.client.0.smithi067.stdout:3/635: symlink d0/d13/d1a/d38/lc1 0 2024-01-17T23:42:23.947 INFO:tasks.workunit.client.0.smithi067.stdout:3/636: dwrite d0/f80 [0,4194304] 0 2024-01-17T23:42:25.949 INFO:tasks.workunit.client.0.smithi067.stdout:0/604: symlink d3/d5/d1a/lef 0 2024-01-17T23:42:25.949 INFO:tasks.workunit.client.0.smithi067.stdout:0/605: creat d3/d6/dd/ff0 x:0 0 0 2024-01-17T23:42:26.253 INFO:tasks.workunit.client.0.smithi067.stdout:6/620: getdents d6/d18/d2e 0 2024-01-17T23:42:26.253 INFO:tasks.workunit.client.0.smithi067.stdout:6/621: fdatasync d6/f1f 0 2024-01-17T23:42:26.277 INFO:tasks.workunit.client.0.smithi067.stdout:6/622: dwrite d6/d9/d1c/d1e/d43/d86/da5/fc6 [0,4194304] 0 2024-01-17T23:42:26.287 INFO:tasks.workunit.client.0.smithi067.stdout:6/623: read d6/d9/d1c/d1e/f62 [2585275,18271] 0 2024-01-17T23:42:26.299 INFO:tasks.workunit.client.0.smithi067.stdout:6/624: dread d6/f88 [0,4194304] 0 2024-01-17T23:42:26.312 INFO:tasks.workunit.client.0.smithi067.stdout:6/625: write d6/d18/d2e/f50 [3311051,12971] 0 2024-01-17T23:42:26.437 INFO:tasks.workunit.client.0.smithi067.stdout:4/549: creat d3/d8/de/d20/fb5 x:0 0 0 2024-01-17T23:42:26.437 INFO:tasks.workunit.client.0.smithi067.stdout:4/550: dread - d3/d26/f88 zero size 2024-01-17T23:42:26.759 INFO:tasks.workunit.client.0.smithi067.stdout:2/548: mknod d5/d86/cc6 0 2024-01-17T23:42:27.009 INFO:tasks.workunit.client.0.smithi067.stdout:8/623: symlink d6/d19/dcf/ld7 0 2024-01-17T23:42:27.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/637: symlink d0/d13/d4a/d55/lc2 0 2024-01-17T23:42:27.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/638: truncate d0/d13/f8a 1792481 0 2024-01-17T23:42:27.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/639: write d0/d12/d59/fa3 [866461,54182] 0 2024-01-17T23:42:27.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/640: truncate d0/d13/d4a/fb0 608308 0 2024-01-17T23:42:27.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/641: dread d0/d17/fa8 [0,4194304] 0 2024-01-17T23:42:27.272 INFO:tasks.workunit.client.0.smithi067.stdout:3/642: getdents d0/d37/dbb 0 2024-01-17T23:42:27.397 INFO:tasks.workunit.client.0.smithi067.stdout:1/578: unlink d0/d7/d13/d2e/f34 0 2024-01-17T23:42:27.699 INFO:tasks.workunit.client.0.smithi067.stdout:0/606: rmdir d3/d64/d7d 39 2024-01-17T23:42:28.068 INFO:tasks.workunit.client.0.smithi067.stdout:6/626: mkdir d6/d9/d30/d4c/dd6 0 2024-01-17T23:42:28.069 INFO:tasks.workunit.client.0.smithi067.stdout:6/627: chown d6/d9/d30/f46 18557 1 2024-01-17T23:42:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:6/628: dread d6/d18/d2e/f50 [0,4194304] 0 2024-01-17T23:42:28.082 INFO:tasks.workunit.client.0.smithi067.stdout:6/629: write d6/d9/d65/f72 [1000962,8644] 0 2024-01-17T23:42:28.614 INFO:tasks.workunit.client.0.smithi067.stdout:5/521: rename d10/f71 to d10/d24/d59/d5d/fa8 0 2024-01-17T23:42:28.635 INFO:tasks.workunit.client.0.smithi067.stdout:5/522: dread d10/d24/d59/d5d/f41 [0,4194304] 0 2024-01-17T23:42:28.718 INFO:tasks.workunit.client.0.smithi067.stdout:2/549: creat d5/d1f/d16/fc7 x:0 0 0 2024-01-17T23:42:28.912 INFO:tasks.workunit.client.0.smithi067.stdout:3/643: unlink d0/d12/d59/c5d 0 2024-01-17T23:42:29.011 INFO:tasks.workunit.client.0.smithi067.stdout:1/579: truncate d0/d7/d13/d3a/f59 8146629 0 2024-01-17T23:42:29.133 INFO:tasks.workunit.client.0.smithi067.stdout:6/630: unlink d6/d18/f4f 0 2024-01-17T23:42:29.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/607: rename d3/d5/f2b to d3/d5/d1a/d1c/d1d/d2e/d5a/ff1 0 2024-01-17T23:42:29.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/608: chown d3/d5/d1a/d1c/d1d/c46 4017 1 2024-01-17T23:42:29.991 INFO:tasks.workunit.client.0.smithi067.stdout:9/490: sync 2024-01-17T23:42:30.248 INFO:tasks.workunit.client.0.smithi067.stdout:1/580: mknod d0/d7/d13/d3d/d48/cb4 0 2024-01-17T23:42:30.414 INFO:tasks.workunit.client.0.smithi067.stdout:6/631: rename d6/d9/d30/d4c/d8d/f93 to d6/d18/d2e/d7c/fd7 0 2024-01-17T23:42:30.617 INFO:tasks.workunit.client.0.smithi067.stdout:0/609: symlink d3/dbf/lf2 0 2024-01-17T23:42:30.617 INFO:tasks.workunit.client.0.smithi067.stdout:0/610: chown d3/dbf 232 1 2024-01-17T23:42:30.953 INFO:tasks.workunit.client.0.smithi067.stdout:6/632: rename d6/cc to d6/d9/d1c/d1e/d43/d78/dab/cd8 0 2024-01-17T23:42:30.953 INFO:tasks.workunit.client.0.smithi067.stdout:6/633: creat d6/d18/d44/d51/fd9 x:0 0 0 2024-01-17T23:42:31.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/611: mknod d3/d5/d32/dc5/cf3 0 2024-01-17T23:42:31.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/612: creat d3/d6/dd/dc4/ff4 x:0 0 0 2024-01-17T23:42:31.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/613: write d3/d5/d1a/d1c/d4d/faa [389873,72801] 0 2024-01-17T23:42:31.374 INFO:tasks.workunit.client.0.smithi067.stdout:7/579: dwrite d4/d25/d39/d46/f59 [0,4194304] 0 2024-01-17T23:42:32.095 INFO:tasks.workunit.client.0.smithi067.stdout:0/614: getdents d3/d6/dd/d43 0 2024-01-17T23:42:32.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/580: creat d4/d25/d39/d79/d8c/fab x:0 0 0 2024-01-17T23:42:32.211 INFO:tasks.workunit.client.0.smithi067.stdout:7/581: chown d4/de/d41/l4a 17805 1 2024-01-17T23:42:32.211 INFO:tasks.workunit.client.0.smithi067.stdout:7/582: stat d4/de/d41/da2 0 2024-01-17T23:42:32.211 INFO:tasks.workunit.client.0.smithi067.stdout:7/583: creat d4/d4b/fac x:0 0 0 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:0/615: rmdir d3/d5/d32/dc5 39 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:4/551: sync 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:4/552: fsync d3/d8/d35/f3c 0 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:8/624: sync 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:8/625: chown d6/d19/d22/d25/cab 122977897 1 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:8/626: chown d6/d26/f36 152 1 2024-01-17T23:42:32.511 INFO:tasks.workunit.client.0.smithi067.stdout:8/627: read d6/d26/f36 [2025144,81866] 0 2024-01-17T23:42:32.529 INFO:tasks.workunit.client.0.smithi067.stdout:4/553: dread d3/d4e/f85 [0,4194304] 0 2024-01-17T23:42:32.818 INFO:tasks.workunit.client.0.smithi067.stdout:7/584: read d4/f19 [2977786,8066] 0 2024-01-17T23:42:32.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/523: write d10/d24/d59/d5d/f4d [1134354,20157] 0 2024-01-17T23:42:32.843 INFO:tasks.workunit.client.0.smithi067.stdout:2/550: sync 2024-01-17T23:42:33.015 INFO:tasks.workunit.client.0.smithi067.stdout:0/616: unlink d3/d5/d1a/d1c/d4e/d7c/lc0 0 2024-01-17T23:42:33.015 INFO:tasks.workunit.client.0.smithi067.stdout:0/617: write d3/d5/d32/f73 [473448,75389] 0 2024-01-17T23:42:33.069 INFO:tasks.workunit.client.0.smithi067.stdout:0/618: dwrite d3/d5/d1a/d1c/d4d/faa [0,4194304] 0 2024-01-17T23:42:33.146 INFO:tasks.workunit.client.0.smithi067.stdout:8/628: mkdir d6/d26/d3e/d87/dd8 0 2024-01-17T23:42:33.196 INFO:tasks.workunit.client.0.smithi067.stdout:8/629: dwrite d6/d19/fc8 [0,4194304] 0 2024-01-17T23:42:33.307 INFO:tasks.workunit.client.0.smithi067.stdout:4/554: creat d3/d8/de/da6/fb6 x:0 0 0 2024-01-17T23:42:33.697 INFO:tasks.workunit.client.0.smithi067.stdout:9/491: write d3/d6/f7f [5493605,87231] 0 2024-01-17T23:42:33.697 INFO:tasks.workunit.client.0.smithi067.stdout:9/492: readlink d3/d6/d2e/l62 0 2024-01-17T23:42:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:5/524: readlink d10/l23 0 2024-01-17T23:42:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:5/525: dread - d10/d24/d46/d4a/fa1 zero size 2024-01-17T23:42:33.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/526: dread d10/d24/d46/f7c [0,4194304] 0 2024-01-17T23:42:34.269 INFO:tasks.workunit.client.0.smithi067.stdout:2/551: unlink d5/d1f/d16/d7d/fa2 0 2024-01-17T23:42:34.439 INFO:tasks.workunit.client.0.smithi067.stdout:0/619: rmdir d3/d5/d32/d9f 39 2024-01-17T23:42:34.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/634: link d6/d9/d1c/d1e/d7e/f8c d6/d9/d1c/d1e/d43/d86/fda 0 2024-01-17T23:42:35.442 INFO:tasks.workunit.client.0.smithi067.stdout:4/555: creat d3/d26/d34/d65/fb7 x:0 0 0 2024-01-17T23:42:35.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/556: dwrite d3/d8/d35/f3c [4194304,4194304] 0 2024-01-17T23:42:35.503 INFO:tasks.workunit.client.0.smithi067.stdout:4/557: dwrite d3/d8/de/d20/d3b/d7c/d92/f99 [0,4194304] 0 2024-01-17T23:42:35.540 INFO:tasks.workunit.client.0.smithi067.stdout:4/558: dwrite d3/d8/de/d20/fb4 [0,4194304] 0 2024-01-17T23:42:35.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/559: truncate d3/d8/de/da6/fb6 343940 0 2024-01-17T23:42:35.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/560: fsync d3/d8/d35/d36/f48 0 2024-01-17T23:42:35.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/561: fsync d3/d8/f13 0 2024-01-17T23:42:35.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/562: write d3/d40/fae [854963,94721] 0 2024-01-17T23:42:35.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/563: write d3/d8/d35/f3c [1930768,73467] 0 2024-01-17T23:42:35.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/493: mknod d3/d58/cae 0 2024-01-17T23:42:35.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/494: fsync d3/d6/d47/d6d/f8c 0 2024-01-17T23:42:35.728 INFO:tasks.workunit.client.0.smithi067.stdout:5/527: rmdir d10/d24/d25/d5c 39 2024-01-17T23:42:35.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/581: dwrite d0/d7/d7f/d82/d35/f79 [8388608,4194304] 0 2024-01-17T23:42:36.012 INFO:tasks.workunit.client.0.smithi067.stdout:0/620: truncate d3/d5/d1a/d1c/d4e/d6b/fab 485973 0 2024-01-17T23:42:36.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/635: creat d6/d9/d30/dbd/fdb x:0 0 0 2024-01-17T23:42:36.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/636: fdatasync d6/f3d 0 2024-01-17T23:42:36.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/637: creat d6/d9/d1c/d1e/d43/d86/da5/fdc x:0 0 0 2024-01-17T23:42:36.895 INFO:tasks.workunit.client.0.smithi067.stdout:9/495: symlink d3/d6/d2a/d34/d42/laf 0 2024-01-17T23:42:37.131 INFO:tasks.workunit.client.0.smithi067.stdout:1/582: mknod d0/d7/d13/d77/cb5 0 2024-01-17T23:42:37.193 INFO:tasks.workunit.client.0.smithi067.stdout:0/621: dread d3/d6/dd/fb8 [0,4194304] 0 2024-01-17T23:42:37.193 INFO:tasks.workunit.client.0.smithi067.stdout:0/622: write d3/d5/d1a/d1c/d1d/d2e/f8e [791627,6185] 0 2024-01-17T23:42:37.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/623: dread d3/d6/f76 [0,4194304] 0 2024-01-17T23:42:37.217 INFO:tasks.workunit.client.0.smithi067.stdout:7/585: dwrite d4/de/f14 [0,4194304] 0 2024-01-17T23:42:37.217 INFO:tasks.workunit.client.0.smithi067.stdout:7/586: fsync d4/d16/f1e 0 2024-01-17T23:42:37.217 INFO:tasks.workunit.client.0.smithi067.stdout:7/587: readlink d4/d25/l6c 0 2024-01-17T23:42:37.269 INFO:tasks.workunit.client.0.smithi067.stdout:6/638: symlink d6/d81/ldd 0 2024-01-17T23:42:37.278 INFO:tasks.workunit.client.0.smithi067.stdout:6/639: dread d6/f75 [0,4194304] 0 2024-01-17T23:42:37.309 INFO:tasks.workunit.client.0.smithi067.stdout:6/640: dwrite d6/d9/f27 [0,4194304] 0 2024-01-17T23:42:37.347 INFO:tasks.workunit.client.0.smithi067.stdout:9/496: symlink d3/d6/d11/d5c/lb0 0 2024-01-17T23:42:37.581 INFO:tasks.workunit.client.0.smithi067.stdout:5/528: rmdir d10/d24/d25 39 2024-01-17T23:42:37.708 INFO:tasks.workunit.client.0.smithi067.stdout:1/583: mknod d0/d7/d13/d3d/d48/cb6 0 2024-01-17T23:42:37.744 INFO:tasks.workunit.client.0.smithi067.stdout:1/584: dwrite d0/d7/d13/d3d/f8e [0,4194304] 0 2024-01-17T23:42:37.745 INFO:tasks.workunit.client.0.smithi067.stdout:1/585: fdatasync d0/d7/d13/f40 0 2024-01-17T23:42:37.972 INFO:tasks.workunit.client.0.smithi067.stdout:7/588: mkdir d4/d4b/d63/d95/dad 0 2024-01-17T23:42:38.004 INFO:tasks.workunit.client.0.smithi067.stdout:7/589: dwrite d4/d16/f4e [0,4194304] 0 2024-01-17T23:42:38.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/590: dwrite d4/d16/f1e [4194304,4194304] 0 2024-01-17T23:42:38.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/641: mkdir d6/d9/d65/dde 0 2024-01-17T23:42:38.255 INFO:tasks.workunit.client.0.smithi067.stdout:9/497: rename d3/d6/da4/d55/l80 to d3/d6/d11/d50/d84/da8/lb1 0 2024-01-17T23:42:38.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/642: chown d6/d18/d2e/d61 52 1 2024-01-17T23:42:38.462 INFO:tasks.workunit.client.0.smithi067.stdout:5/529: mkdir d10/d24/d46/d4a/d4b/da9 0 2024-01-17T23:42:39.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/644: rmdir d0 39 2024-01-17T23:42:39.431 INFO:tasks.workunit.client.0.smithi067.stdout:7/591: mknod d4/de/d41/d7d/cae 0 2024-01-17T23:42:39.469 INFO:tasks.workunit.client.0.smithi067.stdout:9/498: link d3/d6/da4/c1a d3/d6/d11/d50/d84/da8/da9/cb2 0 2024-01-17T23:42:39.470 INFO:tasks.workunit.client.0.smithi067.stdout:8/630: sync 2024-01-17T23:42:39.515 INFO:tasks.workunit.client.0.smithi067.stdout:6/643: mkdir d6/d9/ddf 0 2024-01-17T23:42:39.548 INFO:tasks.workunit.client.0.smithi067.stdout:5/530: mknod d10/d53/caa 0 2024-01-17T23:42:39.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/531: fsync d10/d24/f36 0 2024-01-17T23:42:39.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/532: write d10/d24/d46/d4a/d50/f89 [923979,26366] 0 2024-01-17T23:42:39.567 INFO:tasks.workunit.client.0.smithi067.stdout:5/533: dread d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:42:39.567 INFO:tasks.workunit.client.0.smithi067.stdout:5/534: creat d10/d24/d46/d4a/d50/fab x:0 0 0 2024-01-17T23:42:39.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/586: rmdir d0/d74 39 2024-01-17T23:42:40.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/645: rename d0/d12/d59/f9a to d0/d34/d35/d65/d6f/fc3 0 2024-01-17T23:42:40.173 INFO:tasks.workunit.client.0.smithi067.stdout:7/592: creat d4/faf x:0 0 0 2024-01-17T23:42:40.224 INFO:tasks.workunit.client.0.smithi067.stdout:2/552: sync 2024-01-17T23:42:40.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/631: symlink d6/db/d58/ld9 0 2024-01-17T23:42:40.341 INFO:tasks.workunit.client.0.smithi067.stdout:8/632: write d6/d19/d22/d25/f59 [4070252,37702] 0 2024-01-17T23:42:40.342 INFO:tasks.workunit.client.0.smithi067.stdout:8/633: readlink d6/d19/dcf/ld7 0 2024-01-17T23:42:40.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/644: mknod d6/d9/d65/dde/ce0 0 2024-01-17T23:42:41.411 INFO:tasks.workunit.client.0.smithi067.stdout:5/535: truncate d10/d24/d46/f54 3697192 0 2024-01-17T23:42:41.513 INFO:tasks.workunit.client.0.smithi067.stdout:1/587: dread - d0/d7/d7f/d82/d35/fa0 zero size 2024-01-17T23:42:41.513 INFO:tasks.workunit.client.0.smithi067.stdout:1/588: fdatasync d0/d7/d7f/f91 0 2024-01-17T23:42:41.514 INFO:tasks.workunit.client.0.smithi067.stdout:1/589: read - d0/d7/d13/d3a/d75/da1/fa2 zero size 2024-01-17T23:42:41.514 INFO:tasks.workunit.client.0.smithi067.stdout:1/590: stat d0/d7/d13/d2e/f4b 0 2024-01-17T23:42:41.667 INFO:tasks.workunit.client.0.smithi067.stdout:7/593: mkdir d4/d25/d39/d46/da8/db0 0 2024-01-17T23:42:41.667 INFO:tasks.workunit.client.0.smithi067.stdout:7/594: readlink d4/d4b/d63/d9c/la0 0 2024-01-17T23:42:41.667 INFO:tasks.workunit.client.0.smithi067.stdout:7/595: fsync d4/d25/d39/d8a/f97 0 2024-01-17T23:42:41.998 INFO:tasks.workunit.client.0.smithi067.stdout:8/634: mknod d6/d19/d22/d25/d53/d54/cda 0 2024-01-17T23:42:42.303 INFO:tasks.workunit.client.0.smithi067.stdout:0/624: dwrite d3/d5/d1a/f24 [0,4194304] 0 2024-01-17T23:42:42.313 INFO:tasks.workunit.client.0.smithi067.stdout:0/625: dread d3/d5/d1a/d1c/d1d/f9a [0,4194304] 0 2024-01-17T23:42:42.314 INFO:tasks.workunit.client.0.smithi067.stdout:0/626: truncate d3/d6/dd/dc4/fe3 932180 0 2024-01-17T23:42:42.317 INFO:tasks.workunit.client.0.smithi067.stdout:0/627: dread d3/d6/f4b [4194304,4194304] 0 2024-01-17T23:42:42.402 INFO:tasks.workunit.client.0.smithi067.stdout:5/536: mknod d10/d24/d25/d5c/cac 0 2024-01-17T23:42:42.606 INFO:tasks.workunit.client.0.smithi067.stdout:1/591: creat d0/fb7 x:0 0 0 2024-01-17T23:42:43.405 INFO:tasks.workunit.client.0.smithi067.stdout:0/628: symlink d3/d5/d1a/d1c/d4e/d6b/lf5 0 2024-01-17T23:42:43.903 INFO:tasks.workunit.client.0.smithi067.stdout:0/629: rmdir d3/d5/d1a/d1c 39 2024-01-17T23:42:43.903 INFO:tasks.workunit.client.0.smithi067.stdout:2/553: rmdir d5/d1f/d2a 39 2024-01-17T23:42:43.903 INFO:tasks.workunit.client.0.smithi067.stdout:2/554: dread - d5/d2f/f8f zero size 2024-01-17T23:42:43.942 INFO:tasks.workunit.client.0.smithi067.stdout:0/630: dwrite d3/d64/f95 [0,4194304] 0 2024-01-17T23:42:43.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:43.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:42:44.307 INFO:tasks.workunit.client.0.smithi067.stdout:2/555: creat d5/d1f/d2a/d8d/fc8 x:0 0 0 2024-01-17T23:42:44.307 INFO:tasks.workunit.client.0.smithi067.stdout:2/556: dread - d5/d2f/f8f zero size 2024-01-17T23:42:44.668 INFO:tasks.workunit.client.0.smithi067.stdout:0/631: dread d3/d5/d1a/d1c/d4e/d6b/fab [0,4194304] 0 2024-01-17T23:42:44.669 INFO:tasks.workunit.client.0.smithi067.stdout:0/632: chown d3/d5/d1a/d1c/d1d/d2e/l67 0 1 2024-01-17T23:42:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/633: dwrite d3/d5/d32/fd3 [0,4194304] 0 2024-01-17T23:42:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/634: chown d3/d5/d1a/d1c/d4e/d7c 0 1 2024-01-17T23:42:44.783 INFO:tasks.workunit.client.0.smithi067.stdout:8/635: rename d6/d26/l64 to d6/d26/d56/dd5/ldb 0 2024-01-17T23:42:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:4/564: mkdir d3/db8 0 2024-01-17T23:42:45.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/565: dread d3/d8/d35/f3c [0,4194304] 0 2024-01-17T23:42:45.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/566: dread d3/d5/f3f [0,4194304] 0 2024-01-17T23:42:45.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/557: creat d5/d1f/d2a/d54/d8/fc9 x:0 0 0 2024-01-17T23:42:45.841 INFO:tasks.workunit.client.0.smithi067.stdout:0/635: unlink d3/d6/dd/dc4/ce4 0 2024-01-17T23:42:45.847 INFO:tasks.workunit.client.0.smithi067.stdout:0/636: dread d3/d5/f9 [4194304,4194304] 0 2024-01-17T23:42:46.065 INFO:tasks.workunit.client.0.smithi067.stdout:5/537: rename d10/d53/l9d to d10/d24/d25/d5c/d7e/d7f/d92/lad 0 2024-01-17T23:42:46.096 INFO:tasks.workunit.client.0.smithi067.stdout:5/538: dwrite d10/d24/d59/f67 [0,4194304] 0 2024-01-17T23:42:46.097 INFO:tasks.workunit.client.0.smithi067.stdout:5/539: truncate d10/d24/d46/d4a/d50/fab 1028585 0 2024-01-17T23:42:46.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/567: unlink d3/f7 0 2024-01-17T23:42:46.464 INFO:tasks.workunit.client.0.smithi067.stdout:4/568: fsync d3/d8/de/da6/fb6 0 2024-01-17T23:42:46.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/569: dwrite d3/d26/f43 [0,4194304] 0 2024-01-17T23:42:46.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/570: creat d3/d8/de/da6/fb9 x:0 0 0 2024-01-17T23:42:46.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/637: symlink d3/dbf/lf6 0 2024-01-17T23:42:46.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/638: dread - d3/d64/fd6 zero size 2024-01-17T23:42:46.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/639: creat d3/d64/d82/ff7 x:0 0 0 2024-01-17T23:42:46.794 INFO:tasks.workunit.client.0.smithi067.stdout:7/596: write d4/f65 [1704966,12297] 0 2024-01-17T23:42:46.794 INFO:tasks.workunit.client.0.smithi067.stdout:7/597: stat d4/de/f4d 0 2024-01-17T23:42:46.794 INFO:tasks.workunit.client.0.smithi067.stdout:7/598: chown d4/d25/f33 5686 1 2024-01-17T23:42:46.794 INFO:tasks.workunit.client.0.smithi067.stdout:7/599: chown d4/d25/d39 0 1 2024-01-17T23:42:46.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/600: readlink d4/d4b/d7f/l91 0 2024-01-17T23:42:46.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/601: chown d4/de/d41/d7d/d81 33004860 1 2024-01-17T23:42:46.892 INFO:tasks.workunit.client.0.smithi067.stdout:1/592: rename d0/d62/f64 to d0/d7/d13/d3d/d48/d4d/fb8 0 2024-01-17T23:42:47.170 INFO:tasks.workunit.client.0.smithi067.stdout:5/540: mkdir d10/d24/d59/d8c/dae 0 2024-01-17T23:42:47.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/646: mknod d0/d12/cc4 0 2024-01-17T23:42:47.171 INFO:tasks.workunit.client.0.smithi067.stdout:6/645: write d6/d9/d1c/d1e/d43/d86/fda [801775,18479] 0 2024-01-17T23:42:47.490 INFO:tasks.workunit.client.0.smithi067.stdout:4/571: unlink d3/d8/de/d20/d52/c8a 0 2024-01-17T23:42:47.730 INFO:tasks.workunit.client.0.smithi067.stdout:0/640: creat d3/d5/d32/dc5/ff8 x:0 0 0 2024-01-17T23:42:47.827 INFO:tasks.workunit.client.0.smithi067.stdout:7/602: symlink d4/de/d41/lb1 0 2024-01-17T23:42:47.837 INFO:tasks.workunit.client.0.smithi067.stdout:7/603: dread d4/d16/f29 [0,4194304] 0 2024-01-17T23:42:48.274 INFO:tasks.workunit.client.0.smithi067.stdout:1/593: rename d0/d7/d13/d3a/d3e/l7d to d0/d7/d13/d3a/d3e/lb9 0 2024-01-17T23:42:48.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/647: getdents d0/d34/d35/d65/d6f 0 2024-01-17T23:42:48.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/648: chown d0/d13/d1a/l51 195 1 2024-01-17T23:42:48.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/649: stat d0/d13/d4a/d75 0 2024-01-17T23:42:48.431 INFO:tasks.workunit.client.0.smithi067.stdout:3/650: creat d0/d12/d1b/d4d/fc5 x:0 0 0 2024-01-17T23:42:48.663 INFO:tasks.workunit.client.0.smithi067.stdout:0/641: symlink d3/d64/d7d/de6/lf9 0 2024-01-17T23:42:48.663 INFO:tasks.workunit.client.0.smithi067.stdout:0/642: write d3/d5/d1a/d1c/d1d/d2e/f85 [327712,311] 0 2024-01-17T23:42:48.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/643: dread d3/d6/dd/f5d [0,4194304] 0 2024-01-17T23:42:48.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/644: chown d3/cd5 1745859582 1 2024-01-17T23:42:48.739 INFO:tasks.workunit.client.0.smithi067.stdout:7/604: getdents d4/d25/d39 0 2024-01-17T23:42:48.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/605: dwrite d4/f5b [4194304,4194304] 0 2024-01-17T23:42:48.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/594: mknod d0/d7/d7f/d82/cba 0 2024-01-17T23:42:48.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/595: stat d0/d7/d13/l30 0 2024-01-17T23:42:49.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/645: truncate d3/d5/d1a/d1c/d1d/f9a 399087 0 2024-01-17T23:42:49.538 INFO:tasks.workunit.client.0.smithi067.stdout:7/606: mknod d4/d4b/d7f/d82/cb2 0 2024-01-17T23:42:49.591 INFO:tasks.workunit.client.0.smithi067.stdout:9/499: sync 2024-01-17T23:42:50.203 INFO:tasks.workunit.client.0.smithi067.stdout:3/651: rename d0/d34/d35/f96 to d0/d13/d1a/d38/fc6 0 2024-01-17T23:42:50.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/652: dwrite d0/d13/d4a/d55/f62 [0,4194304] 0 2024-01-17T23:42:50.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/653: fsync d0/d17/f28 0 2024-01-17T23:42:50.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/646: link d3/cd5 d3/d64/cfa 0 2024-01-17T23:42:50.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/500: creat d3/d6/da4/d55/da1/fb3 x:0 0 0 2024-01-17T23:42:50.985 INFO:tasks.workunit.client.0.smithi067.stdout:3/654: link d0/d13/d4a/d82/fa7 d0/d17/fc7 0 2024-01-17T23:42:51.132 INFO:tasks.workunit.client.0.smithi067.stdout:0/647: symlink d3/dbf/lfb 0 2024-01-17T23:42:51.146 INFO:tasks.workunit.client.0.smithi067.stdout:0/648: write d3/d6/f76 [995059,129358] 0 2024-01-17T23:42:51.146 INFO:tasks.workunit.client.0.smithi067.stdout:0/649: fsync d3/d5/d1a/f24 0 2024-01-17T23:42:51.179 INFO:tasks.workunit.client.0.smithi067.stdout:2/558: write d5/d1f/f1e [4633125,53541] 0 2024-01-17T23:42:51.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/501: rmdir d3/d58 39 2024-01-17T23:42:51.674 INFO:tasks.workunit.client.0.smithi067.stdout:7/607: rename d4/de/d41/d7d/d81 to d4/de/d41/da2/db3 0 2024-01-17T23:42:51.800 INFO:tasks.workunit.client.0.smithi067.stdout:9/502: getdents d3/d6/d11/d50/d84/da8/da9 0 2024-01-17T23:42:51.800 INFO:tasks.workunit.client.0.smithi067.stdout:9/503: fsync d3/f26 0 2024-01-17T23:42:51.800 INFO:tasks.workunit.client.0.smithi067.stdout:8/636: sync 2024-01-17T23:42:51.889 INFO:tasks.workunit.client.0.smithi067.stdout:2/559: getdents d5/d1f/d35 0 2024-01-17T23:42:52.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/608: mknod d4/de/d40/d84/cb4 0 2024-01-17T23:42:52.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/609: stat d4/d25/d39/d46/f99 0 2024-01-17T23:42:52.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/610: fsync d4/de/d40/f71 0 2024-01-17T23:42:52.230 INFO:tasks.workunit.client.0.smithi067.stdout:8/637: mknod d6/d26/d7c/cdc 0 2024-01-17T23:42:52.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/638: dwrite d6/d19/d22/d25/d53/fce [0,4194304] 0 2024-01-17T23:42:52.383 INFO:tasks.workunit.client.0.smithi067.stdout:4/572: getdents d3/d8/de/da6 0 2024-01-17T23:42:52.424 INFO:tasks.workunit.client.0.smithi067.stdout:4/573: dwrite d3/d8/d35/fb1 [0,4194304] 0 2024-01-17T23:42:52.450 INFO:tasks.workunit.client.0.smithi067.stdout:4/574: dwrite d3/d8/fa4 [4194304,4194304] 0 2024-01-17T23:42:52.450 INFO:tasks.workunit.client.0.smithi067.stdout:4/575: stat d3/d8/l8b 0 2024-01-17T23:42:53.439 INFO:tasks.workunit.client.0.smithi067.stdout:8/639: mkdir d6/d19/d22/ddd 0 2024-01-17T23:42:53.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/541: write d10/f19 [1593631,22365] 0 2024-01-17T23:42:53.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/542: chown d10/d24/c6c 749195984 1 2024-01-17T23:42:53.967 INFO:tasks.workunit.client.0.smithi067.stdout:3/655: rename d0/d12/d59 to d0/d17/dc8 0 2024-01-17T23:42:53.968 INFO:tasks.workunit.client.0.smithi067.stdout:8/640: mkdir d6/d19/db4/dde 0 2024-01-17T23:42:53.996 INFO:tasks.workunit.client.0.smithi067.stdout:3/656: dwrite d0/d12/d1b/d4d/fc5 [0,4194304] 0 2024-01-17T23:42:54.006 INFO:tasks.workunit.client.0.smithi067.stdout:3/657: write d0/d13/d4a/f5c [1427911,92929] 0 2024-01-17T23:42:54.166 INFO:tasks.workunit.client.0.smithi067.stdout:5/543: mknod d10/d24/d59/d8c/caf 0 2024-01-17T23:42:54.238 INFO:tasks.workunit.client.0.smithi067.stdout:8/641: unlink d6/d19/d22/d25/d53/d54/fad 0 2024-01-17T23:42:54.238 INFO:tasks.workunit.client.0.smithi067.stdout:8/642: chown d6/d26/d3e/f74 32387 1 2024-01-17T23:42:54.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/576: symlink d3/d8/lba 0 2024-01-17T23:42:54.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/577: dread d3/d8/de/d20/f56 [0,4194304] 0 2024-01-17T23:42:54.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/578: write d3/d26/d34/d3a/fa0 [533554,53576] 0 2024-01-17T23:42:55.605 INFO:tasks.workunit.client.0.smithi067.stdout:4/579: mknod d3/d8/de/d20/d52/cbb 0 2024-01-17T23:42:55.769 INFO:tasks.workunit.client.0.smithi067.stdout:5/544: truncate d10/f20 1457378 0 2024-01-17T23:42:56.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/545: creat d10/d24/d59/d8c/dae/fb0 x:0 0 0 2024-01-17T23:42:56.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/646: mkdir d6/d9/de1 0 2024-01-17T23:42:56.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/647: creat d6/d9/d3e/fe2 x:0 0 0 2024-01-17T23:42:56.777 INFO:tasks.workunit.client.0.smithi067.stdout:5/546: dread fa [0,4194304] 0 2024-01-17T23:42:56.801 INFO:tasks.workunit.client.0.smithi067.stdout:7/611: write d4/de/f58 [503837,122258] 0 2024-01-17T23:42:56.801 INFO:tasks.workunit.client.0.smithi067.stdout:7/612: write d4/f65 [2753826,9345] 0 2024-01-17T23:42:56.807 INFO:tasks.workunit.client.0.smithi067.stdout:9/504: write d3/d6/d2a/f71 [3247883,34889] 0 2024-01-17T23:42:56.807 INFO:tasks.workunit.client.0.smithi067.stdout:9/505: read - d3/d6/d11/faa zero size 2024-01-17T23:42:56.828 INFO:tasks.workunit.client.0.smithi067.stdout:6/648: dwrite d6/d9/f31 [0,4194304] 0 2024-01-17T23:42:56.844 INFO:tasks.workunit.client.0.smithi067.stdout:2/560: dwrite d5/d1f/d2a/d54/d8/d4c/f51 [0,4194304] 0 2024-01-17T23:42:57.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/547: mkdir d10/d24/d46/db1 0 2024-01-17T23:42:57.325 INFO:tasks.workunit.client.0.smithi067.stdout:5/548: dread d10/d53/f62 [0,4194304] 0 2024-01-17T23:42:57.396 INFO:tasks.workunit.client.0.smithi067.stdout:7/613: creat d4/de/d40/d84/fb5 x:0 0 0 2024-01-17T23:42:57.763 INFO:tasks.workunit.client.0.smithi067.stdout:6/649: unlink d6/d9/d1c/d1e/lca 0 2024-01-17T23:42:58.368 INFO:tasks.workunit.client.0.smithi067.stdout:5/549: creat d10/d24/d46/db1/fb2 x:0 0 0 2024-01-17T23:42:58.488 INFO:tasks.workunit.client.0.smithi067.stdout:7/614: getdents d4/d25/d39/d46/d78/d93 0 2024-01-17T23:42:58.673 INFO:tasks.workunit.client.0.smithi067.stdout:6/650: symlink d6/d9/d30/d4c/d8d/le3 0 2024-01-17T23:42:58.858 INFO:tasks.workunit.client.0.smithi067.stdout:2/561: rmdir d5/d1f/d2a/d54/d8/d4c 39 2024-01-17T23:42:59.295 INFO:tasks.workunit.client.0.smithi067.stdout:3/658: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:42:59.302 INFO:tasks.workunit.client.0.smithi067.stdout:8/643: dwrite d6/f1a [0,4194304] 0 2024-01-17T23:42:59.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/580: write d3/d5/f98 [202778,20157] 0 2024-01-17T23:42:59.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/581: write d3/d8/de/d20/fb5 [354909,35764] 0 2024-01-17T23:42:59.573 INFO:tasks.workunit.client.0.smithi067.stdout:1/596: sync 2024-01-17T23:42:59.573 INFO:tasks.workunit.client.0.smithi067.stdout:1/597: dread - d0/d7/d13/d77/d95/fa3 zero size 2024-01-17T23:42:59.651 INFO:tasks.workunit.client.0.smithi067.stdout:6/651: truncate d6/d18/f2a 1835973 0 2024-01-17T23:42:59.651 INFO:tasks.workunit.client.0.smithi067.stdout:6/652: chown d6/d9/d1c/d1e/d43/f9f 0 1 2024-01-17T23:42:59.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/562: dread d5/d1f/d2a/d54/d8/d4c/d84/f8c [0,4194304] 0 2024-01-17T23:43:00.109 INFO:tasks.workunit.client.0.smithi067.stdout:3/659: truncate d0/d17/d69/d6e/f89 2450219 0 2024-01-17T23:43:00.110 INFO:tasks.workunit.client.0.smithi067.stdout:8/644: mknod d6/d19/d22/d25/d53/d48/cdf 0 2024-01-17T23:43:00.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/660: chown d0/d13/d1a/fb5 862 1 2024-01-17T23:43:00.382 INFO:tasks.workunit.client.0.smithi067.stdout:1/598: getdents d0/d74/d31 0 2024-01-17T23:43:00.382 INFO:tasks.workunit.client.0.smithi067.stdout:1/599: truncate d0/d7/d7f/d82/d35/fb0 311268 0 2024-01-17T23:43:01.157 INFO:tasks.workunit.client.0.smithi067.stdout:8/645: unlink d6/db/f84 0 2024-01-17T23:43:01.347 INFO:tasks.workunit.client.0.smithi067.stdout:4/582: rmdir d3/d26/d34/d65 39 2024-01-17T23:43:01.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/600: dwrite d0/d7/f55 [0,4194304] 0 2024-01-17T23:43:01.618 INFO:tasks.workunit.client.0.smithi067.stdout:2/563: link d5/d1f/d16/f85 d5/d1f/d2a/d54/d39/fca 0 2024-01-17T23:43:01.628 INFO:tasks.workunit.client.0.smithi067.stdout:2/564: dread d5/d1f/d2a/d54/f24 [0,4194304] 0 2024-01-17T23:43:01.633 INFO:tasks.workunit.client.0.smithi067.stdout:2/565: dread d5/d1f/d2a/d54/f24 [0,4194304] 0 2024-01-17T23:43:01.940 INFO:tasks.workunit.client.0.smithi067.stdout:4/583: link d3/d8/de/c2d d3/d8/de/d20/d3b/d7c/d92/cbc 0 2024-01-17T23:43:02.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/601: link d0/d7/d13/d3d/d48/cb4 d0/d7/d13/d3a/d3e/cbb 0 2024-01-17T23:43:02.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/602: readlink d0/d7/d7f/d82/l9f 0 2024-01-17T23:43:02.098 INFO:tasks.workunit.client.0.smithi067.stdout:1/603: dread d0/d7/d13/f40 [0,4194304] 0 2024-01-17T23:43:02.098 INFO:tasks.workunit.client.0.smithi067.stdout:1/604: chown d0/d7/d13/c47 1471258 1 2024-01-17T23:43:02.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/566: rmdir d5/d1f/d2a/d54 39 2024-01-17T23:43:02.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/567: dread - d5/d1f/d2a/d54/d8/db5/fbe zero size 2024-01-17T23:43:02.207 INFO:tasks.workunit.client.0.smithi067.stdout:5/550: write d10/f2c [4051358,2555] 0 2024-01-17T23:43:02.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/568: write d5/d1f/d2a/d54/d39/fca [3675661,58588] 0 2024-01-17T23:43:02.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/569: write d5/d1f/d2a/d8d/fc8 [395706,37813] 0 2024-01-17T23:43:02.207 INFO:tasks.workunit.client.0.smithi067.stdout:2/570: fsync d5/d1f/d35/f3b 0 2024-01-17T23:43:02.234 INFO:tasks.workunit.client.0.smithi067.stdout:2/571: dwrite d5/d1f/d2a/d54/fb2 [0,4194304] 0 2024-01-17T23:43:02.247 INFO:tasks.workunit.client.0.smithi067.stdout:5/551: dwrite d10/f6e [0,4194304] 0 2024-01-17T23:43:02.247 INFO:tasks.workunit.client.0.smithi067.stdout:5/552: write d10/d24/d59/d5d/f51 [218173,56471] 0 2024-01-17T23:43:02.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/584: creat d3/d8/d35/db0/fbd x:0 0 0 2024-01-17T23:43:02.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/585: write d3/d26/d34/f7b [1656974,96373] 0 2024-01-17T23:43:02.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/586: write d3/d8/f1f [4181729,46778] 0 2024-01-17T23:43:02.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/587: truncate d3/d26/f43 4450516 0 2024-01-17T23:43:02.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/588: write d3/d8/de/da6/fb6 [664519,91606] 0 2024-01-17T23:43:02.303 INFO:tasks.workunit.client.0.smithi067.stdout:4/589: dwrite d3/d8/de/f14 [0,4194304] 0 2024-01-17T23:43:02.303 INFO:tasks.workunit.client.0.smithi067.stdout:4/590: write d3/d8/d35/db0/fbd [1027496,101469] 0 2024-01-17T23:43:02.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/591: dwrite d3/d8/d35/db0/fbd [0,4194304] 0 2024-01-17T23:43:02.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/592: chown d3/d8/d35/fb1 0 1 2024-01-17T23:43:02.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/615: write d4/f26 [523513,105446] 0 2024-01-17T23:43:02.398 INFO:tasks.workunit.client.0.smithi067.stdout:1/605: truncate d0/f2f 1880436 0 2024-01-17T23:43:02.895 INFO:tasks.workunit.client.0.smithi067.stdout:2/572: getdents d5/d1f/d98/d9f 0 2024-01-17T23:43:02.895 INFO:tasks.workunit.client.0.smithi067.stdout:2/573: creat d5/d1f/d2a/d54/d7c/fcb x:0 0 0 2024-01-17T23:43:02.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/574: dwrite d5/d1f/d2a/d73/d95/fa8 [0,4194304] 0 2024-01-17T23:43:03.648 INFO:tasks.workunit.client.0.smithi067.stdout:0/650: rename d3/d5/d1a/d1c/d4e/fb6 to d3/d5/ffc 0 2024-01-17T23:43:04.739 INFO:tasks.workunit.client.0.smithi067.stdout:1/606: creat d0/d7/d13/d3d/d48/fbc x:0 0 0 2024-01-17T23:43:04.778 INFO:tasks.workunit.client.0.smithi067.stdout:3/661: dwrite d0/d13/d4a/fb0 [0,4194304] 0 2024-01-17T23:43:04.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/662: creat d0/d13/d1a/fc9 x:0 0 0 2024-01-17T23:43:05.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/575: link d5/d1f/d2a/d54/d8/d4c/f5f d5/d1f/d2a/d54/d8/d32/d33/fcc 0 2024-01-17T23:43:05.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/576: fdatasync d5/d1f/d2a/f7f 0 2024-01-17T23:43:05.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/577: readlink d5/d1f/d2a/d54/d8/d32/d9c/l7a 0 2024-01-17T23:43:05.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/578: write d5/d1f/d2a/d55/f71 [2273714,97518] 0 2024-01-17T23:43:05.361 INFO:tasks.workunit.client.0.smithi067.stdout:2/579: stat d5/d1f/d2a/d54/d8/d4c/d84/da9 0 2024-01-17T23:43:05.416 INFO:tasks.workunit.client.0.smithi067.stdout:8/646: write d6/d19/d22/d25/d53/f75 [4885396,35364] 0 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/651: symlink d3/d5/d32/d7f/lfd 0 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/652: chown d3/d4c/l5b 405094367 1 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/653: chown d3/d5/d1a/d1c/d1d/d2e/f89 747890748 1 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/654: dread - d3/d5/ffc zero size 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/655: fdatasync d3/d64/d82/fbe 0 2024-01-17T23:43:05.662 INFO:tasks.workunit.client.0.smithi067.stdout:0/656: creat d3/d5/d1a/d1c/d4e/d7c/ffe x:0 0 0 2024-01-17T23:43:05.687 INFO:tasks.workunit.client.0.smithi067.stdout:0/657: dwrite d3/d5/d1a/d1c/d4e/d6b/fc7 [0,4194304] 0 2024-01-17T23:43:05.972 INFO:tasks.workunit.client.0.smithi067.stdout:1/607: creat d0/d7/d13/d3a/d45/fbd x:0 0 0 2024-01-17T23:43:06.648 INFO:tasks.workunit.client.0.smithi067.stdout:7/616: creat d4/de/fb6 x:0 0 0 2024-01-17T23:43:07.070 INFO:tasks.workunit.client.0.smithi067.stdout:4/593: link d3/d26/d34/d3a/c58 d3/d40/cbe 0 2024-01-17T23:43:07.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/594: dwrite d3/d8/d35/d36/f48 [0,4194304] 0 2024-01-17T23:43:07.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/595: truncate d3/d8/de/da6/fb9 911513 0 2024-01-17T23:43:07.123 INFO:tasks.workunit.client.0.smithi067.stdout:4/596: dread d3/d8/fa4 [0,4194304] 0 2024-01-17T23:43:07.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/647: symlink d6/d19/d22/d25/d53/d65/le0 0 2024-01-17T23:43:07.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/648: stat d6/d19/d22/cc3 0 2024-01-17T23:43:07.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/649: write d6/db/d58/d5f/fb7 [492839,100973] 0 2024-01-17T23:43:07.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/650: chown d6/d19/l6b 6828655 1 2024-01-17T23:43:07.499 INFO:tasks.workunit.client.0.smithi067.stdout:6/653: sync 2024-01-17T23:43:07.499 INFO:tasks.workunit.client.0.smithi067.stdout:9/506: sync 2024-01-17T23:43:07.582 INFO:tasks.workunit.client.0.smithi067.stdout:0/658: getdents d3/d64/d7d 0 2024-01-17T23:43:07.582 INFO:tasks.workunit.client.0.smithi067.stdout:0/659: truncate d3/d5/d32/fa5 704251 0 2024-01-17T23:43:07.671 INFO:tasks.workunit.client.0.smithi067.stdout:1/608: creat d0/d74/d31/fbe x:0 0 0 2024-01-17T23:43:07.671 INFO:tasks.workunit.client.0.smithi067.stdout:1/609: readlink d0/d7/d7f/l97 0 2024-01-17T23:43:07.699 INFO:tasks.workunit.client.0.smithi067.stdout:1/610: dwrite d0/d74/d31/f72 [0,4194304] 0 2024-01-17T23:43:07.699 INFO:tasks.workunit.client.0.smithi067.stdout:1/611: chown d0/d7/d13/d3d/d48/cb4 23 1 2024-01-17T23:43:07.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/612: dread d0/d7/d13/d2e/f49 [0,4194304] 0 2024-01-17T23:43:07.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/613: chown d0/d7/d7f/d82/l9f 8 1 2024-01-17T23:43:07.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/614: write d0/d74/d31/f67 [1805134,75478] 0 2024-01-17T23:43:07.978 INFO:tasks.workunit.client.0.smithi067.stdout:7/617: mkdir d4/d4b/d63/db7 0 2024-01-17T23:43:08.759 INFO:tasks.workunit.client.0.smithi067.stdout:6/654: rmdir d6 39 2024-01-17T23:43:08.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/507: rmdir d3/d58 39 2024-01-17T23:43:08.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/508: write d3/d6/d11/d50/f77 [931864,3052] 0 2024-01-17T23:43:08.834 INFO:tasks.workunit.client.0.smithi067.stdout:9/509: stat d3/d6/da4/c5b 0 2024-01-17T23:43:09.424 INFO:tasks.workunit.client.0.smithi067.stdout:1/615: creat d0/d7/d13/d3a/d75/fbf x:0 0 0 2024-01-17T23:43:09.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/663: getdents d0/d34/d35/d57/d87 0 2024-01-17T23:43:09.773 INFO:tasks.workunit.client.0.smithi067.stdout:7/618: creat d4/d25/d39/d79/fb8 x:0 0 0 2024-01-17T23:43:09.773 INFO:tasks.workunit.client.0.smithi067.stdout:7/619: chown d4/d25/d39/d46/d78/d93/fa4 12 1 2024-01-17T23:43:09.773 INFO:tasks.workunit.client.0.smithi067.stdout:7/620: dread - d4/d4b/d63/d9c/fa3 zero size 2024-01-17T23:43:09.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/621: dread d4/d25/d39/d46/f99 [0,4194304] 0 2024-01-17T23:43:10.239 INFO:tasks.workunit.client.0.smithi067.stdout:1/616: creat d0/d7/d13/d2e/fc0 x:0 0 0 2024-01-17T23:43:10.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/664: rmdir d0/d17/d69 39 2024-01-17T23:43:10.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/665: truncate d0/d13/d1a/fb5 198122 0 2024-01-17T23:43:10.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/666: dwrite d0/d13/fa9 [0,4194304] 0 2024-01-17T23:43:10.461 INFO:tasks.workunit.client.0.smithi067.stdout:7/622: creat d4/d25/d39/d46/d78/d93/d94/fb9 x:0 0 0 2024-01-17T23:43:11.396 INFO:tasks.workunit.client.0.smithi067.stdout:5/553: sync 2024-01-17T23:43:11.396 INFO:tasks.workunit.client.0.smithi067.stdout:5/554: chown d10/d24/d46/d4a/d50/f89 18 1 2024-01-17T23:43:11.424 INFO:tasks.workunit.client.0.smithi067.stdout:2/580: dwrite d5/d1f/f43 [0,4194304] 0 2024-01-17T23:43:11.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/581: dwrite d5/d1f/d2a/f4a [0,4194304] 0 2024-01-17T23:43:11.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/582: write d5/d1f/d2a/d54/d8/d32/d33/f6f [3189011,2505] 0 2024-01-17T23:43:11.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/597: write d3/d40/f41 [1202965,101667] 0 2024-01-17T23:43:11.498 INFO:tasks.workunit.client.0.smithi067.stdout:2/583: dwrite d5/d1f/f43 [4194304,4194304] 0 2024-01-17T23:43:11.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/651: dwrite d6/d19/d22/f4f [0,4194304] 0 2024-01-17T23:43:11.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/555: unlink d10/d24/d46/f69 0 2024-01-17T23:43:12.314 INFO:tasks.workunit.client.0.smithi067.stdout:5/556: chown d10/f16 651 1 2024-01-17T23:43:12.316 INFO:tasks.workunit.client.0.smithi067.stdout:0/660: sync 2024-01-17T23:43:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:0/661: write d3/d6/dd/d43/f92 [273212,84639] 0 2024-01-17T23:43:12.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/655: rename d6/f75 to d6/d9/d1c/d1e/d43/d86/fe4 0 2024-01-17T23:43:12.889 INFO:tasks.workunit.client.0.smithi067.stdout:9/510: write d3/d6/da4/f44 [6256246,127740] 0 2024-01-17T23:43:13.369 INFO:tasks.workunit.client.0.smithi067.stdout:1/617: rename d0/c25 to d0/d62/cc1 0 2024-01-17T23:43:13.450 INFO:tasks.workunit.client.0.smithi067.stdout:9/511: mkdir d3/d6/d47/db4 0 2024-01-17T23:43:13.450 INFO:tasks.workunit.client.0.smithi067.stdout:9/512: chown d3/d25/d5d/c7a 56603881 1 2024-01-17T23:43:13.450 INFO:tasks.workunit.client.0.smithi067.stdout:9/513: fsync d3/d6/f7f 0 2024-01-17T23:43:13.694 INFO:tasks.workunit.client.0.smithi067.stdout:7/623: rename d4/de/fb6 to d4/d25/d39/d46/d78/d93/d94/fba 0 2024-01-17T23:43:13.850 INFO:tasks.workunit.client.0.smithi067.stdout:1/618: symlink d0/d7/d13/d3a/d3e/lc2 0 2024-01-17T23:43:13.850 INFO:tasks.workunit.client.0.smithi067.stdout:1/619: chown d0/d7/f61 16120960 1 2024-01-17T23:43:13.956 INFO:tasks.workunit.client.0.smithi067.stdout:8/652: write d6/d26/d7c/dd0/fa4 [964254,35796] 0 2024-01-17T23:43:13.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/514: symlink d3/d6/d47/d88/lb5 0 2024-01-17T23:43:13.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/515: chown d3/d6/d11/d50/d84/da8/da9/cb2 101852829 1 2024-01-17T23:43:13.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/516: dread - d3/d6/da4/d55/da1/fb3 zero size 2024-01-17T23:43:14.126 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:14.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:14.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/584: rename d5/d1f/d2a/d55/f71 to d5/d1f/d2a/d54/d8/d4c/d84/da9/fcd 0 2024-01-17T23:43:14.345 INFO:tasks.workunit.client.0.smithi067.stdout:1/620: mkdir d0/d7/d13/d3a/d75/dc3 0 2024-01-17T23:43:14.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/624: mkdir d4/de/d41/da2/db3/da9/dbb 0 2024-01-17T23:43:14.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/653: mkdir d6/d26/d56/dbb/de1 0 2024-01-17T23:43:14.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/654: write d6/d19/d22/d25/d53/d65/f23 [2360282,76569] 0 2024-01-17T23:43:14.508 INFO:tasks.workunit.client.0.smithi067.stdout:3/667: sync 2024-01-17T23:43:14.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/598: sync 2024-01-17T23:43:14.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/599: dread - d3/d26/d34/d3a/d53/fb3 zero size 2024-01-17T23:43:14.508 INFO:tasks.workunit.client.0.smithi067.stdout:4/600: creat d3/d8/d35/db0/fbf x:0 0 0 2024-01-17T23:43:14.682 INFO:tasks.workunit.client.0.smithi067.stdout:9/517: creat d3/d6/d47/fb6 x:0 0 0 2024-01-17T23:43:15.199 INFO:tasks.workunit.client.0.smithi067.stdout:6/656: rename d6/d9/d30/d58/fa3 to d6/d9/ddf/fe5 0 2024-01-17T23:43:15.317 INFO:tasks.workunit.client.0.smithi067.stdout:5/557: unlink d10/f20 0 2024-01-17T23:43:15.369 INFO:tasks.workunit.client.0.smithi067.stdout:2/585: creat d5/d1f/d2a/d54/d8/fce x:0 0 0 2024-01-17T23:43:15.727 INFO:tasks.workunit.client.0.smithi067.stdout:7/625: creat d4/fbc x:0 0 0 2024-01-17T23:43:15.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/621: creat d0/d7/d1c/fc4 x:0 0 0 2024-01-17T23:43:15.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/622: dread - d0/d7/d1c/fc4 zero size 2024-01-17T23:43:15.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/623: write d0/d74/d31/fbe [126672,59873] 0 2024-01-17T23:43:15.730 INFO:tasks.workunit.client.0.smithi067.stdout:8/655: creat d6/d19/db4/fe2 x:0 0 0 2024-01-17T23:43:15.730 INFO:tasks.workunit.client.0.smithi067.stdout:9/518: creat d3/d25/d5d/d79/fb7 x:0 0 0 2024-01-17T23:43:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/626: dwrite d4/d25/d39/f70 [0,4194304] 0 2024-01-17T23:43:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/627: chown d4/d25/d39/d8a/fa6 300497 1 2024-01-17T23:43:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/628: creat d4/de/d40/d84/fbd x:0 0 0 2024-01-17T23:43:15.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/629: write d4/f9a [769345,124585] 0 2024-01-17T23:43:15.779 INFO:tasks.workunit.client.0.smithi067.stdout:1/624: dwrite d0/d7/d13/d3a/d3e/f88 [0,4194304] 0 2024-01-17T23:43:15.779 INFO:tasks.workunit.client.0.smithi067.stdout:1/625: chown d0/d74/d31/f72 128631630 1 2024-01-17T23:43:15.788 INFO:tasks.workunit.client.0.smithi067.stdout:8/656: dwrite d6/d19/d22/d25/d53/d54/f77 [0,4194304] 0 2024-01-17T23:43:15.842 INFO:tasks.workunit.client.0.smithi067.stdout:0/662: write d3/d6/f17 [2146201,75332] 0 2024-01-17T23:43:16.077 INFO:tasks.workunit.client.0.smithi067.stdout:3/668: rename d0/d17/c6a to d0/d12/d98/cca 0 2024-01-17T23:43:16.252 INFO:tasks.workunit.client.0.smithi067.stdout:6/657: getdents d6/d9/d30/d4c/d82 0 2024-01-17T23:43:16.252 INFO:tasks.workunit.client.0.smithi067.stdout:6/658: chown d6/d9/d30/d4c/f6d 41 1 2024-01-17T23:43:16.320 INFO:tasks.workunit.client.0.smithi067.stdout:5/558: creat d10/d24/d59/fb3 x:0 0 0 2024-01-17T23:43:16.346 INFO:tasks.workunit.client.0.smithi067.stdout:5/559: dwrite d10/d24/d59/d5d/f51 [0,4194304] 0 2024-01-17T23:43:16.347 INFO:tasks.workunit.client.0.smithi067.stdout:5/560: fsync d10/f16 0 2024-01-17T23:43:16.347 INFO:tasks.workunit.client.0.smithi067.stdout:5/561: write d10/d24/d59/d5d/f95 [954133,55349] 0 2024-01-17T23:43:16.347 INFO:tasks.workunit.client.0.smithi067.stdout:5/562: chown d10/d53/d9a 13514 1 2024-01-17T23:43:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/586: unlink d5/d1f/d2a/d54/d8/d4c/d84/cb1 0 2024-01-17T23:43:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/587: chown d5/d1f/d2a/d54/f1a 1 1 2024-01-17T23:43:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/588: write d5/d1f/d2a/d54/d8/d4c/f5f [1881323,95288] 0 2024-01-17T23:43:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/589: write d5/d1f/d2a/d55/f99 [4809384,127451] 0 2024-01-17T23:43:16.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/590: creat d5/d1f/d2a/d55/fcf x:0 0 0 2024-01-17T23:43:16.496 INFO:tasks.workunit.client.0.smithi067.stdout:2/591: dread - d5/d2f/f8f zero size 2024-01-17T23:43:16.499 INFO:tasks.workunit.client.0.smithi067.stdout:2/592: dread d5/d1f/d2a/d54/f11 [0,4194304] 0 2024-01-17T23:43:16.499 INFO:tasks.workunit.client.0.smithi067.stdout:2/593: read d5/d1f/d2a/d54/d8/d32/f9b [3657405,65875] 0 2024-01-17T23:43:16.708 INFO:tasks.workunit.client.0.smithi067.stdout:9/519: unlink d3/d6/d2a/d34/d42/laf 0 2024-01-17T23:43:17.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/630: creat d4/d25/d39/d46/da8/fbe x:0 0 0 2024-01-17T23:43:17.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/631: chown d4/d16/l21 18 1 2024-01-17T23:43:17.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/626: mknod d0/d7/d13/d3a/d45/cc5 0 2024-01-17T23:43:17.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/627: dread d0/d74/f5f [0,4194304] 0 2024-01-17T23:43:17.486 INFO:tasks.workunit.client.0.smithi067.stdout:8/657: mkdir d6/db/de3 0 2024-01-17T23:43:17.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/658: write d6/f1a [2201280,53343] 0 2024-01-17T23:43:17.784 INFO:tasks.workunit.client.0.smithi067.stdout:4/601: rename d3/d8/de/d38/c44 to d3/d8/de/d20/d3b/cc0 0 2024-01-17T23:43:18.447 INFO:tasks.workunit.client.0.smithi067.stdout:2/594: mknod d5/d1f/d98/cd0 0 2024-01-17T23:43:18.447 INFO:tasks.workunit.client.0.smithi067.stdout:2/595: creat d5/d1f/d2a/d54/d8/d32/fd1 x:0 0 0 2024-01-17T23:43:19.451 INFO:tasks.workunit.client.0.smithi067.stdout:9/520: truncate d3/d6/d11/d50/f43 5398299 0 2024-01-17T23:43:19.451 INFO:tasks.workunit.client.0.smithi067.stdout:9/521: readlink d3/d6/d11/l29 0 2024-01-17T23:43:20.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/659: mknod d6/d19/d22/d25/d53/d54/ce4 0 2024-01-17T23:43:20.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/660: chown d6/d19/d22/d25/d53/f2d 3437 1 2024-01-17T23:43:20.495 INFO:tasks.workunit.client.0.smithi067.stdout:0/663: rename d3/d5/d1a/d1c/d1d/d2e/f89 to d3/d64/d7d/fff 0 2024-01-17T23:43:20.522 INFO:tasks.workunit.client.0.smithi067.stdout:0/664: dwrite d3/d75/fd7 [4194304,4194304] 0 2024-01-17T23:43:20.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/563: mkdir d10/d24/db4 0 2024-01-17T23:43:20.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/564: fsync d10/d24/d46/d4a/d50/d5a/fa2 0 2024-01-17T23:43:20.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/565: truncate d10/d24/f5f 5178082 0 2024-01-17T23:43:21.012 INFO:tasks.workunit.client.0.smithi067.stdout:2/596: symlink d5/d1f/d2a/d54/d8/d4c/dbf/ld2 0 2024-01-17T23:43:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:9/522: symlink d3/d6/d11/d5c/lb8 0 2024-01-17T23:43:21.295 INFO:tasks.workunit.client.0.smithi067.stdout:1/628: creat d0/d69/fc6 x:0 0 0 2024-01-17T23:43:22.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/661: mknod d6/db/d58/ce5 0 2024-01-17T23:43:22.150 INFO:tasks.workunit.client.0.smithi067.stdout:8/662: write d6/d19/d22/d25/d53/f75 [176252,104854] 0 2024-01-17T23:43:22.200 INFO:tasks.workunit.client.0.smithi067.stdout:6/659: rename d6/d9/f10 to d6/d18/d44/fe6 0 2024-01-17T23:43:22.201 INFO:tasks.workunit.client.0.smithi067.stdout:6/660: creat d6/d9/d30/dbd/fe7 x:0 0 0 2024-01-17T23:43:22.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/661: dwrite d6/d9/d30/d4c/d8d/f99 [0,4194304] 0 2024-01-17T23:43:22.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/662: creat d6/d9/d65/da4/fe8 x:0 0 0 2024-01-17T23:43:22.366 INFO:tasks.workunit.client.0.smithi067.stdout:0/665: creat d3/d64/d7d/de6/f100 x:0 0 0 2024-01-17T23:43:22.366 INFO:tasks.workunit.client.0.smithi067.stdout:0/666: chown d3/dbf/lf6 196 1 2024-01-17T23:43:22.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/597: fsync d5/d1f/d2a/d73/f83 0 2024-01-17T23:43:22.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/598: creat d5/d1f/d2a/d54/d8/db5/fd3 x:0 0 0 2024-01-17T23:43:23.134 INFO:tasks.workunit.client.0.smithi067.stdout:8/663: symlink d6/d19/d22/le6 0 2024-01-17T23:43:23.134 INFO:tasks.workunit.client.0.smithi067.stdout:8/664: readlink d6/l40 0 2024-01-17T23:43:23.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/663: chown d6/d81/dc7 14 1 2024-01-17T23:43:23.524 INFO:tasks.workunit.client.0.smithi067.stdout:6/664: write d6/d9/d3e/f92 [247977,35190] 0 2024-01-17T23:43:23.636 INFO:tasks.workunit.client.0.smithi067.stdout:0/667: getdents d3/d6/dd 0 2024-01-17T23:43:23.666 INFO:tasks.workunit.client.0.smithi067.stdout:0/668: dwrite d3/d5/d1a/f71 [4194304,4194304] 0 2024-01-17T23:43:23.666 INFO:tasks.workunit.client.0.smithi067.stdout:0/669: dread - d3/d64/d7d/de6/f100 zero size 2024-01-17T23:43:23.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/632: sync 2024-01-17T23:43:23.796 INFO:tasks.workunit.client.0.smithi067.stdout:7/633: chown d4/d25/d39/d46/d60/l72 267695809 1 2024-01-17T23:43:23.798 INFO:tasks.workunit.client.0.smithi067.stdout:7/634: dread d4/d25/f38 [0,4194304] 0 2024-01-17T23:43:23.820 INFO:tasks.workunit.client.0.smithi067.stdout:7/635: write d4/de/f14 [2406777,103867] 0 2024-01-17T23:43:23.820 INFO:tasks.workunit.client.0.smithi067.stdout:7/636: fsync d4/de/d40/f42 0 2024-01-17T23:43:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:7/637: dwrite d4/de/d40/f42 [4194304,4194304] 0 2024-01-17T23:43:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:7/638: truncate d4/d25/d39/d46/f99 2253698 0 2024-01-17T23:43:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:7/639: readlink d4/d25/l6c 0 2024-01-17T23:43:23.968 INFO:tasks.workunit.client.0.smithi067.stdout:2/599: rename d5/d2f/l47 to d5/d1f/d2a/d54/d8/d4c/d84/ld4 0 2024-01-17T23:43:24.241 INFO:tasks.workunit.client.0.smithi067.stdout:3/669: dwrite d0/d34/d35/d57/fa0 [0,4194304] 0 2024-01-17T23:43:24.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/670: write d0/d13/d1a/d38/f53 [1724021,89897] 0 2024-01-17T23:43:24.434 INFO:tasks.workunit.client.0.smithi067.stdout:1/629: truncate d0/d7/d13/d3a/d3e/f88 3843666 0 2024-01-17T23:43:24.434 INFO:tasks.workunit.client.0.smithi067.stdout:1/630: chown d0/d7/d13/d3a/fa6 1357 1 2024-01-17T23:43:24.434 INFO:tasks.workunit.client.0.smithi067.stdout:8/665: getdents d6/d26/d56/dbb 0 2024-01-17T23:43:24.434 INFO:tasks.workunit.client.0.smithi067.stdout:8/666: write d6/db/d58/fbe [815656,127162] 0 2024-01-17T23:43:24.461 INFO:tasks.workunit.client.0.smithi067.stdout:6/665: read d6/d9/d30/f5a [4687704,55680] 0 2024-01-17T23:43:24.835 INFO:tasks.workunit.client.0.smithi067.stdout:0/670: symlink d3/d5/d32/d7f/dc6/l101 0 2024-01-17T23:43:24.835 INFO:tasks.workunit.client.0.smithi067.stdout:0/671: fdatasync d3/d5/d32/dc5/ff8 0 2024-01-17T23:43:24.838 INFO:tasks.workunit.client.0.smithi067.stdout:7/640: creat d4/de/d41/da2/db3/da9/fbf x:0 0 0 2024-01-17T23:43:24.851 INFO:tasks.workunit.client.0.smithi067.stdout:0/672: dread d3/d5/d1a/d1c/f63 [0,4194304] 0 2024-01-17T23:43:24.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/600: link d5/d1f/d98/d9f/la6 d5/d1f/d2a/d55/ld5 0 2024-01-17T23:43:25.006 INFO:tasks.workunit.client.0.smithi067.stdout:2/601: dread d5/d1f/d2a/f4a [0,4194304] 0 2024-01-17T23:43:25.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/671: mkdir d0/d13/d4a/d75/dcb 0 2024-01-17T23:43:25.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/641: rename d4/de/d41/c48 to d4/d25/d39/d8a/cc0 0 2024-01-17T23:43:25.856 INFO:tasks.workunit.client.0.smithi067.stdout:0/673: symlink d3/d64/d7d/de6/l102 0 2024-01-17T23:43:25.857 INFO:tasks.workunit.client.0.smithi067.stdout:7/642: creat d4/d25/d39/d79/d8c/fc1 x:0 0 0 2024-01-17T23:43:25.875 INFO:tasks.workunit.client.0.smithi067.stdout:0/674: read d3/d5/d32/f41 [6292515,116652] 0 2024-01-17T23:43:26.513 INFO:tasks.workunit.client.0.smithi067.stdout:0/675: creat d3/d5/d1a/d1c/d1d/f103 x:0 0 0 2024-01-17T23:43:26.610 INFO:tasks.workunit.client.0.smithi067.stdout:2/602: mkdir d5/d1f/d2a/d54/d39/d68/dd6 0 2024-01-17T23:43:26.611 INFO:tasks.workunit.client.0.smithi067.stdout:2/603: stat d5/d1f/d2a/d8d 0 2024-01-17T23:43:26.643 INFO:tasks.workunit.client.0.smithi067.stdout:2/604: dwrite d5/d1f/d2a/d54/f24 [0,4194304] 0 2024-01-17T23:43:26.697 INFO:tasks.workunit.client.0.smithi067.stdout:7/643: unlink d4/d25/d39/d46/l6f 0 2024-01-17T23:43:26.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/676: mknod d3/c104 0 2024-01-17T23:43:26.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/677: write d3/d6/fdc [1043639,30862] 0 2024-01-17T23:43:26.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/678: truncate d3/d64/d7d/de6/f100 386457 0 2024-01-17T23:43:26.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/679: fsync d3/d5/d1a/d1c/d4e/d6b/f8f 0 2024-01-17T23:43:26.797 INFO:tasks.workunit.client.0.smithi067.stdout:0/680: fsync d3/d5/d32/d7f/dc6/feb 0 2024-01-17T23:43:27.219 INFO:tasks.workunit.client.0.smithi067.stdout:2/605: truncate d5/d1f/d2a/d54/d8/f3f 2109152 0 2024-01-17T23:43:27.219 INFO:tasks.workunit.client.0.smithi067.stdout:7/644: getdents d4 0 2024-01-17T23:43:28.698 INFO:tasks.workunit.client.0.smithi067.stdout:7/645: dwrite d4/d25/d39/d46/f99 [0,4194304] 0 2024-01-17T23:43:29.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/646: unlink d4/d4b/f61 0 2024-01-17T23:43:29.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/647: write d4/d25/d39/f70 [1220540,16175] 0 2024-01-17T23:43:29.053 INFO:tasks.workunit.client.0.smithi067.stdout:7/648: dwrite d4/d25/d39/d8a/f97 [0,4194304] 0 2024-01-17T23:43:29.053 INFO:tasks.workunit.client.0.smithi067.stdout:7/649: chown d4/d4b/c83 1059 1 2024-01-17T23:43:29.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/650: dread d4/de/d40/f71 [0,4194304] 0 2024-01-17T23:43:29.634 INFO:tasks.workunit.client.0.smithi067.stdout:7/651: creat d4/de/d40/d84/d8b/fc2 x:0 0 0 2024-01-17T23:43:29.662 INFO:tasks.workunit.client.0.smithi067.stdout:1/631: write d0/d7/f4c [5178418,2631] 0 2024-01-17T23:43:29.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/666: dwrite d6/d9/d30/d4c/f6d [0,4194304] 0 2024-01-17T23:43:29.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/667: write d6/d18/d2e/f50 [110609,56411] 0 2024-01-17T23:43:30.134 INFO:tasks.workunit.client.0.smithi067.stdout:3/672: write d0/f14 [4349670,129470] 0 2024-01-17T23:43:30.134 INFO:tasks.workunit.client.0.smithi067.stdout:3/673: chown d0/d34/d35/d57/f79 19 1 2024-01-17T23:43:30.134 INFO:tasks.workunit.client.0.smithi067.stdout:3/674: fdatasync d0/d34/d35/d57/f79 0 2024-01-17T23:43:30.134 INFO:tasks.workunit.client.0.smithi067.stdout:3/675: write d0/d12/d1b/d4d/f71 [1186994,13146] 0 2024-01-17T23:43:30.137 INFO:tasks.workunit.client.0.smithi067.stdout:4/602: creat d3/fc1 x:0 0 0 2024-01-17T23:43:30.663 INFO:tasks.workunit.client.0.smithi067.stdout:7/652: mkdir d4/d16/dc3 0 2024-01-17T23:43:30.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/523: unlink d3/d6/l69 0 2024-01-17T23:43:30.691 INFO:tasks.workunit.client.0.smithi067.stdout:7/653: dwrite d4/d25/d39/d46/d78/d93/fa1 [0,4194304] 0 2024-01-17T23:43:30.692 INFO:tasks.workunit.client.0.smithi067.stdout:7/654: chown d4/d25/d39/c2a 143678928 1 2024-01-17T23:43:31.077 INFO:tasks.workunit.client.0.smithi067.stdout:6/668: dwrite d6/f88 [0,4194304] 0 2024-01-17T23:43:31.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/676: mkdir d0/d17/d69/d6e/dcc 0 2024-01-17T23:43:31.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/667: rmdir d6/d19/db4 39 2024-01-17T23:43:31.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/668: chown d6/d19/d22/d25/d53/d65/db6 818375994 1 2024-01-17T23:43:31.564 INFO:tasks.workunit.client.0.smithi067.stdout:9/524: creat d3/d6/d2a/da2/fb9 x:0 0 0 2024-01-17T23:43:31.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/669: read d6/d9/f9c [107628,91440] 0 2024-01-17T23:43:31.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/670: write d6/d9/d1c/d1e/d43/d78/fa1 [828213,111315] 0 2024-01-17T23:43:32.073 INFO:tasks.workunit.client.0.smithi067.stdout:3/677: creat d0/d12/d1b/fcd x:0 0 0 2024-01-17T23:43:32.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/678: dwrite d0/d13/d4a/fb0 [0,4194304] 0 2024-01-17T23:43:32.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/679: chown d0/d12/d1b/d4d/f71 178734 1 2024-01-17T23:43:32.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/680: write d0/d17/dc8/fa3 [1439392,105135] 0 2024-01-17T23:43:32.119 INFO:tasks.workunit.client.0.smithi067.stdout:8/669: mknod d6/d26/d56/d89/ce7 0 2024-01-17T23:43:32.119 INFO:tasks.workunit.client.0.smithi067.stdout:8/670: creat d6/d26/d3e/d6c/fe8 x:0 0 0 2024-01-17T23:43:32.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/671: dread d6/db/d58/f3d [0,4194304] 0 2024-01-17T23:43:32.128 INFO:tasks.workunit.client.0.smithi067.stdout:8/672: dread d6/d19/d22/d25/d53/f16 [0,4194304] 0 2024-01-17T23:43:32.220 INFO:tasks.workunit.client.0.smithi067.stdout:9/525: mkdir d3/d6/da4/dba 0 2024-01-17T23:43:32.220 INFO:tasks.workunit.client.0.smithi067.stdout:9/526: readlink d3/d6/l8 0 2024-01-17T23:43:32.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/566: sync 2024-01-17T23:43:32.588 INFO:tasks.workunit.client.0.smithi067.stdout:3/681: mkdir d0/d12/dce 0 2024-01-17T23:43:32.861 INFO:tasks.workunit.client.0.smithi067.stdout:8/673: mknod d6/d19/dcf/ce9 0 2024-01-17T23:43:32.953 INFO:tasks.workunit.client.0.smithi067.stdout:9/527: unlink d3/d6/d10/l24 0 2024-01-17T23:43:33.094 INFO:tasks.workunit.client.0.smithi067.stdout:5/567: mknod d10/d53/d9a/cb5 0 2024-01-17T23:43:33.094 INFO:tasks.workunit.client.0.smithi067.stdout:5/568: write d10/d24/d59/f67 [4831042,103358] 0 2024-01-17T23:43:33.159 INFO:tasks.workunit.client.0.smithi067.stdout:0/681: sync 2024-01-17T23:43:33.159 INFO:tasks.workunit.client.0.smithi067.stdout:2/606: sync 2024-01-17T23:43:34.096 INFO:tasks.workunit.client.0.smithi067.stdout:9/528: symlink d3/d25/d5d/lbb 0 2024-01-17T23:43:34.308 INFO:tasks.workunit.client.0.smithi067.stdout:0/682: truncate d3/d6/dd/f4a 1825997 0 2024-01-17T23:43:34.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/529: mkdir d3/d6/da4/d55/da1/dbc 0 2024-01-17T23:43:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:6/671: dwrite d6/d9/d1c/d1e/d43/d86/fe4 [0,4194304] 0 2024-01-17T23:43:34.773 INFO:tasks.workunit.client.0.smithi067.stdout:6/672: write d6/d9/d1c/d1e/d43/d86/da5/fc3 [1361705,116084] 0 2024-01-17T23:43:34.831 INFO:tasks.workunit.client.0.smithi067.stdout:0/683: link d3/d5/d1a/d1c/d1d/f103 d3/d5/d1a/d1c/dd4/f105 0 2024-01-17T23:43:34.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/607: getdents d5/d1f/d2a/d54/d7c 0 2024-01-17T23:43:34.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/608: creat d5/d1f/d2a/d55/fd7 x:0 0 0 2024-01-17T23:43:34.948 INFO:tasks.workunit.client.0.smithi067.stdout:2/609: write d5/d1f/d2a/d54/f1a [3838953,106412] 0 2024-01-17T23:43:34.965 INFO:tasks.workunit.client.0.smithi067.stdout:2/610: dread d5/d2f/f4b [0,4194304] 0 2024-01-17T23:43:34.965 INFO:tasks.workunit.client.0.smithi067.stdout:2/611: chown d5/d1f/d2a/d54/d7c/fcb 221 1 2024-01-17T23:43:34.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/612: dwrite d5/d1f/d98/d9f/fae [0,4194304] 0 2024-01-17T23:43:35.069 INFO:tasks.workunit.client.0.smithi067.stdout:9/530: mkdir d3/d6/d2a/da2/dbd 0 2024-01-17T23:43:35.069 INFO:tasks.workunit.client.0.smithi067.stdout:9/531: truncate d3/d58/f81 368410 0 2024-01-17T23:43:35.370 INFO:tasks.workunit.client.0.smithi067.stdout:6/673: truncate d6/d9/d1c/f2f 2174437 0 2024-01-17T23:43:35.800 INFO:tasks.workunit.client.0.smithi067.stdout:0/684: symlink d3/d64/d7d/l106 0 2024-01-17T23:43:36.198 INFO:tasks.workunit.client.0.smithi067.stdout:2/613: chown d5/d1f/d2a/d54/d39/l3d 5 1 2024-01-17T23:43:36.198 INFO:tasks.workunit.client.0.smithi067.stdout:2/614: write d5/d1f/d2a/d54/d39/d68/fb4 [92408,28608] 0 2024-01-17T23:43:36.198 INFO:tasks.workunit.client.0.smithi067.stdout:2/615: truncate d5/d1f/d2a/d54/d8/fce 288371 0 2024-01-17T23:43:36.325 INFO:tasks.workunit.client.0.smithi067.stdout:9/532: rmdir d3/d6/da4 39 2024-01-17T23:43:36.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/674: creat d6/d18/fe9 x:0 0 0 2024-01-17T23:43:36.465 INFO:tasks.workunit.client.0.smithi067.stdout:0/685: dread d3/d5/d32/fa5 [0,4194304] 0 2024-01-17T23:43:36.679 INFO:tasks.workunit.client.0.smithi067.stdout:6/675: symlink d6/d9/d30/lea 0 2024-01-17T23:43:36.679 INFO:tasks.workunit.client.0.smithi067.stdout:6/676: creat d6/d18/d44/d51/feb x:0 0 0 2024-01-17T23:43:36.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/686: mkdir d3/d6/dd/d107 0 2024-01-17T23:43:36.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/687: write d3/d5/f38 [4738243,10093] 0 2024-01-17T23:43:36.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/688: chown d3/d64/lba 6 1 2024-01-17T23:43:36.784 INFO:tasks.workunit.client.0.smithi067.stdout:0/689: chown d3/d5/d1a/d1c/d1d/d2e/f8e 5 1 2024-01-17T23:43:37.222 INFO:tasks.workunit.client.0.smithi067.stdout:1/632: rename d0/c9e to d0/d7/d13/cc7 0 2024-01-17T23:43:37.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/677: unlink d6/d18/d44/d51/f5d 0 2024-01-17T23:43:37.313 INFO:tasks.workunit.client.0.smithi067.stdout:0/690: mkdir d3/d5/d32/d7f/dc6/d108 0 2024-01-17T23:43:37.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/678: chown d6/d18/d2e/d61/d9a/cc8 357033 1 2024-01-17T23:43:37.327 INFO:tasks.workunit.client.0.smithi067.stdout:0/691: dread d3/f47 [0,4194304] 0 2024-01-17T23:43:37.337 INFO:tasks.workunit.client.0.smithi067.stdout:6/679: write d6/d9/d30/f7b [77694,22573] 0 2024-01-17T23:43:37.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/680: dread d6/d9/d1c/d1e/d43/f9f [0,4194304] 0 2024-01-17T23:43:37.346 INFO:tasks.workunit.client.0.smithi067.stdout:6/681: dread d6/d9/f9c [0,4194304] 0 2024-01-17T23:43:37.348 INFO:tasks.workunit.client.0.smithi067.stdout:0/692: dread d3/d5/d1a/f24 [0,4194304] 0 2024-01-17T23:43:37.348 INFO:tasks.workunit.client.0.smithi067.stdout:0/693: readlink d3/d5/d1a/d1c/l5c 0 2024-01-17T23:43:37.397 INFO:tasks.workunit.client.0.smithi067.stdout:5/569: write d10/d24/f5f [3529280,112208] 0 2024-01-17T23:43:37.398 INFO:tasks.workunit.client.0.smithi067.stdout:5/570: chown d10/d53/f62 159422 1 2024-01-17T23:43:37.632 INFO:tasks.workunit.client.0.smithi067.stdout:1/633: rmdir d0/d7/d13 39 2024-01-17T23:43:37.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/603: rename d3/d8/d35/d36/c37 to d3/d8/de/d38/cc2 0 2024-01-17T23:43:37.632 INFO:tasks.workunit.client.0.smithi067.stdout:6/682: creat d6/d18/fec x:0 0 0 2024-01-17T23:43:37.633 INFO:tasks.workunit.client.0.smithi067.stdout:6/683: readlink d6/d9/d3e/l69 0 2024-01-17T23:43:37.633 INFO:tasks.workunit.client.0.smithi067.stdout:4/604: write d3/d5/d93/d9e/f9c [15027,125032] 0 2024-01-17T23:43:37.633 INFO:tasks.workunit.client.0.smithi067.stdout:4/605: write d3/d8/de/f54 [4285862,73670] 0 2024-01-17T23:43:37.633 INFO:tasks.workunit.client.0.smithi067.stdout:0/694: mknod d3/d5/d32/c109 0 2024-01-17T23:43:37.661 INFO:tasks.workunit.client.0.smithi067.stdout:0/695: dwrite d3/d5/d1a/d1c/d4e/d7c/ffe [0,4194304] 0 2024-01-17T23:43:38.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/634: link d0/d69/fc6 d0/d7/d13/d3d/d48/fc8 0 2024-01-17T23:43:38.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/635: dwrite d0/f5 [0,4194304] 0 2024-01-17T23:43:39.279 INFO:tasks.workunit.client.0.smithi067.stdout:4/606: link d3/d26/d34/fb2 d3/fc3 0 2024-01-17T23:43:39.279 INFO:tasks.workunit.client.0.smithi067.stdout:4/607: chown d3/d40/fae 52832328 1 2024-01-17T23:43:39.589 INFO:tasks.workunit.client.0.smithi067.stdout:0/696: getdents d3/d5/d1a/d1c/d4e 0 2024-01-17T23:43:39.589 INFO:tasks.workunit.client.0.smithi067.stdout:0/697: chown d3/d5/d1a/d1c/d4d/lcd 116010 1 2024-01-17T23:43:39.594 INFO:tasks.workunit.client.0.smithi067.stdout:0/698: write d3/d5/d1a/d1c/f63 [4210185,33676] 0 2024-01-17T23:43:39.618 INFO:tasks.workunit.client.0.smithi067.stdout:0/699: dwrite d3/d6/f17 [0,4194304] 0 2024-01-17T23:43:39.901 INFO:tasks.workunit.client.0.smithi067.stdout:1/636: dwrite d0/d7/d7f/d82/d35/f83 [0,4194304] 0 2024-01-17T23:43:39.993 INFO:tasks.workunit.client.0.smithi067.stdout:4/608: mknod d3/d8/de/da6/cc4 0 2024-01-17T23:43:40.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/609: dwrite d3/fc3 [0,4194304] 0 2024-01-17T23:43:40.047 INFO:tasks.workunit.client.0.smithi067.stdout:4/610: write d3/d8/d35/f6e [1149371,78851] 0 2024-01-17T23:43:40.524 INFO:tasks.workunit.client.0.smithi067.stdout:9/533: dwrite d3/d6/d11/d50/d84/da8/fab [0,4194304] 0 2024-01-17T23:43:40.901 INFO:tasks.workunit.client.0.smithi067.stdout:8/674: sync 2024-01-17T23:43:40.902 INFO:tasks.workunit.client.0.smithi067.stdout:8/675: fsync d6/d19/d22/d25/d53/d65/f28 0 2024-01-17T23:43:41.548 INFO:tasks.workunit.client.0.smithi067.stdout:0/700: truncate d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/fca 3430111 0 2024-01-17T23:43:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:9/534: mkdir d3/d6/d11/dbe 0 2024-01-17T23:43:42.139 INFO:tasks.workunit.client.0.smithi067.stdout:9/535: read d3/d6/d11/d50/f77 [662311,112073] 0 2024-01-17T23:43:42.167 INFO:tasks.workunit.client.0.smithi067.stdout:9/536: dwrite d3/d25/f9a [0,4194304] 0 2024-01-17T23:43:42.261 INFO:tasks.workunit.client.0.smithi067.stdout:5/571: sync 2024-01-17T23:43:42.609 INFO:tasks.workunit.client.0.smithi067.stdout:9/537: link d3/d6/da4/c1a d3/d6/d2a/d34/d42/d9c/da5/da6/cbf 0 2024-01-17T23:43:42.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/572: creat d10/d24/d59/d8c/fb6 x:0 0 0 2024-01-17T23:43:43.048 INFO:tasks.workunit.client.0.smithi067.stdout:9/538: unlink d3/d6/d47/d6d/l95 0 2024-01-17T23:43:44.118 INFO:tasks.workunit.client.0.smithi067.stdout:9/539: creat d3/d25/d5d/fc0 x:0 0 0 2024-01-17T23:43:44.118 INFO:tasks.workunit.client.0.smithi067.stdout:9/540: write d3/d6/d2a/d34/d42/f4d [3465025,2720] 0 2024-01-17T23:43:44.118 INFO:tasks.workunit.client.0.smithi067.stdout:9/541: fsync d3/d6/da4/d55/f7b 0 2024-01-17T23:43:44.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:44.200 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:43:44.472 INFO:tasks.workunit.client.0.smithi067.stdout:9/542: symlink d3/d6/d11/d50/d84/da8/da9/lc1 0 2024-01-17T23:43:44.472 INFO:tasks.workunit.client.0.smithi067.stdout:9/543: fsync d3/d6/da4/f44 0 2024-01-17T23:43:44.717 INFO:tasks.workunit.client.0.smithi067.stdout:7/655: rename d4/de to d4/d25/d39/d46/d78/d93/d94/dc4 0 2024-01-17T23:43:44.833 INFO:tasks.workunit.client.0.smithi067.stdout:9/544: stat d3/d6/l9d 0 2024-01-17T23:43:44.855 INFO:tasks.workunit.client.0.smithi067.stdout:9/545: dread d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:43:45.013 INFO:tasks.workunit.client.0.smithi067.stdout:3/682: rename d0/d13/d1a/d38/f47 to d0/d17/d69/d6e/fcf 0 2024-01-17T23:43:45.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/683: write d0/d13/fa9 [629368,78804] 0 2024-01-17T23:43:45.172 INFO:tasks.workunit.client.0.smithi067.stdout:7/656: getdents d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9 0 2024-01-17T23:43:45.359 INFO:tasks.workunit.client.0.smithi067.stdout:9/546: mkdir d3/d6/d47/d88/dc2 0 2024-01-17T23:43:45.937 INFO:tasks.workunit.client.0.smithi067.stdout:7/657: symlink d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/lc5 0 2024-01-17T23:43:45.937 INFO:tasks.workunit.client.0.smithi067.stdout:7/658: creat d4/d4b/d63/d9c/fc6 x:0 0 0 2024-01-17T23:43:46.176 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:44:34.393 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.181 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:44:34.398 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.200 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:44:34.512 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.206 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:44:34.518 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.212 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:44:34.524 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.219 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:44:34.531 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.238 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:44:34.456 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.297 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:44:34.609 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.302 INFO:tasks.workunit.client.0.smithi067.stdout:2/616: rename d5/d1f/d2a/d55/fd7 to d5/d1f/d2a/d73/d95/fd8 0 2024-01-17T23:43:46.303 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:44:34.615 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:43:46.385 INFO:tasks.workunit.client.0.smithi067.stdout:2/617: dwrite d5/d1f/d2a/d54/d7c/fcb [0,4194304] 0 2024-01-17T23:43:46.645 INFO:tasks.workunit.client.0.smithi067.stdout:8/676: sync 2024-01-17T23:43:46.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/637: sync 2024-01-17T23:43:46.646 INFO:tasks.workunit.client.0.smithi067.stdout:4/611: sync 2024-01-17T23:43:46.646 INFO:tasks.workunit.client.0.smithi067.stdout:4/612: readlink d3/d26/d34/d3a/d53/l7a 0 2024-01-17T23:43:46.669 INFO:tasks.workunit.client.0.smithi067.stdout:1/638: write d0/fa5 [168971,124628] 0 2024-01-17T23:43:46.681 INFO:tasks.workunit.client.0.smithi067.stdout:4/613: dwrite d3/d8/f1f [4194304,4194304] 0 2024-01-17T23:43:46.702 INFO:tasks.workunit.client.0.smithi067.stdout:7/659: mkdir d4/d25/d39/d46/d60/dc7 0 2024-01-17T23:43:46.867 INFO:tasks.workunit.client.0.smithi067.stdout:6/684: rename d6/d9/d1c/d1e/c5c to d6/d9/d3e/ced 0 2024-01-17T23:43:47.065 INFO:tasks.workunit.client.0.smithi067.stdout:2/618: mknod d5/d1f/d2a/d54/d39/d68/dd6/cd9 0 2024-01-17T23:43:47.127 INFO:tasks.workunit.client.0.smithi067.stdout:8/677: mknod d6/d19/cea 0 2024-01-17T23:43:47.404 INFO:tasks.workunit.client.0.smithi067.stdout:1/639: link d0/d7/d13/d3a/d45/cc5 d0/d7/d13/d77/cc9 0 2024-01-17T23:43:47.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/614: mkdir d3/d8/de/d20/d3b/d7c/d92/dc5 0 2024-01-17T23:43:47.430 INFO:tasks.workunit.client.0.smithi067.stdout:3/684: dwrite d0/d17/dc8/f66 [0,4194304] 0 2024-01-17T23:43:47.430 INFO:tasks.workunit.client.0.smithi067.stdout:3/685: fsync d0/d17/f23 0 2024-01-17T23:43:47.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/701: rename d3/d5/d32/fa5 to d3/d6/dd/dc4/f10a 0 2024-01-17T23:43:47.805 INFO:tasks.workunit.client.0.smithi067.stdout:2/619: symlink d5/d1f/d2a/d54/d8/d4c/dbf/lda 0 2024-01-17T23:43:48.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/640: creat d0/fca x:0 0 0 2024-01-17T23:43:48.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/547: write d3/d6/d11/f23 [6852249,75936] 0 2024-01-17T23:43:48.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/548: readlink d3/d6/d11/l12 0 2024-01-17T23:43:48.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/549: read - d3/f85 zero size 2024-01-17T23:43:48.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/550: getdents d3/d6/d47/db4 0 2024-01-17T23:43:48.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/686: mkdir d0/d13/d4a/d75/dd0 0 2024-01-17T23:43:48.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/687: write d0/f7c [842339,65379] 0 2024-01-17T23:43:48.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/688: dread - d0/d13/d1a/fc9 zero size 2024-01-17T23:43:48.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/689: dread - d0/d34/d35/d57/d87/faa zero size 2024-01-17T23:43:48.766 INFO:tasks.workunit.client.0.smithi067.stdout:3/690: chown d0/d12/d1b/d4d/lb4 34038897 1 2024-01-17T23:43:48.867 INFO:tasks.workunit.client.0.smithi067.stdout:5/573: rename d10/d24/c6c to d10/d24/d59/d8c/dae/cb7 0 2024-01-17T23:43:49.076 INFO:tasks.workunit.client.0.smithi067.stdout:2/620: truncate d5/d1f/d2a/f4a 4189933 0 2024-01-17T23:43:49.103 INFO:tasks.workunit.client.0.smithi067.stdout:2/621: read d5/d1f/d2a/d73/d95/fa8 [4010122,78960] 0 2024-01-17T23:43:49.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/622: dwrite d5/d1f/d2a/d54/f11 [0,4194304] 0 2024-01-17T23:43:49.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/623: write d5/d1f/d2a/d73/d95/fa8 [3569772,72399] 0 2024-01-17T23:43:49.148 INFO:tasks.workunit.client.0.smithi067.stdout:2/624: read d5/d1f/d2a/d55/f99 [194994,74132] 0 2024-01-17T23:43:49.148 INFO:tasks.workunit.client.0.smithi067.stdout:2/625: readlink d5/d1f/d35/la3 0 2024-01-17T23:43:49.377 INFO:tasks.workunit.client.0.smithi067.stdout:8/678: rmdir d6/d26/d3e/d6c 39 2024-01-17T23:43:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/679: chown d6/d19/d22/d25/d53/d54/f77 87504 1 2024-01-17T23:43:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/680: stat d6/db/d58/d5f 0 2024-01-17T23:43:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:1/641: creat d0/d7/d13/d77/fcb x:0 0 0 2024-01-17T23:43:49.378 INFO:tasks.workunit.client.0.smithi067.stdout:1/642: readlink d0/d74/d31/l85 0 2024-01-17T23:43:49.399 INFO:tasks.workunit.client.0.smithi067.stdout:8/681: dwrite d6/db/d58/f6e [0,4194304] 0 2024-01-17T23:43:49.400 INFO:tasks.workunit.client.0.smithi067.stdout:8/682: chown d6/d26/d3e 613142761 1 2024-01-17T23:43:49.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/683: dwrite d6/d19/d22/d25/d53/fce [0,4194304] 0 2024-01-17T23:43:49.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/684: chown d6/d19/d22/le6 284911538 1 2024-01-17T23:43:49.557 INFO:tasks.workunit.client.0.smithi067.stdout:9/551: creat d3/d6/d2a/d34/d42/d9c/da5/fc3 x:0 0 0 2024-01-17T23:43:49.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/660: rename d4/d25/d39 to d4/d25/d39/d46/dc8 22 2024-01-17T23:43:49.890 INFO:tasks.workunit.client.0.smithi067.stdout:7/661: dread d4/f19 [0,4194304] 0 2024-01-17T23:43:50.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/685: write d6/fd [4640591,56706] 0 2024-01-17T23:43:50.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/686: chown d6/d9/d30/f70 2641962 1 2024-01-17T23:43:50.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/687: dread - d6/d9/d30/d4c/f54 zero size 2024-01-17T23:43:50.365 INFO:tasks.workunit.client.0.smithi067.stdout:6/688: dwrite d6/d9/d30/d58/fa8 [0,4194304] 0 2024-01-17T23:43:50.649 INFO:tasks.workunit.client.0.smithi067.stdout:2/626: rmdir d5/d1f/d2a/d54/d39/d68/dd6 39 2024-01-17T23:43:50.661 INFO:tasks.workunit.client.0.smithi067.stdout:2/627: dread d5/d1f/f43 [0,4194304] 0 2024-01-17T23:43:51.025 INFO:tasks.workunit.client.0.smithi067.stdout:1/643: dread d0/d7/d13/d3a/f51 [0,4194304] 0 2024-01-17T23:43:51.331 INFO:tasks.workunit.client.0.smithi067.stdout:9/552: symlink d3/d6/da4/lc4 0 2024-01-17T23:43:51.351 INFO:tasks.workunit.client.0.smithi067.stdout:9/553: dread d3/d6/da4/f44 [4194304,4194304] 0 2024-01-17T23:43:51.778 INFO:tasks.workunit.client.0.smithi067.stdout:6/689: dread d6/d9/d1c/d1e/d43/d86/f97 [0,4194304] 0 2024-01-17T23:43:51.902 INFO:tasks.workunit.client.0.smithi067.stdout:2/628: creat d5/d1f/d2a/d54/d39/fdb x:0 0 0 2024-01-17T23:43:51.903 INFO:tasks.workunit.client.0.smithi067.stdout:0/702: sync 2024-01-17T23:43:51.903 INFO:tasks.workunit.client.0.smithi067.stdout:0/703: getdents d3/d5/d32/d9f/dee 0 2024-01-17T23:43:52.250 INFO:tasks.workunit.client.0.smithi067.stdout:1/644: symlink d0/d7/d7f/lcc 0 2024-01-17T23:43:52.432 INFO:tasks.workunit.client.0.smithi067.stdout:5/574: sync 2024-01-17T23:43:52.458 INFO:tasks.workunit.client.0.smithi067.stdout:5/575: dwrite d10/d24/d59/d5d/f95 [0,4194304] 0 2024-01-17T23:43:52.471 INFO:tasks.workunit.client.0.smithi067.stdout:5/576: write d10/f6e [2823578,63542] 0 2024-01-17T23:43:52.501 INFO:tasks.workunit.client.0.smithi067.stdout:5/577: dwrite d10/f7b [0,4194304] 0 2024-01-17T23:43:52.839 INFO:tasks.workunit.client.0.smithi067.stdout:4/615: rename d3/d8/de to d3/d26/d34/d3a/d53/dc6 0 2024-01-17T23:43:52.839 INFO:tasks.workunit.client.0.smithi067.stdout:4/616: chown d3/d26/d34/d3a/d53/dc6/d20/d3b/f51 74707 1 2024-01-17T23:43:52.922 INFO:tasks.workunit.client.0.smithi067.stdout:6/690: mknod d6/d18/d2e/d61/d9a/cee 0 2024-01-17T23:43:52.945 INFO:tasks.workunit.client.0.smithi067.stdout:6/691: write d6/d9/d30/d4c/f6d [2333927,60938] 0 2024-01-17T23:43:53.358 INFO:tasks.workunit.client.0.smithi067.stdout:0/704: symlink d3/d5/d1a/d1c/dd4/l10b 0 2024-01-17T23:43:53.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/645: creat d0/d7/d13/d3d/d48/da4/fcd x:0 0 0 2024-01-17T23:43:53.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/646: chown d0/d7/d13/d3a/d3e/cbb 0 1 2024-01-17T23:43:53.561 INFO:tasks.workunit.client.0.smithi067.stdout:9/554: mknod d3/d6/d2e/cc5 0 2024-01-17T23:43:53.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/578: dread d10/d53/f83 [0,4194304] 0 2024-01-17T23:43:53.884 INFO:tasks.workunit.client.0.smithi067.stdout:5/579: dwrite d10/d24/d59/fb3 [0,4194304] 0 2024-01-17T23:43:53.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/662: rename d4/d4b/c83 to d4/d25/d39/d46/d78/d93/cc9 0 2024-01-17T23:43:53.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/663: dread - d4/faf zero size 2024-01-17T23:43:54.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/685: sync 2024-01-17T23:43:54.047 INFO:tasks.workunit.client.0.smithi067.stdout:4/617: mkdir d3/d26/d34/d3a/d53/dc6/dc7 0 2024-01-17T23:43:54.413 INFO:tasks.workunit.client.0.smithi067.stdout:3/691: dwrite d0/d34/d35/d65/d6f/fc3 [0,4194304] 0 2024-01-17T23:43:54.519 INFO:tasks.workunit.client.0.smithi067.stdout:1/647: symlink d0/d62/lce 0 2024-01-17T23:43:54.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/580: dread d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:43:55.246 INFO:tasks.workunit.client.0.smithi067.stdout:2/629: rename d5/d1f/f64 to d5/d1f/d98/d9f/dbb/fdc 0 2024-01-17T23:43:55.246 INFO:tasks.workunit.client.0.smithi067.stdout:7/664: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca 0 2024-01-17T23:43:55.246 INFO:tasks.workunit.client.0.smithi067.stdout:2/630: chown d5/d1f/lc0 0 1 2024-01-17T23:43:55.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/686: creat d6/db/de3/feb x:0 0 0 2024-01-17T23:43:55.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/687: fdatasync d6/d26/d3e/d6c/fc9 0 2024-01-17T23:43:55.370 INFO:tasks.workunit.client.0.smithi067.stdout:8/688: dwrite d6/d26/d3e/d6c/fc7 [0,4194304] 0 2024-01-17T23:43:55.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/689: write d6/db/d58/d5f/fb7 [214691,17734] 0 2024-01-17T23:43:55.536 INFO:tasks.workunit.client.0.smithi067.stdout:0/705: mkdir d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c 0 2024-01-17T23:43:55.536 INFO:tasks.workunit.client.0.smithi067.stdout:0/706: chown d3/d5/d1a/d1c/d4e/d6b/ca0 443 1 2024-01-17T23:43:55.702 INFO:tasks.workunit.client.0.smithi067.stdout:3/692: creat d0/d12/fd1 x:0 0 0 2024-01-17T23:43:55.702 INFO:tasks.workunit.client.0.smithi067.stdout:3/693: creat d0/d12/d1b/d4d/fd2 x:0 0 0 2024-01-17T23:43:55.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/648: getdents d0/d7/d13/d3d 0 2024-01-17T23:43:55.862 INFO:tasks.workunit.client.0.smithi067.stdout:6/692: rmdir d6/d9 39 2024-01-17T23:43:56.074 INFO:tasks.workunit.client.0.smithi067.stdout:5/581: mknod d10/d24/d46/cb8 0 2024-01-17T23:43:56.294 INFO:tasks.workunit.client.0.smithi067.stdout:9/555: rename d3/d6/d2a/d34/f8b to d3/d6/d2a/fc6 0 2024-01-17T23:43:57.241 INFO:tasks.workunit.client.0.smithi067.stdout:8/690: mkdir d6/d19/d22/dec 0 2024-01-17T23:43:57.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/691: dread d6/db/d58/d5f/fb7 [0,4194304] 0 2024-01-17T23:43:57.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/692: fsync d6/d19/f3f 0 2024-01-17T23:43:57.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/693: stat d6/db/d58/fbe 0 2024-01-17T23:43:57.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/694: write d6/d19/d22/d25/d53/d48/fb0 [5420938,43753] 0 2024-01-17T23:43:57.530 INFO:tasks.workunit.client.0.smithi067.stdout:0/707: fsync d3/d5/d1a/fa4 0 2024-01-17T23:43:57.646 INFO:tasks.workunit.client.0.smithi067.stdout:3/694: unlink d0/d13/f3c 0 2024-01-17T23:43:57.670 INFO:tasks.workunit.client.0.smithi067.stdout:3/695: read d0/f11 [2189508,66779] 0 2024-01-17T23:43:57.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/696: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:43:57.702 INFO:tasks.workunit.client.0.smithi067.stdout:3/697: dread d0/d17/fac [0,4194304] 0 2024-01-17T23:43:58.130 INFO:tasks.workunit.client.0.smithi067.stdout:5/582: creat d10/d24/d46/fb9 x:0 0 0 2024-01-17T23:43:58.130 INFO:tasks.workunit.client.0.smithi067.stdout:5/583: dread - d10/d24/d46/d4a/fa1 zero size 2024-01-17T23:43:58.132 INFO:tasks.workunit.client.0.smithi067.stdout:7/665: rename d4/f2d to d4/d4b/d63/fcb 0 2024-01-17T23:43:58.219 INFO:tasks.workunit.client.0.smithi067.stdout:9/556: unlink d3/d6/d10/l90 0 2024-01-17T23:43:58.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/695: mknod d6/d19/d22/d25/d53/ced 0 2024-01-17T23:43:58.387 INFO:tasks.workunit.client.0.smithi067.stdout:8/696: write d6/d19/f3a [2999936,52075] 0 2024-01-17T23:43:58.387 INFO:tasks.workunit.client.0.smithi067.stdout:8/697: truncate d6/d26/d56/dbb/fbc 998132 0 2024-01-17T23:43:58.387 INFO:tasks.workunit.client.0.smithi067.stdout:8/698: read d6/d26/f36 [1292890,90963] 0 2024-01-17T23:43:58.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/698: mkdir d0/d13/d4a/d82/da6/dd3 0 2024-01-17T23:43:58.853 INFO:tasks.workunit.client.0.smithi067.stdout:5/584: mkdir d10/d24/d59/d8c/dba 0 2024-01-17T23:43:58.853 INFO:tasks.workunit.client.0.smithi067.stdout:5/585: readlink d10/d24/d46/d4a/d50/l65 0 2024-01-17T23:43:59.104 INFO:tasks.workunit.client.0.smithi067.stdout:9/557: mkdir d3/d6/da4/d55/da1/dbc/dc7 0 2024-01-17T23:43:59.227 INFO:tasks.workunit.client.0.smithi067.stdout:8/699: mkdir d6/d26/d56/dbb/dee 0 2024-01-17T23:43:59.257 INFO:tasks.workunit.client.0.smithi067.stdout:4/618: dwrite d3/d26/d34/d3a/d53/dc6/da6/fb9 [0,4194304] 0 2024-01-17T23:43:59.499 INFO:tasks.workunit.client.0.smithi067.stdout:3/699: unlink d0/d34/d35/d65/l7b 0 2024-01-17T23:43:59.499 INFO:tasks.workunit.client.0.smithi067.stdout:5/586: symlink d10/d24/d59/d5d/lbb 0 2024-01-17T23:43:59.997 INFO:tasks.workunit.client.0.smithi067.stdout:6/693: rename d6/d18/d44 to d6/d9/d1c/d1e/d43/def 0 2024-01-17T23:44:00.144 INFO:tasks.workunit.client.0.smithi067.stdout:8/700: truncate d6/d26/d7c/f8b 1110890 0 2024-01-17T23:44:00.428 INFO:tasks.workunit.client.0.smithi067.stdout:2/631: sync 2024-01-17T23:44:00.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/700: chown d0/l5a 450719 1 2024-01-17T23:44:00.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/701: dread d0/d17/f28 [0,4194304] 0 2024-01-17T23:44:00.560 INFO:tasks.workunit.client.0.smithi067.stdout:3/702: write d0/d34/d35/d65/d6f/fc3 [973133,7075] 0 2024-01-17T23:44:00.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/694: rmdir d6/d9/d30/d4c/dd6 0 2024-01-17T23:44:00.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/695: write d6/d9/f27 [4981879,1617] 0 2024-01-17T23:44:00.835 INFO:tasks.workunit.client.0.smithi067.stdout:0/708: rename d3/d5/d32/d7f/dc6 to d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d 0 2024-01-17T23:44:01.039 INFO:tasks.workunit.client.0.smithi067.stdout:9/558: mkdir d3/d6/d2e/dc8 0 2024-01-17T23:44:01.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/649: sync 2024-01-17T23:44:01.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/650: truncate d0/d7/d13/d3a/d75/fbf 893039 0 2024-01-17T23:44:01.673 INFO:tasks.workunit.client.0.smithi067.stdout:2/632: unlink d5/d1f/d2a/d54/d8/d4c/f4e 0 2024-01-17T23:44:01.710 INFO:tasks.workunit.client.0.smithi067.stdout:4/619: mkdir d3/d40/dc8 0 2024-01-17T23:44:01.716 INFO:tasks.workunit.client.0.smithi067.stdout:4/620: write d3/d26/d34/f7b [967283,108294] 0 2024-01-17T23:44:01.734 INFO:tasks.workunit.client.0.smithi067.stdout:4/621: dread d3/d26/d34/d3a/d53/dc6/d20/fb4 [4194304,4194304] 0 2024-01-17T23:44:01.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/703: symlink d0/d13/d4a/d82/da6/ld4 0 2024-01-17T23:44:01.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/704: write d0/f7c [1839634,93070] 0 2024-01-17T23:44:01.967 INFO:tasks.workunit.client.0.smithi067.stdout:3/705: dread d0/f11 [0,4194304] 0 2024-01-17T23:44:01.967 INFO:tasks.workunit.client.0.smithi067.stdout:3/706: write d0/d13/d4a/d82/f8c [195166,55458] 0 2024-01-17T23:44:01.981 INFO:tasks.workunit.client.0.smithi067.stdout:3/707: write d0/d12/d1b/f2d [4142738,122465] 0 2024-01-17T23:44:01.981 INFO:tasks.workunit.client.0.smithi067.stdout:3/708: truncate d0/d17/f5e 276695 0 2024-01-17T23:44:02.444 INFO:tasks.workunit.client.0.smithi067.stdout:0/709: symlink d3/d5/d32/d9f/l10e 0 2024-01-17T23:44:02.734 INFO:tasks.workunit.client.0.smithi067.stdout:1/651: creat d0/d7/d7f/d82/d35/fcf x:0 0 0 2024-01-17T23:44:02.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/633: symlink d5/d1f/d2a/d54/d8/d4c/db3/ldd 0 2024-01-17T23:44:02.887 INFO:tasks.workunit.client.0.smithi067.stdout:2/634: dwrite d5/d1f/d98/d9f/fae [0,4194304] 0 2024-01-17T23:44:02.888 INFO:tasks.workunit.client.0.smithi067.stdout:2/635: dread - d5/d2f/f8f zero size 2024-01-17T23:44:02.916 INFO:tasks.workunit.client.0.smithi067.stdout:2/636: dwrite d5/d1f/d35/f6d [0,4194304] 0 2024-01-17T23:44:02.965 INFO:tasks.workunit.client.0.smithi067.stdout:4/622: stat d3/d26/d34/d3a/d53/dc6/c2d 0 2024-01-17T23:44:03.423 INFO:tasks.workunit.client.0.smithi067.stdout:0/710: unlink d3/d6/l10 0 2024-01-17T23:44:03.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/711: truncate d3/d6/dd/f69 1887521 0 2024-01-17T23:44:03.545 INFO:tasks.workunit.client.0.smithi067.stdout:1/652: mkdir d0/d7/d13/d3d/dd0 0 2024-01-17T23:44:04.091 INFO:tasks.workunit.client.0.smithi067.stdout:4/623: symlink d3/d26/d34/d3a/d53/dc6/d20/d3b/lc9 0 2024-01-17T23:44:04.104 INFO:tasks.workunit.client.0.smithi067.stdout:6/696: read d6/fb [4347611,15960] 0 2024-01-17T23:44:04.214 INFO:tasks.workunit.client.0.smithi067.stdout:7/666: rename d4/d25/d39/d79/d8c to d4/d4b/d63/d95/dad/dcc 0 2024-01-17T23:44:04.215 INFO:tasks.workunit.client.0.smithi067.stdout:7/667: fsync d4/d16/f1e 0 2024-01-17T23:44:04.247 INFO:tasks.workunit.client.0.smithi067.stdout:7/668: dwrite d4/d25/d39/f35 [0,4194304] 0 2024-01-17T23:44:04.408 INFO:tasks.workunit.client.0.smithi067.stdout:1/653: unlink d0/d7/d7f/d82/d35/f83 0 2024-01-17T23:44:04.412 INFO:tasks.workunit.client.0.smithi067.stdout:1/654: dread d0/d7/d13/d3a/d45/f5a [0,4194304] 0 2024-01-17T23:44:04.412 INFO:tasks.workunit.client.0.smithi067.stdout:1/655: fsync d0/d7/f4c 0 2024-01-17T23:44:04.412 INFO:tasks.workunit.client.0.smithi067.stdout:1/656: fsync d0/fa5 0 2024-01-17T23:44:04.630 INFO:tasks.workunit.client.0.smithi067.stdout:2/637: mknod d5/d1f/d2a/d54/d39/cde 0 2024-01-17T23:44:04.703 INFO:tasks.workunit.client.0.smithi067.stdout:4/624: getdents d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c 0 2024-01-17T23:44:04.704 INFO:tasks.workunit.client.0.smithi067.stdout:4/625: write d3/d4e/fa3 [71760,30292] 0 2024-01-17T23:44:04.951 INFO:tasks.workunit.client.0.smithi067.stdout:5/587: rename d10/d24/d59/d5d/d43/f70 to d10/d53/d9a/fbc 0 2024-01-17T23:44:05.168 INFO:tasks.workunit.client.0.smithi067.stdout:7/669: creat d4/d25/d39/d46/d78/d93/fcd x:0 0 0 2024-01-17T23:44:05.168 INFO:tasks.workunit.client.0.smithi067.stdout:7/670: creat d4/d4b/fce x:0 0 0 2024-01-17T23:44:05.186 INFO:tasks.workunit.client.0.smithi067.stdout:7/671: write d4/f5b [7452416,118631] 0 2024-01-17T23:44:05.186 INFO:tasks.workunit.client.0.smithi067.stdout:7/672: stat d4/d4b/d7f 0 2024-01-17T23:44:05.187 INFO:tasks.workunit.client.0.smithi067.stdout:7/673: write d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fb5 [1409,122780] 0 2024-01-17T23:44:05.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/674: dread d4/f27 [0,4194304] 0 2024-01-17T23:44:05.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/701: sync 2024-01-17T23:44:05.580 INFO:tasks.workunit.client.0.smithi067.stdout:1/657: link d0/d69/fc6 d0/d7/d1c/fd1 0 2024-01-17T23:44:05.580 INFO:tasks.workunit.client.0.smithi067.stdout:1/658: fdatasync d0/d7/d13/d3d/d48/fad 0 2024-01-17T23:44:06.106 INFO:tasks.workunit.client.0.smithi067.stdout:4/626: mknod d3/d26/d34/d3a/d53/dc6/d20/d3b/cca 0 2024-01-17T23:44:06.106 INFO:tasks.workunit.client.0.smithi067.stdout:9/559: rename d3/d6/d11/d5c/lb0 to d3/d6/d11/dbe/lc9 0 2024-01-17T23:44:06.229 INFO:tasks.workunit.client.0.smithi067.stdout:5/588: read d10/d24/d59/d5d/f9f [6655389,4585] 0 2024-01-17T23:44:06.275 INFO:tasks.workunit.client.0.smithi067.stdout:5/589: dwrite d10/d24/d59/d5d/f41 [0,4194304] 0 2024-01-17T23:44:06.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/675: symlink d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/lcf 0 2024-01-17T23:44:06.523 INFO:tasks.workunit.client.0.smithi067.stdout:7/676: dread d4/f9a [0,4194304] 0 2024-01-17T23:44:06.563 INFO:tasks.workunit.client.0.smithi067.stdout:7/677: dwrite d4/d25/d39/d46/d60/f66 [0,4194304] 0 2024-01-17T23:44:06.563 INFO:tasks.workunit.client.0.smithi067.stdout:7/678: truncate d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f8e 1002823 0 2024-01-17T23:44:06.600 INFO:tasks.workunit.client.0.smithi067.stdout:8/702: getdents d6/d19/dcf 0 2024-01-17T23:44:06.626 INFO:tasks.workunit.client.0.smithi067.stdout:8/703: dwrite d6/d26/d3e/d87/f94 [0,4194304] 0 2024-01-17T23:44:06.627 INFO:tasks.workunit.client.0.smithi067.stdout:8/704: chown d6/d19/d22/fba 81357 1 2024-01-17T23:44:06.627 INFO:tasks.workunit.client.0.smithi067.stdout:8/705: stat d6/db/de3 0 2024-01-17T23:44:08.278 INFO:tasks.workunit.client.0.smithi067.stdout:3/709: rename d0/d34/d35/d57/d87 to d0/d13/d4a/dd5 0 2024-01-17T23:44:08.411 INFO:tasks.workunit.client.0.smithi067.stdout:9/560: rmdir d3/d6/d11/d50 39 2024-01-17T23:44:09.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/679: stat d4/d25/c76 0 2024-01-17T23:44:09.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/680: write d4/d25/d39/d79/fb8 [761533,69263] 0 2024-01-17T23:44:09.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/681: write d4/d4b/d7f/d82/f89 [653901,12470] 0 2024-01-17T23:44:09.611 INFO:tasks.workunit.client.0.smithi067.stdout:8/706: link d6/d19/f3a d6/d26/d7c/fef 0 2024-01-17T23:44:09.611 INFO:tasks.workunit.client.0.smithi067.stdout:8/707: write d6/db/d58/d5f/dc0/f9f [635193,17080] 0 2024-01-17T23:44:09.781 INFO:tasks.workunit.client.0.smithi067.stdout:0/712: rename d3/d5/d1a/d1c/d4e/f51 to d3/d5/d32/dc5/f10f 0 2024-01-17T23:44:09.810 INFO:tasks.workunit.client.0.smithi067.stdout:0/713: dwrite d3/d5/d1a/d1c/d4e/d7c/f91 [0,4194304] 0 2024-01-17T23:44:09.938 INFO:tasks.workunit.client.0.smithi067.stdout:3/710: symlink d0/d17/d69/d6e/ld6 0 2024-01-17T23:44:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:9/561: chown d3/da/lb 967000 1 2024-01-17T23:44:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:9/562: dread - d3/d6/d2a/da2/fb9 zero size 2024-01-17T23:44:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:9/563: chown d3/d6/d2a/d34/cad 10 1 2024-01-17T23:44:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:9/564: write d3/d6/f7f [4331627,50815] 0 2024-01-17T23:44:10.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/638: dwrite d5/d1f/d2a/f4a [4194304,4194304] 0 2024-01-17T23:44:10.308 INFO:tasks.workunit.client.0.smithi067.stdout:7/682: mknod d4/d25/d39/d46/d60/dc7/cd0 0 2024-01-17T23:44:10.890 INFO:tasks.workunit.client.0.smithi067.stdout:6/697: rename d6/d9/c29 to d6/d18/d2e/d61/cf0 0 2024-01-17T23:44:11.146 INFO:tasks.workunit.client.0.smithi067.stdout:0/714: dwrite d3/d6/dd/f69 [0,4194304] 0 2024-01-17T23:44:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:3/711: mkdir d0/d17/d69/d6e/dd7 0 2024-01-17T23:44:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:3/712: stat d0/d37/c45 0 2024-01-17T23:44:11.399 INFO:tasks.workunit.client.0.smithi067.stdout:9/565: mknod d3/d6/da4/dba/cca 0 2024-01-17T23:44:11.399 INFO:tasks.workunit.client.0.smithi067.stdout:9/566: write d3/d6/d2e/f99 [1613895,65122] 0 2024-01-17T23:44:11.410 INFO:tasks.workunit.client.0.smithi067.stdout:9/567: dread d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:44:11.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/683: rename d4/f5b to d4/d4b/d63/fd1 0 2024-01-17T23:44:11.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/684: read d4/d25/f2c [956532,54209] 0 2024-01-17T23:44:11.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/685: chown d4/d4b/d63/d95/dad/dcc/l80 59 1 2024-01-17T23:44:11.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/698: fsync d6/d9/d1c/d1e/f7f 0 2024-01-17T23:44:12.091 INFO:tasks.workunit.client.0.smithi067.stdout:0/715: symlink d3/d4c/l110 0 2024-01-17T23:44:12.165 INFO:tasks.workunit.client.0.smithi067.stdout:3/713: mkdir d0/d13/d4a/d75/dd0/dd8 0 2024-01-17T23:44:12.537 INFO:tasks.workunit.client.0.smithi067.stdout:5/590: mknod d10/d24/d59/cbd 0 2024-01-17T23:44:12.537 INFO:tasks.workunit.client.0.smithi067.stdout:5/591: write d10/d24/d59/d8c/fb6 [510485,33301] 0 2024-01-17T23:44:12.538 INFO:tasks.workunit.client.0.smithi067.stdout:5/592: chown d10/d24/d25/f9b 2327 1 2024-01-17T23:44:12.588 INFO:tasks.workunit.client.0.smithi067.stdout:5/593: dwrite d10/f16 [4194304,4194304] 0 2024-01-17T23:44:12.606 INFO:tasks.workunit.client.0.smithi067.stdout:5/594: dread d10/d24/d25/f2e [0,4194304] 0 2024-01-17T23:44:12.949 INFO:tasks.workunit.client.0.smithi067.stdout:2/639: symlink d5/d1f/d16/d7d/ldf 0 2024-01-17T23:44:12.957 INFO:tasks.workunit.client.0.smithi067.stdout:1/659: sync 2024-01-17T23:44:12.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/640: dread d5/d1f/d2a/d55/f99 [0,4194304] 0 2024-01-17T23:44:12.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/641: write d5/d1f/d2a/d54/d8/d32/d33/f6f [153631,2452] 0 2024-01-17T23:44:12.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/642: chown d5/d1f/d2a/d54/d8/d32/lb9 70 1 2024-01-17T23:44:12.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/643: readlink d5/d1f/d2a/d54/d8/d4c/lbc 0 2024-01-17T23:44:13.010 INFO:tasks.workunit.client.0.smithi067.stdout:4/627: write d3/d26/d34/d3a/f4b [270655,22045] 0 2024-01-17T23:44:13.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/628: write d3/d26/d34/d3a/f7f [309826,8924] 0 2024-01-17T23:44:13.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/629: write d3/d8/f13 [2644974,106819] 0 2024-01-17T23:44:13.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/630: fsync d3/d26/f43 0 2024-01-17T23:44:13.195 INFO:tasks.workunit.client.0.smithi067.stdout:9/568: rename d3/da/l14 to d3/d25/d5d/lcb 0 2024-01-17T23:44:13.347 INFO:tasks.workunit.client.0.smithi067.stdout:7/686: creat d4/d4b/d63/db7/fd2 x:0 0 0 2024-01-17T23:44:13.347 INFO:tasks.workunit.client.0.smithi067.stdout:7/687: chown d4/d25/d39/d8a/cc0 359082 1 2024-01-17T23:44:13.383 INFO:tasks.workunit.client.0.smithi067.stdout:7/688: dwrite d4/d25/d39/d46/d78/d93/fa4 [0,4194304] 0 2024-01-17T23:44:13.383 INFO:tasks.workunit.client.0.smithi067.stdout:7/689: chown d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/fbf 286 1 2024-01-17T23:44:13.527 INFO:tasks.workunit.client.0.smithi067.stdout:0/716: mknod d3/d5/d1a/d1c/d4d/c111 0 2024-01-17T23:44:13.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/714: symlink d0/d13/d8e/ld9 0 2024-01-17T23:44:14.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:14.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/631: creat d3/d8/d35/d36/fcb x:0 0 0 2024-01-17T23:44:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/632: write d3/d26/d34/d3a/d53/dc6/d20/d52/f94 [778035,21064] 0 2024-01-17T23:44:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/633: write d3/d26/d34/d3a/d53/dc6/d20/fb5 [425909,27817] 0 2024-01-17T23:44:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:4/634: chown d3/d26/d34/d3a/caf 14713123 1 2024-01-17T23:44:14.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/708: getdents d6/d26/d7c 0 2024-01-17T23:44:15.274 INFO:tasks.workunit.client.0.smithi067.stdout:6/699: symlink d6/d9/d65/lf1 0 2024-01-17T23:44:15.358 INFO:tasks.workunit.client.0.smithi067.stdout:0/717: mknod d3/d64/d82/de8/c112 0 2024-01-17T23:44:15.628 INFO:tasks.workunit.client.0.smithi067.stdout:3/715: mknod d0/d34/cda 0 2024-01-17T23:44:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/635: creat d3/d40/fcc x:0 0 0 2024-01-17T23:44:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:3/716: fdatasync d0/d13/f8a 0 2024-01-17T23:44:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/636: fdatasync d3/d40/fcc 0 2024-01-17T23:44:15.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/637: chown d3/d8/c18 7841 1 2024-01-17T23:44:15.947 INFO:tasks.workunit.client.0.smithi067.stdout:8/709: creat d6/d26/d3e/d6c/ff0 x:0 0 0 2024-01-17T23:44:16.071 INFO:tasks.workunit.client.0.smithi067.stdout:6/700: mknod d6/d18/d2e/cf2 0 2024-01-17T23:44:16.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/638: mkdir d3/d5/d93/dcd 0 2024-01-17T23:44:16.518 INFO:tasks.workunit.client.0.smithi067.stdout:8/710: creat d6/d19/d22/d25/ff1 x:0 0 0 2024-01-17T23:44:16.775 INFO:tasks.workunit.client.0.smithi067.stdout:6/701: mkdir d6/d18/d2e/d61/d9a/dd1/df3 0 2024-01-17T23:44:16.911 INFO:tasks.workunit.client.0.smithi067.stdout:0/718: getdents d3/d64/d7d/de6 0 2024-01-17T23:44:16.911 INFO:tasks.workunit.client.0.smithi067.stdout:0/719: stat d3/d5/d1a/d1c/d4e/d7c/f91 0 2024-01-17T23:44:16.911 INFO:tasks.workunit.client.0.smithi067.stdout:0/720: stat d3/d5/d1a/d1c/d1d 0 2024-01-17T23:44:16.912 INFO:tasks.workunit.client.0.smithi067.stdout:0/721: write d3/d64/fd6 [193146,103042] 0 2024-01-17T23:44:17.112 INFO:tasks.workunit.client.0.smithi067.stdout:6/702: symlink d6/d9/d65/lf4 0 2024-01-17T23:44:17.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/722: rmdir d3/d6/dd 39 2024-01-17T23:44:17.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/723: fdatasync d3/d5/d32/f78 0 2024-01-17T23:44:17.328 INFO:tasks.workunit.client.0.smithi067.stdout:8/711: mknod d6/d26/d7c/dd0/cf2 0 2024-01-17T23:44:17.358 INFO:tasks.workunit.client.0.smithi067.stdout:8/712: dwrite d6/db/d58/f6e [4194304,4194304] 0 2024-01-17T23:44:17.432 INFO:tasks.workunit.client.0.smithi067.stdout:6/703: dread d6/d9/d30/f4d [4194304,4194304] 0 2024-01-17T23:44:18.444 INFO:tasks.workunit.client.0.smithi067.stdout:6/704: dwrite d6/d9/f31 [4194304,4194304] 0 2024-01-17T23:44:18.444 INFO:tasks.workunit.client.0.smithi067.stdout:6/705: dread - d6/d18/fe9 zero size 2024-01-17T23:44:18.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/595: sync 2024-01-17T23:44:18.669 INFO:tasks.workunit.client.0.smithi067.stdout:1/660: sync 2024-01-17T23:44:18.954 INFO:tasks.workunit.client.0.smithi067.stdout:6/706: mkdir d6/d9/d65/dde/df5 0 2024-01-17T23:44:18.983 INFO:tasks.workunit.client.0.smithi067.stdout:6/707: dwrite d6/d9/d30/d4c/d82/f91 [0,4194304] 0 2024-01-17T23:44:19.034 INFO:tasks.workunit.client.0.smithi067.stdout:1/661: fsync d0/d74/f84 0 2024-01-17T23:44:19.215 INFO:tasks.workunit.client.0.smithi067.stdout:5/596: mknod d10/d24/d25/d5c/d7e/d7f/d92/cbe 0 2024-01-17T23:44:19.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/569: write d3/d6/da4/f67 [493379,6234] 0 2024-01-17T23:44:19.536 INFO:tasks.workunit.client.0.smithi067.stdout:6/708: link d6/d9/d30/d58/fa9 d6/d9/d1c/d1e/ff6 0 2024-01-17T23:44:19.745 INFO:tasks.workunit.client.0.smithi067.stdout:1/662: creat d0/d7/d13/d3a/d75/da1/fd2 x:0 0 0 2024-01-17T23:44:19.745 INFO:tasks.workunit.client.0.smithi067.stdout:5/597: dread d10/d24/d46/d4a/d50/fab [0,4194304] 0 2024-01-17T23:44:19.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/570: dwrite d3/d6/fe [0,4194304] 0 2024-01-17T23:44:19.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/571: getdents d3/d6/d2e/dc8 0 2024-01-17T23:44:19.998 INFO:tasks.workunit.client.0.smithi067.stdout:9/572: dwrite d3/f5 [0,4194304] 0 2024-01-17T23:44:19.998 INFO:tasks.workunit.client.0.smithi067.stdout:9/573: dread - d3/d6/da4/d55/f7b zero size 2024-01-17T23:44:20.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/663: dwrite d0/d62/f9c [0,4194304] 0 2024-01-17T23:44:20.412 INFO:tasks.workunit.client.0.smithi067.stdout:5/598: getdents d10/d24/d25/d5c/d7e/d7f 0 2024-01-17T23:44:20.437 INFO:tasks.workunit.client.0.smithi067.stdout:3/717: dwrite d0/d17/d69/d6e/f89 [0,4194304] 0 2024-01-17T23:44:20.460 INFO:tasks.workunit.client.0.smithi067.stdout:3/718: dwrite d0/d12/d1b/f1d [0,4194304] 0 2024-01-17T23:44:20.461 INFO:tasks.workunit.client.0.smithi067.stdout:3/719: fsync d0/d17/f29 0 2024-01-17T23:44:20.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/720: dwrite d0/d17/fa8 [0,4194304] 0 2024-01-17T23:44:20.496 INFO:tasks.workunit.client.0.smithi067.stdout:3/721: readlink d0/d12/d1b/d4d/lb4 0 2024-01-17T23:44:20.505 INFO:tasks.workunit.client.0.smithi067.stdout:9/574: symlink d3/d6/d47/d88/dc2/lcc 0 2024-01-17T23:44:20.505 INFO:tasks.workunit.client.0.smithi067.stdout:9/575: dread - d3/d6/da4/d55/fa3 zero size 2024-01-17T23:44:20.732 INFO:tasks.workunit.client.0.smithi067.stdout:1/664: creat d0/d7/d7f/fd3 x:0 0 0 2024-01-17T23:44:20.732 INFO:tasks.workunit.client.0.smithi067.stdout:1/665: chown d0/d7/d13/d3a/d45/l53 3 1 2024-01-17T23:44:20.742 INFO:tasks.workunit.client.0.smithi067.stdout:1/666: dread d0/d7/d13/d2e/f46 [0,4194304] 0 2024-01-17T23:44:20.852 INFO:tasks.workunit.client.0.smithi067.stdout:4/639: write d3/d5/f2e [4711525,59573] 0 2024-01-17T23:44:20.852 INFO:tasks.workunit.client.0.smithi067.stdout:4/640: fsync d3/d8/f13 0 2024-01-17T23:44:20.868 INFO:tasks.workunit.client.0.smithi067.stdout:4/641: dread d3/d26/d34/d3a/d53/dc6/f14 [0,4194304] 0 2024-01-17T23:44:21.021 INFO:tasks.workunit.client.0.smithi067.stdout:3/722: creat d0/d13/d4a/d75/dcb/fdb x:0 0 0 2024-01-17T23:44:21.282 INFO:tasks.workunit.client.0.smithi067.stdout:1/667: creat d0/d7/d13/fd4 x:0 0 0 2024-01-17T23:44:21.437 INFO:tasks.workunit.client.0.smithi067.stdout:2/644: rename d5/d1f/d2a/d54/f11 to d5/d1f/d16/fe0 0 2024-01-17T23:44:22.257 INFO:tasks.workunit.client.0.smithi067.stdout:3/723: mkdir d0/d34/d35/d65/d6f/d70/ddc 0 2024-01-17T23:44:22.311 INFO:tasks.workunit.client.0.smithi067.stdout:9/576: truncate d3/d6/d11/d50/f43 782683 0 2024-01-17T23:44:22.335 INFO:tasks.workunit.client.0.smithi067.stdout:9/577: dwrite d3/d6/d2e/f99 [0,4194304] 0 2024-01-17T23:44:22.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/645: write d5/d1f/d2a/d54/fb2 [270107,8785] 0 2024-01-17T23:44:22.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/690: rename d4/d25/d39/d46/d78/d93/d94/dc4/d40/f71 to d4/d25/d39/d46/d78/d93/fd3 0 2024-01-17T23:44:22.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/691: dread - d4/d4b/d7f/d82/f9b zero size 2024-01-17T23:44:22.843 INFO:tasks.workunit.client.0.smithi067.stdout:3/724: creat d0/d34/d35/d57/fdd x:0 0 0 2024-01-17T23:44:22.843 INFO:tasks.workunit.client.0.smithi067.stdout:3/725: chown d0/f99 1 1 2024-01-17T23:44:23.290 INFO:tasks.workunit.client.0.smithi067.stdout:9/578: creat d3/d6/d11/d50/fcd x:0 0 0 2024-01-17T23:44:23.290 INFO:tasks.workunit.client.0.smithi067.stdout:9/579: stat d3/d25/d5d/d79 0 2024-01-17T23:44:23.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/646: mkdir d5/d1f/d2a/de1 0 2024-01-17T23:44:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:0/724: rename d3/d4c/l110 to d3/d64/d7d/l113 0 2024-01-17T23:44:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:0/725: stat d3/d5/d1a/d1c/d4e/d6b/fab 0 2024-01-17T23:44:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:7/692: creat d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fd4 x:0 0 0 2024-01-17T23:44:23.730 INFO:tasks.workunit.client.0.smithi067.stdout:0/726: dread - d3/d64/d82/ff7 zero size 2024-01-17T23:44:23.941 INFO:tasks.workunit.client.0.smithi067.stdout:9/580: write d3/d6/d11/d50/f77 [1313429,8955] 0 2024-01-17T23:44:24.007 INFO:tasks.workunit.client.0.smithi067.stdout:2/647: truncate d5/d1f/f96 6102521 0 2024-01-17T23:44:24.254 INFO:tasks.workunit.client.0.smithi067.stdout:0/727: truncate d3/d5/d32/fd3 2527792 0 2024-01-17T23:44:24.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/728: dwrite d3/d6/f1e [0,4194304] 0 2024-01-17T23:44:24.320 INFO:tasks.workunit.client.0.smithi067.stdout:0/729: dwrite d3/d5/fe5 [0,4194304] 0 2024-01-17T23:44:24.402 INFO:tasks.workunit.client.0.smithi067.stdout:7/693: creat d4/d4b/d63/d95/dad/fd5 x:0 0 0 2024-01-17T23:44:24.402 INFO:tasks.workunit.client.0.smithi067.stdout:7/694: truncate d4/d25/d39/d46/d78/d93/fcd 523360 0 2024-01-17T23:44:24.729 INFO:tasks.workunit.client.0.smithi067.stdout:9/581: write d3/d6/d11/d50/d84/da8/fab [3304385,53774] 0 2024-01-17T23:44:24.730 INFO:tasks.workunit.client.0.smithi067.stdout:9/582: fdatasync d3/d6/da4/f67 0 2024-01-17T23:44:25.328 INFO:tasks.workunit.client.0.smithi067.stdout:0/730: link d3/d5/f9 d3/d64/f114 0 2024-01-17T23:44:25.328 INFO:tasks.workunit.client.0.smithi067.stdout:7/695: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/fd6 x:0 0 0 2024-01-17T23:44:25.381 INFO:tasks.workunit.client.0.smithi067.stdout:7/696: dread d4/d25/d39/d46/d60/f66 [0,4194304] 0 2024-01-17T23:44:25.381 INFO:tasks.workunit.client.0.smithi067.stdout:5/599: dwrite d10/d24/d46/d4a/d50/f89 [0,4194304] 0 2024-01-17T23:44:25.381 INFO:tasks.workunit.client.0.smithi067.stdout:7/697: truncate d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/fbf 588197 0 2024-01-17T23:44:25.511 INFO:tasks.workunit.client.0.smithi067.stdout:9/583: creat d3/d6/d2a/d34/d42/d9c/da5/da6/fce x:0 0 0 2024-01-17T23:44:25.511 INFO:tasks.workunit.client.0.smithi067.stdout:9/584: readlink d3/d6/d11/d50/d84/da8/da9/lc1 0 2024-01-17T23:44:25.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/648: mkdir d5/d1f/d2a/d54/d8/d4c/dbf/de2 0 2024-01-17T23:44:26.111 INFO:tasks.workunit.client.0.smithi067.stdout:0/731: mkdir d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d115 0 2024-01-17T23:44:26.111 INFO:tasks.workunit.client.0.smithi067.stdout:0/732: read d3/d6/f76 [680922,106057] 0 2024-01-17T23:44:26.111 INFO:tasks.workunit.client.0.smithi067.stdout:0/733: read - d3/d6/fcf zero size 2024-01-17T23:44:26.112 INFO:tasks.workunit.client.0.smithi067.stdout:8/713: sync 2024-01-17T23:44:26.312 INFO:tasks.workunit.client.0.smithi067.stdout:5/600: creat d10/d24/db4/fbf x:0 0 0 2024-01-17T23:44:26.427 INFO:tasks.workunit.client.0.smithi067.stdout:7/698: truncate d4/f27 905085 0 2024-01-17T23:44:26.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/585: creat d3/d6/d47/d88/fcf x:0 0 0 2024-01-17T23:44:26.503 INFO:tasks.workunit.client.0.smithi067.stdout:9/586: dread d3/d6/da4/f86 [0,4194304] 0 2024-01-17T23:44:26.503 INFO:tasks.workunit.client.0.smithi067.stdout:9/587: write d3/d6/da4/d55/da1/fb3 [145537,35823] 0 2024-01-17T23:44:26.503 INFO:tasks.workunit.client.0.smithi067.stdout:9/588: fsync d3/d6/d47/d6d/f8c 0 2024-01-17T23:44:26.530 INFO:tasks.workunit.client.0.smithi067.stdout:9/589: dwrite d3/d6/d11/faa [0,4194304] 0 2024-01-17T23:44:26.668 INFO:tasks.workunit.client.0.smithi067.stdout:2/649: mkdir d5/d1f/d2a/d54/d8/d4c/de3 0 2024-01-17T23:44:27.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/714: mknod d6/d26/d56/dd5/cf3 0 2024-01-17T23:44:27.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/715: chown d6/db/f34 729 1 2024-01-17T23:44:27.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/716: chown d6/d26/d7c/f8b 16563526 1 2024-01-17T23:44:27.148 INFO:tasks.workunit.client.0.smithi067.stdout:8/717: dread d6/db/f5e [0,4194304] 0 2024-01-17T23:44:27.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/601: creat d10/d24/d25/d5c/d7e/d7f/fc0 x:0 0 0 2024-01-17T23:44:27.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/642: sync 2024-01-17T23:44:27.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/643: creat d3/d4e/fce x:0 0 0 2024-01-17T23:44:28.073 INFO:tasks.workunit.client.0.smithi067.stdout:9/590: truncate d3/d6/da4/f86 2933477 0 2024-01-17T23:44:28.275 INFO:tasks.workunit.client.0.smithi067.stdout:2/650: mknod d5/d1f/d2a/d54/d8/ce4 0 2024-01-17T23:44:28.275 INFO:tasks.workunit.client.0.smithi067.stdout:2/651: fsync d5/d1f/d2a/d73/f83 0 2024-01-17T23:44:28.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/734: getdents d3/d5/d1a/d90 0 2024-01-17T23:44:28.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/735: chown d3/d6 125736 1 2024-01-17T23:44:28.629 INFO:tasks.workunit.client.0.smithi067.stdout:8/718: creat d6/d19/d22/d25/d53/dbd/ff4 x:0 0 0 2024-01-17T23:44:28.738 INFO:tasks.workunit.client.0.smithi067.stdout:5/602: unlink d10/f7b 0 2024-01-17T23:44:29.099 INFO:tasks.workunit.client.0.smithi067.stdout:9/591: rmdir d3/d6/d2a 39 2024-01-17T23:44:29.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/736: truncate d3/d64/f95 2513927 0 2024-01-17T23:44:29.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/737: readlink d3/d5/d1a/d1c/d1d/d2e/d5a/lc1 0 2024-01-17T23:44:29.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/738: chown d3/d5/d1a/d90 339 1 2024-01-17T23:44:29.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/719: unlink d6/d19/d22/c4e 0 2024-01-17T23:44:29.508 INFO:tasks.workunit.client.0.smithi067.stdout:5/603: mknod d10/d24/d46/d4a/cc1 0 2024-01-17T23:44:29.617 INFO:tasks.workunit.client.0.smithi067.stdout:2/652: unlink d5/d1f/d2a/d54/c2b 0 2024-01-17T23:44:29.754 INFO:tasks.workunit.client.0.smithi067.stdout:6/709: rename d6/f3d to d6/d18/d2e/d61/ff7 0 2024-01-17T23:44:29.755 INFO:tasks.workunit.client.0.smithi067.stdout:6/710: truncate d6/d9/d1c/d1e/d43/def/d51/fd9 878214 0 2024-01-17T23:44:29.798 INFO:tasks.workunit.client.0.smithi067.stdout:8/720: creat d6/d26/d56/dbb/ff5 x:0 0 0 2024-01-17T23:44:29.798 INFO:tasks.workunit.client.0.smithi067.stdout:8/721: write d6/db/de3/feb [188307,95851] 0 2024-01-17T23:44:29.802 INFO:tasks.workunit.client.0.smithi067.stdout:8/722: read d6/db/d58/fbe [168585,1142] 0 2024-01-17T23:44:29.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/604: mknod d10/d24/d25/d5c/d7e/cc2 0 2024-01-17T23:44:30.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/605: dwrite d10/d24/d59/fb3 [0,4194304] 0 2024-01-17T23:44:30.074 INFO:tasks.workunit.client.0.smithi067.stdout:2/653: dread - d5/d1f/d2a/d54/d39/fdb zero size 2024-01-17T23:44:30.372 INFO:tasks.workunit.client.0.smithi067.stdout:3/726: symlink d0/lde 0 2024-01-17T23:44:30.373 INFO:tasks.workunit.client.0.smithi067.stdout:4/644: rmdir d3/d26 39 2024-01-17T23:44:31.038 INFO:tasks.workunit.client.0.smithi067.stdout:1/668: rename d0/d7/d7f/lcc to d0/d7/d13/d2e/ld5 0 2024-01-17T23:44:31.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/711: truncate d6/f1f 3365034 0 2024-01-17T23:44:31.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/712: truncate d6/d18/fec 998344 0 2024-01-17T23:44:31.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/713: chown d6/d9/d1c/d1e 0 1 2024-01-17T23:44:31.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/714: fdatasync d6/d9/d1c/d1e/d43/d78/dab/fc9 0 2024-01-17T23:44:31.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/715: read - d6/d9/d1c/d1e/d43/def/d51/feb zero size 2024-01-17T23:44:31.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/645: creat d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fcf x:0 0 0 2024-01-17T23:44:31.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/646: stat d3/d26/d34/d3a/d53/dc6/d20/l84 0 2024-01-17T23:44:31.417 INFO:tasks.workunit.client.0.smithi067.stdout:1/669: chown d0/f6f 1007626800 1 2024-01-17T23:44:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/647: creat d3/d40/dc8/fd0 x:0 0 0 2024-01-17T23:44:31.926 INFO:tasks.workunit.client.0.smithi067.stdout:6/716: mknod d6/d9/cf8 0 2024-01-17T23:44:32.404 INFO:tasks.workunit.client.0.smithi067.stdout:4/648: symlink d3/d26/d34/d3a/d9f/ld1 0 2024-01-17T23:44:32.580 INFO:tasks.workunit.client.0.smithi067.stdout:1/670: chown d0/d69/c7b 424 1 2024-01-17T23:44:32.719 INFO:tasks.workunit.client.0.smithi067.stdout:9/592: rename d3/d6/d2a/d34/d42/d9c/da5 to d3/d6/d11/dbe/dd0 0 2024-01-17T23:44:32.932 INFO:tasks.workunit.client.0.smithi067.stdout:4/649: creat d3/d26/d34/d3a/d53/dc6/d20/d3b/fd2 x:0 0 0 2024-01-17T23:44:32.932 INFO:tasks.workunit.client.0.smithi067.stdout:4/650: write d3/d4e/f63 [1120317,117856] 0 2024-01-17T23:44:33.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/739: rename d3/d4c/ca3 to d3/d6/d80/c116 0 2024-01-17T23:44:33.050 INFO:tasks.workunit.client.0.smithi067.stdout:0/740: creat d3/d5/d32/dc5/f117 x:0 0 0 2024-01-17T23:44:33.073 INFO:tasks.workunit.client.0.smithi067.stdout:0/741: write d3/d5/d1a/d1c/d4e/d6b/f8f [1675838,56463] 0 2024-01-17T23:44:33.330 INFO:tasks.workunit.client.0.smithi067.stdout:9/593: mkdir d3/d6/d2a/dd1 0 2024-01-17T23:44:33.426 INFO:tasks.workunit.client.0.smithi067.stdout:4/651: symlink d3/d26/d34/d3a/d53/dc6/ld3 0 2024-01-17T23:44:33.655 INFO:tasks.workunit.client.0.smithi067.stdout:1/671: rename d0/d7/d13/d3a/d45/f5a to d0/d7/d13/d3d/d48/fd6 0 2024-01-17T23:44:33.665 INFO:tasks.workunit.client.0.smithi067.stdout:1/672: dread d0/d7/d13/d2e/f46 [0,4194304] 0 2024-01-17T23:44:33.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/742: mknod d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/c118 0 2024-01-17T23:44:33.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/717: mknod d6/d9/d30/d4c/cf9 0 2024-01-17T23:44:34.156 INFO:tasks.workunit.client.0.smithi067.stdout:9/594: creat d3/d6/d11/dbe/dd0/da6/fd2 x:0 0 0 2024-01-17T23:44:34.180 INFO:tasks.workunit.client.0.smithi067.stdout:9/595: write d3/d6/d2a/da2/f91 [3214733,67990] 0 2024-01-17T23:44:34.683 INFO:tasks.workunit.client.0.smithi067.stdout:4/652: rename d3/d40/fae to d3/d5/d93/dcd/fd4 0 2024-01-17T23:44:34.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/673: stat d0/d7/d13/d2e/c68 0 2024-01-17T23:44:34.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/674: write d0/d7/d13/d3a/fa6 [13083,33322] 0 2024-01-17T23:44:34.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/675: dread - d0/d7/d13/d3a/f81 zero size 2024-01-17T23:44:34.683 INFO:tasks.workunit.client.0.smithi067.stdout:0/743: creat d3/d5/d1a/d1c/d1d/d2e/f119 x:0 0 0 2024-01-17T23:44:34.686 INFO:tasks.workunit.client.0.smithi067.stdout:6/718: getdents d6/d9/d65 0 2024-01-17T23:44:34.686 INFO:tasks.workunit.client.0.smithi067.stdout:9/596: creat d3/d58/fd3 x:0 0 0 2024-01-17T23:44:34.687 INFO:tasks.workunit.client.0.smithi067.stdout:1/676: write d0/d7/d13/f40 [90085,49678] 0 2024-01-17T23:44:34.704 INFO:tasks.workunit.client.0.smithi067.stdout:4/653: dread d3/d8/d35/d36/f48 [0,4194304] 0 2024-01-17T23:44:34.717 INFO:tasks.workunit.client.0.smithi067.stdout:0/744: write d3/d5/d1a/d1c/d4e/d7c/ffe [1710463,35026] 0 2024-01-17T23:44:34.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/719: dwrite d6/d9/d30/d4c/f54 [0,4194304] 0 2024-01-17T23:44:34.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/720: chown d6/d18/fec 217669450 1 2024-01-17T23:44:34.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/721: chown d6/d9/d65/f72 0 1 2024-01-17T23:44:34.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/745: dwrite d3/d5/d32/f73 [0,4194304] 0 2024-01-17T23:44:35.616 INFO:tasks.workunit.client.0.smithi067.stdout:7/699: sync 2024-01-17T23:44:35.616 INFO:tasks.workunit.client.0.smithi067.stdout:7/700: truncate d4/d25/d39/d79/fb8 1800358 0 2024-01-17T23:44:35.697 INFO:tasks.workunit.client.0.smithi067.stdout:4/654: mknod d3/d26/d34/d3a/d53/cd5 0 2024-01-17T23:44:35.718 INFO:tasks.workunit.client.0.smithi067.stdout:4/655: write d3/d8/d35/f3c [7641203,91928] 0 2024-01-17T23:44:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:4/656: dwrite d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/f99 [0,4194304] 0 2024-01-17T23:44:35.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/657: creat d3/d4e/fd6 x:0 0 0 2024-01-17T23:44:35.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/658: fsync d3/d8/fa4 0 2024-01-17T23:44:36.688 INFO:tasks.workunit.client.0.smithi067.stdout:6/722: getdents d6/d9/d30/d4c/d8d 0 2024-01-17T23:44:37.105 INFO:tasks.workunit.client.0.smithi067.stdout:0/746: rename d3/d5/d1a/d1c/d4d/fb5 to d3/d5/d1a/d1c/f11a 0 2024-01-17T23:44:37.678 INFO:tasks.workunit.client.0.smithi067.stdout:7/701: link d4/d25/d39/d46/d78/d93/d94/dc4/f14 d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fd7 0 2024-01-17T23:44:38.157 INFO:tasks.workunit.client.0.smithi067.stdout:6/723: mkdir d6/d9/d1c/d1e/d43/def/dad/dfa 0 2024-01-17T23:44:38.248 INFO:tasks.workunit.client.0.smithi067.stdout:0/747: rmdir d3/d5/d32/d7f 39 2024-01-17T23:44:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:0/748: dread d3/d6/f4b [0,4194304] 0 2024-01-17T23:44:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:0/749: stat d3/dbf/lfb 0 2024-01-17T23:44:38.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/702: unlink d4/d16/f6e 0 2024-01-17T23:44:38.526 INFO:tasks.workunit.client.0.smithi067.stdout:4/659: mkdir d3/d40/dd7 0 2024-01-17T23:44:38.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/703: dread - d4/d25/d39/d8a/d92/faa zero size 2024-01-17T23:44:38.580 INFO:tasks.workunit.client.0.smithi067.stdout:6/724: mknod d6/d9/d1c/d1e/d43/d86/cfb 0 2024-01-17T23:44:38.697 INFO:tasks.workunit.client.0.smithi067.stdout:0/750: dwrite d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/feb [0,4194304] 0 2024-01-17T23:44:38.697 INFO:tasks.workunit.client.0.smithi067.stdout:0/751: truncate d3/d6/fa2 1045764 0 2024-01-17T23:44:38.818 INFO:tasks.workunit.client.0.smithi067.stdout:4/660: symlink d3/d26/d34/d3a/d53/dc6/ld8 0 2024-01-17T23:44:38.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/661: truncate d3/d26/d34/d3a/d53/dc6/da6/fb6 1545823 0 2024-01-17T23:44:38.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/662: write d3/d26/d34/d65/fb7 [856358,107835] 0 2024-01-17T23:44:38.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/663: fdatasync d3/d26/d34/d3a/d53/dc6/da6/fb6 0 2024-01-17T23:44:39.015 INFO:tasks.workunit.client.0.smithi067.stdout:7/704: creat d4/d16/dc3/fd8 x:0 0 0 2024-01-17T23:44:39.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/705: dwrite d4/d25/d39/d46/da8/fbe [0,4194304] 0 2024-01-17T23:44:39.082 INFO:tasks.workunit.client.0.smithi067.stdout:7/706: dwrite d4/d25/d39/d46/d78/d93/d94/fba [0,4194304] 0 2024-01-17T23:44:39.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/707: write d4/d25/d39/d46/d78/d93/d94/fb9 [895741,12427] 0 2024-01-17T23:44:39.206 INFO:tasks.workunit.client.0.smithi067.stdout:0/752: getdents d3/d6/d80 0 2024-01-17T23:44:39.206 INFO:tasks.workunit.client.0.smithi067.stdout:0/753: dread - d3/d5/d1a/d1c/d4e/d7c/f9e zero size 2024-01-17T23:44:39.206 INFO:tasks.workunit.client.0.smithi067.stdout:0/754: fsync d3/d64/d82/ff7 0 2024-01-17T23:44:39.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/664: truncate d3/d26/d34/d3a/d53/dc6/f14 2364065 0 2024-01-17T23:44:39.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/665: write d3/d26/d34/d3a/d53/dc6/d20/fb5 [668582,92074] 0 2024-01-17T23:44:39.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/666: stat d3/d8/d35/d36 0 2024-01-17T23:44:39.781 INFO:tasks.workunit.client.0.smithi067.stdout:7/708: symlink d4/d16/ld9 0 2024-01-17T23:44:39.803 INFO:tasks.workunit.client.0.smithi067.stdout:6/725: link d6/c39 d6/d9/d1c/d1e/d43/d78/dab/cfc 0 2024-01-17T23:44:39.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/667: creat d3/d26/d34/d3a/d53/dc6/dc7/fd9 x:0 0 0 2024-01-17T23:44:39.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/668: stat d3/d8/fa4 0 2024-01-17T23:44:39.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/669: creat d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fda x:0 0 0 2024-01-17T23:44:40.382 INFO:tasks.workunit.client.0.smithi067.stdout:0/755: symlink d3/d5/d1a/d1c/dd4/l11b 0 2024-01-17T23:44:40.449 INFO:tasks.workunit.client.0.smithi067.stdout:8/723: creat d6/db/ff6 x:0 0 0 2024-01-17T23:44:41.439 INFO:tasks.workunit.client.0.smithi067.stdout:8/724: creat d6/d19/d22/ff7 x:0 0 0 2024-01-17T23:44:41.440 INFO:tasks.workunit.client.0.smithi067.stdout:8/725: write d6/d26/d7c/fef [4655621,11518] 0 2024-01-17T23:44:41.450 INFO:tasks.workunit.client.0.smithi067.stdout:8/726: dread d6/db/d58/f73 [0,4194304] 0 2024-01-17T23:44:41.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/727: write d6/db/d58/d5f/dc0/f9f [214933,126274] 0 2024-01-17T23:44:41.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/728: write d6/db/d58/d5f/fb7 [1033457,10281] 0 2024-01-17T23:44:41.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/729: dread - d6/d19/d22/d25/d53/dbd/ff4 zero size 2024-01-17T23:44:41.586 INFO:tasks.workunit.client.0.smithi067.stdout:4/670: rename d3/d26/d34/la7 to d3/d40/ldb 0 2024-01-17T23:44:41.741 INFO:tasks.workunit.client.0.smithi067.stdout:8/730: truncate d6/d19/d22/d25/d53/f17 2939724 0 2024-01-17T23:44:42.017 INFO:tasks.workunit.client.0.smithi067.stdout:8/731: mkdir d6/d26/d7c/df8 0 2024-01-17T23:44:42.017 INFO:tasks.workunit.client.0.smithi067.stdout:8/732: fdatasync d6/d19/db4/fe2 0 2024-01-17T23:44:42.194 INFO:tasks.workunit.client.0.smithi067.stdout:2/654: symlink d5/d1f/d2a/le5 0 2024-01-17T23:44:42.224 INFO:tasks.workunit.client.0.smithi067.stdout:2/655: dwrite d5/d1f/d2a/d54/d8/f34 [0,4194304] 0 2024-01-17T23:44:42.224 INFO:tasks.workunit.client.0.smithi067.stdout:2/656: dread - d5/d1f/d2a/d54/d8/d32/fd1 zero size 2024-01-17T23:44:42.559 INFO:tasks.workunit.client.0.smithi067.stdout:8/733: rmdir d6/d19/d22/d25/d53 39 2024-01-17T23:44:42.564 INFO:tasks.workunit.client.0.smithi067.stdout:8/734: write d6/db/f34 [272022,10492] 0 2024-01-17T23:44:42.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/735: chown d6/d26/d3e/d6c/ca3 18489812 1 2024-01-17T23:44:42.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/736: chown d6/d26/d3e/d87/cac 5285 1 2024-01-17T23:44:42.567 INFO:tasks.workunit.client.0.smithi067.stdout:8/737: dread d6/d19/d22/d25/f5d [0,4194304] 0 2024-01-17T23:44:42.588 INFO:tasks.workunit.client.0.smithi067.stdout:8/738: write d6/d19/d22/d25/d53/d48/fb0 [2506732,71273] 0 2024-01-17T23:44:42.588 INFO:tasks.workunit.client.0.smithi067.stdout:8/739: rename d6/d19 to d6/d19/d22/d25/d53/d48/df9 22 2024-01-17T23:44:42.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/740: dread d6/db/d58/f73 [0,4194304] 0 2024-01-17T23:44:42.608 INFO:tasks.workunit.client.0.smithi067.stdout:8/741: write d6/d19/d22/f72 [800816,70869] 0 2024-01-17T23:44:43.460 INFO:tasks.workunit.client.0.smithi067.stdout:8/742: symlink d6/d26/d7c/lfa 0 2024-01-17T23:44:43.907 INFO:tasks.workunit.client.0.smithi067.stdout:8/743: mkdir d6/d26/d7c/df8/dfb 0 2024-01-17T23:44:43.907 INFO:tasks.workunit.client.0.smithi067.stdout:8/744: readlink d6/d19/d22/l42 0 2024-01-17T23:44:43.935 INFO:tasks.workunit.client.0.smithi067.stdout:8/745: dwrite d6/d26/d7c/f9a [0,4194304] 0 2024-01-17T23:44:43.979 INFO:tasks.workunit.client.0.smithi067.stdout:8/746: dwrite d6/db/f55 [4194304,4194304] 0 2024-01-17T23:44:44.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/726: rmdir d6/d9/d1c/d1e/d43/d78/dab 39 2024-01-17T23:44:44.122 INFO:tasks.workunit.client.0.smithi067.stdout:9/597: mkdir d3/d6/d11/dd4 0 2024-01-17T23:44:44.134 INFO:tasks.workunit.client.0.smithi067.stdout:7/709: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f8e [0,4194304] 0 2024-01-17T23:44:44.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/756: dwrite d3/d6/dd/dc4/fe3 [0,4194304] 0 2024-01-17T23:44:44.374 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:44.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:44:44.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/747: creat d6/d26/d56/dd5/ffc x:0 0 0 2024-01-17T23:44:44.635 INFO:tasks.workunit.client.0.smithi067.stdout:6/727: dread d6/f17 [0,4194304] 0 2024-01-17T23:44:44.635 INFO:tasks.workunit.client.0.smithi067.stdout:6/728: fsync d6/d9/d30/dbd/fdb 0 2024-01-17T23:44:44.908 INFO:tasks.workunit.client.0.smithi067.stdout:5/606: sync 2024-01-17T23:44:44.908 INFO:tasks.workunit.client.0.smithi067.stdout:1/677: sync 2024-01-17T23:44:44.908 INFO:tasks.workunit.client.0.smithi067.stdout:3/727: sync 2024-01-17T23:44:44.908 INFO:tasks.workunit.client.0.smithi067.stdout:5/607: readlink d10/d24/d25/d5c/la3 0 2024-01-17T23:44:44.909 INFO:tasks.workunit.client.0.smithi067.stdout:5/608: chown d10/d24/d25/d5c/d7e/d7f/d92/l99 23755 1 2024-01-17T23:44:44.918 INFO:tasks.workunit.client.0.smithi067.stdout:5/609: dread d10/d24/d46/f54 [0,4194304] 0 2024-01-17T23:44:45.113 INFO:tasks.workunit.client.0.smithi067.stdout:7/710: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb/dda 0 2024-01-17T23:44:45.113 INFO:tasks.workunit.client.0.smithi067.stdout:7/711: fdatasync d4/d25/d39/d46/f99 0 2024-01-17T23:44:45.122 INFO:tasks.workunit.client.0.smithi067.stdout:7/712: dread d4/d16/f1e [0,4194304] 0 2024-01-17T23:44:45.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/713: chown f1 41636 1 2024-01-17T23:44:46.538 INFO:tasks.workunit.client.0.smithi067.stdout:2/657: dwrite d5/d1f/d16/fe0 [0,4194304] 0 2024-01-17T23:44:46.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/658: dread d5/d1f/d2a/d54/d8/d4c/d84/da9/fcd [0,4194304] 0 2024-01-17T23:44:46.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/748: unlink d6/d19/d22/fae 0 2024-01-17T23:44:46.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/749: chown d6/d19/d22/d25/d53/f17 225284 1 2024-01-17T23:44:46.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/750: chown d6/d19/d22/d25/f85 729452 1 2024-01-17T23:44:46.616 INFO:tasks.workunit.client.0.smithi067.stdout:8/751: write d6/d19/d22/d25/d53/d65/f23 [2793903,93419] 0 2024-01-17T23:44:46.729 INFO:tasks.workunit.client.0.smithi067.stdout:6/729: rmdir d6/d9/d1c/d1e/d43/d78/dab 39 2024-01-17T23:44:47.135 INFO:tasks.workunit.client.0.smithi067.stdout:3/728: mknod d0/d13/d4a/d82/da6/dd3/cdf 0 2024-01-17T23:44:47.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/610: mknod d10/d24/d59/d5d/d43/cc3 0 2024-01-17T23:44:47.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/611: chown d10/d24/d59/d5d/f4d 2123157 1 2024-01-17T23:44:47.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/612: dread - d10/d24/d46/db1/fb2 zero size 2024-01-17T23:44:47.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/613: chown d10/d24/d46/d4a/d63/d85 2828 1 2024-01-17T23:44:47.628 INFO:tasks.workunit.client.0.smithi067.stdout:7/714: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/fdb x:0 0 0 2024-01-17T23:44:47.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/671: link d3/d26/d34/d3a/d53/c60 d3/cdc 0 2024-01-17T23:44:47.629 INFO:tasks.workunit.client.0.smithi067.stdout:4/672: chown d3/d8/d35/db0/fbf 12560 1 2024-01-17T23:44:47.643 INFO:tasks.workunit.client.0.smithi067.stdout:2/659: mknod d5/d1f/d2a/ce6 0 2024-01-17T23:44:47.867 INFO:tasks.workunit.client.0.smithi067.stdout:8/752: truncate d6/db/d58/d5f/dc0/fb5 470128 0 2024-01-17T23:44:48.043 INFO:tasks.workunit.client.0.smithi067.stdout:6/730: stat d6/d9/d30/d4c/d82/lc4 0 2024-01-17T23:44:48.043 INFO:tasks.workunit.client.0.smithi067.stdout:6/731: fsync d6/fb 0 2024-01-17T23:44:48.396 INFO:tasks.workunit.client.0.smithi067.stdout:5/614: mknod d10/d24/d46/d4a/d50/d5a/cc4 0 2024-01-17T23:44:48.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/615: write d10/d24/d25/d5c/d7e/f87 [499527,10161] 0 2024-01-17T23:44:48.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/616: readlink d10/d24/d46/d4a/d4b/l80 0 2024-01-17T23:44:48.433 INFO:tasks.workunit.client.0.smithi067.stdout:5/617: write d10/d24/d59/d5d/f41 [2622938,124713] 0 2024-01-17T23:44:48.433 INFO:tasks.workunit.client.0.smithi067.stdout:5/618: creat d10/d24/d59/d5d/fc5 x:0 0 0 2024-01-17T23:44:48.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/715: mkdir d4/d25/d39/d46/d60/ddc 0 2024-01-17T23:44:48.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/716: read - d4/d4b/d63/d95/dad/dcc/fab zero size 2024-01-17T23:44:48.686 INFO:tasks.workunit.client.0.smithi067.stdout:4/673: mknod d3/d26/d34/d3a/d53/dc6/d20/d3b/cdd 0 2024-01-17T23:44:48.686 INFO:tasks.workunit.client.0.smithi067.stdout:4/674: chown d3/d8/d35/fb1 6479886 1 2024-01-17T23:44:48.686 INFO:tasks.workunit.client.0.smithi067.stdout:4/675: dread - d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/f8f zero size 2024-01-17T23:44:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:4/676: write d3/d26/f43 [2687967,50470] 0 2024-01-17T23:44:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:4/677: creat d3/d5/fde x:0 0 0 2024-01-17T23:44:48.832 INFO:tasks.workunit.client.0.smithi067.stdout:2/660: creat d5/d1f/d2a/d54/d8/d4c/d84/fe7 x:0 0 0 2024-01-17T23:44:49.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/717: rename d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb/dda to d4/d4b/d7f/ddd 0 2024-01-17T23:44:49.874 INFO:tasks.workunit.client.0.smithi067.stdout:7/718: chown d4/d25/l4f 21663 1 2024-01-17T23:44:50.027 INFO:tasks.workunit.client.0.smithi067.stdout:4/678: mkdir d3/d26/d34/d3a/d53/dc6/d20/d3b/ddf 0 2024-01-17T23:44:50.505 INFO:tasks.workunit.client.0.smithi067.stdout:9/598: write d3/d6/d2a/fc6 [1405355,110427] 0 2024-01-17T23:44:50.518 INFO:tasks.workunit.client.0.smithi067.stdout:9/599: fsync d3/d6/d2a/fc6 0 2024-01-17T23:44:50.535 INFO:tasks.workunit.client.0.smithi067.stdout:1/678: dwrite d0/d7/d13/d2e/f6d [0,4194304] 0 2024-01-17T23:44:50.549 INFO:tasks.workunit.client.0.smithi067.stdout:9/600: dwrite d3/d6/d47/d88/fcf [0,4194304] 0 2024-01-17T23:44:50.549 INFO:tasks.workunit.client.0.smithi067.stdout:9/601: fsync d3/d6/d2e/f9b 0 2024-01-17T23:44:50.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/719: mkdir d4/d25/d39/d79/dde 0 2024-01-17T23:44:50.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/720: fdatasync d4/d4b/fce 0 2024-01-17T23:44:50.945 INFO:tasks.workunit.client.0.smithi067.stdout:4/679: mknod d3/d26/d34/d3a/d53/dc6/da6/ce0 0 2024-01-17T23:44:51.002 INFO:tasks.workunit.client.0.smithi067.stdout:0/757: sync 2024-01-17T23:44:51.461 INFO:tasks.workunit.client.0.smithi067.stdout:1/679: link d0/d7/d13/d3a/d75/ca8 d0/d7/d13/d3a/d3e/cd7 0 2024-01-17T23:44:51.461 INFO:tasks.workunit.client.0.smithi067.stdout:1/680: stat d0/d7/d13/d3d/d48/d4d/fb8 0 2024-01-17T23:44:51.462 INFO:tasks.workunit.client.0.smithi067.stdout:1/681: chown d0/d7/d13/d3a/d75/da1/fd2 988669469 1 2024-01-17T23:44:51.462 INFO:tasks.workunit.client.0.smithi067.stdout:1/682: readlink d0/d7/d13/d2e/ld5 0 2024-01-17T23:44:51.487 INFO:tasks.workunit.client.0.smithi067.stdout:1/683: dwrite d0/d7/d13/d77/fcb [0,4194304] 0 2024-01-17T23:44:51.488 INFO:tasks.workunit.client.0.smithi067.stdout:1/684: getdents d0/d7/d13/d77/d95 0 2024-01-17T23:44:51.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/753: dwrite d6/db/d58/d5f/dc0/fb5 [0,4194304] 0 2024-01-17T23:44:51.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/754: dread - d6/d19/db4/fe2 zero size 2024-01-17T23:44:51.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/721: symlink d4/d4b/d63/d9c/ldf 0 2024-01-17T23:44:51.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/722: creat d4/d25/d39/d46/da8/fe0 x:0 0 0 2024-01-17T23:44:51.820 INFO:tasks.workunit.client.0.smithi067.stdout:4/680: mknod d3/d26/d34/d3a/d53/dc6/d20/d3b/ddf/ce1 0 2024-01-17T23:44:51.821 INFO:tasks.workunit.client.0.smithi067.stdout:4/681: chown d3/d26/d34/d3a/d53/dc6/d20/fb5 16485622 1 2024-01-17T23:44:51.821 INFO:tasks.workunit.client.0.smithi067.stdout:4/682: chown d3/d5/d93/f96 123 1 2024-01-17T23:44:51.841 INFO:tasks.workunit.client.0.smithi067.stdout:3/729: write d0/d13/d4a/d55/f72 [454458,45439] 0 2024-01-17T23:44:51.842 INFO:tasks.workunit.client.0.smithi067.stdout:3/730: write d0/f94 [1723184,50659] 0 2024-01-17T23:44:51.842 INFO:tasks.workunit.client.0.smithi067.stdout:3/731: write d0/d12/f21 [2925539,110828] 0 2024-01-17T23:44:51.842 INFO:tasks.workunit.client.0.smithi067.stdout:3/732: readlink d0/d34/d35/d65/d6f/l95 0 2024-01-17T23:44:51.852 INFO:tasks.workunit.client.0.smithi067.stdout:4/683: dwrite d3/d40/fcc [0,4194304] 0 2024-01-17T23:44:51.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/684: fsync d3/d8/d35/db0/fbf 0 2024-01-17T23:44:52.000 INFO:tasks.workunit.client.0.smithi067.stdout:0/758: dread d3/d64/f95 [0,4194304] 0 2024-01-17T23:44:52.580 INFO:tasks.workunit.client.0.smithi067.stdout:9/602: mkdir d3/da/dd5 0 2024-01-17T23:44:52.819 INFO:tasks.workunit.client.0.smithi067.stdout:6/732: write d6/d9/f9c [918815,4971] 0 2024-01-17T23:44:52.841 INFO:tasks.workunit.client.0.smithi067.stdout:6/733: dread d6/d9/d1c/d1e/f5e [4194304,4194304] 0 2024-01-17T23:44:52.843 INFO:tasks.workunit.client.0.smithi067.stdout:6/734: dread d6/d18/f33 [4194304,4194304] 0 2024-01-17T23:44:52.870 INFO:tasks.workunit.client.0.smithi067.stdout:6/735: dwrite d6/d9/d1c/d1e/d43/f8b [0,4194304] 0 2024-01-17T23:44:53.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/723: creat d4/d25/d39/d79/dde/fe1 x:0 0 0 2024-01-17T23:44:53.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/724: read - d4/d4b/d63/d95/dad/fd5 zero size 2024-01-17T23:44:53.299 INFO:tasks.workunit.client.0.smithi067.stdout:5/619: write d10/f1c [7037150,79369] 0 2024-01-17T23:44:53.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/733: creat d0/d17/dc8/dae/fe0 x:0 0 0 2024-01-17T23:44:53.534 INFO:tasks.workunit.client.0.smithi067.stdout:3/734: fsync d0/f99 0 2024-01-17T23:44:53.534 INFO:tasks.workunit.client.0.smithi067.stdout:3/735: fdatasync d0/d17/fc7 0 2024-01-17T23:44:53.534 INFO:tasks.workunit.client.0.smithi067.stdout:3/736: truncate d0/d12/f1c 5100574 0 2024-01-17T23:44:53.831 INFO:tasks.workunit.client.0.smithi067.stdout:0/759: read d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/fc8 [5495465,23083] 0 2024-01-17T23:44:53.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/661: dwrite d5/d1f/d16/faa [0,4194304] 0 2024-01-17T23:44:54.275 INFO:tasks.workunit.client.0.smithi067.stdout:9/603: unlink d3/d6/d47/l87 0 2024-01-17T23:44:55.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/725: unlink d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/fdb 0 2024-01-17T23:44:55.327 INFO:tasks.workunit.client.0.smithi067.stdout:5/620: mkdir d10/d53/da4/dc6 0 2024-01-17T23:44:55.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/760: write d3/d5/d1a/d1c/d4d/faa [2237246,54530] 0 2024-01-17T23:44:55.754 INFO:tasks.workunit.client.0.smithi067.stdout:0/761: chown d3/d5/d1a/d1c/d4e/lc3 4038757 1 2024-01-17T23:44:55.999 INFO:tasks.workunit.client.0.smithi067.stdout:2/662: mknod d5/d1f/d98/d9f/ce8 0 2024-01-17T23:44:56.026 INFO:tasks.workunit.client.0.smithi067.stdout:2/663: dwrite d5/d1f/d2a/d54/d8/d4c/f51 [4194304,4194304] 0 2024-01-17T23:44:56.122 INFO:tasks.workunit.client.0.smithi067.stdout:8/755: rename d6/db/d58 to d6/d26/d56/dbb/dfd 0 2024-01-17T23:44:56.122 INFO:tasks.workunit.client.0.smithi067.stdout:1/685: truncate d0/d7/d13/d77/fcb 1902926 0 2024-01-17T23:44:56.282 INFO:tasks.workunit.client.0.smithi067.stdout:9/604: mknod d3/d6/d2a/cd6 0 2024-01-17T23:44:56.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/762: creat d3/dbf/f11c x:0 0 0 2024-01-17T23:44:56.798 INFO:tasks.workunit.client.0.smithi067.stdout:0/763: dwrite d3/f1b [4194304,4194304] 0 2024-01-17T23:44:57.064 INFO:tasks.workunit.client.0.smithi067.stdout:2/664: unlink d5/d1f/l4d 0 2024-01-17T23:44:58.438 INFO:tasks.workunit.client.0.smithi067.stdout:9/605: mkdir d3/d6/d11/d50/d84/dd7 0 2024-01-17T23:44:58.439 INFO:tasks.workunit.client.0.smithi067.stdout:9/606: dread - d3/d6/d11/dbe/dd0/da6/fd2 zero size 2024-01-17T23:44:58.458 INFO:tasks.workunit.client.0.smithi067.stdout:9/607: dread d3/d6/f56 [0,4194304] 0 2024-01-17T23:44:58.458 INFO:tasks.workunit.client.0.smithi067.stdout:9/608: dread - d3/d6/da4/d55/fa3 zero size 2024-01-17T23:44:58.626 INFO:tasks.workunit.client.0.smithi067.stdout:5/621: getdents d10/d24/d46/d4a/d63 0 2024-01-17T23:44:58.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/764: unlink d3/d6/dd/c53 0 2024-01-17T23:44:58.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/765: dwrite d3/d6/dd/fd1 [0,4194304] 0 2024-01-17T23:44:58.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/766: chown d3/d5/d1a/d1c/d4e/d7c/dd0 42391 1 2024-01-17T23:44:58.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/767: dwrite d3/d6/dd/dc4/ff4 [0,4194304] 0 2024-01-17T23:44:58.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/609: mkdir d3/d6/d2a/da2/dd8 0 2024-01-17T23:44:59.023 INFO:tasks.workunit.client.0.smithi067.stdout:5/622: creat d10/fc7 x:0 0 0 2024-01-17T23:44:59.494 INFO:tasks.workunit.client.0.smithi067.stdout:5/623: dread - d10/d24/d59/d5d/fa8 zero size 2024-01-17T23:44:59.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/624: rmdir d10/d24/d46/db1 39 2024-01-17T23:44:59.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/685: rename d3/d26/d34/d3a/d53/dc6/l9b to d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/le2 0 2024-01-17T23:44:59.905 INFO:tasks.workunit.client.0.smithi067.stdout:4/686: dwrite d3/d26/d34/d3a/d53/fb3 [0,4194304] 0 2024-01-17T23:45:00.054 INFO:tasks.workunit.client.0.smithi067.stdout:0/768: rmdir d3/d5/d1a/d1c/d1d/d2e 39 2024-01-17T23:45:00.054 INFO:tasks.workunit.client.0.smithi067.stdout:0/769: chown d3/d64/d7d/l106 9866 1 2024-01-17T23:45:00.054 INFO:tasks.workunit.client.0.smithi067.stdout:0/770: chown d3/d5/d32/f7a 2864910 1 2024-01-17T23:45:00.204 INFO:tasks.workunit.client.0.smithi067.stdout:5/625: creat d10/d24/d59/d5d/d43/fc8 x:0 0 0 2024-01-17T23:45:00.204 INFO:tasks.workunit.client.0.smithi067.stdout:5/626: fsync d10/d24/d25/f2e 0 2024-01-17T23:45:00.204 INFO:tasks.workunit.client.0.smithi067.stdout:5/627: creat d10/d24/d25/d5c/d7e/d7f/fc9 x:0 0 0 2024-01-17T23:45:00.204 INFO:tasks.workunit.client.0.smithi067.stdout:5/628: chown d10/d24/d59/d5d/f51 4523 1 2024-01-17T23:45:00.204 INFO:tasks.workunit.client.0.smithi067.stdout:5/629: readlink d10/d24/d46/d4a/d50/l65 0 2024-01-17T23:45:00.420 INFO:tasks.workunit.client.0.smithi067.stdout:1/686: read - d0/fca zero size 2024-01-17T23:45:00.454 INFO:tasks.workunit.client.0.smithi067.stdout:1/687: dwrite d0/d7/d13/fd4 [0,4194304] 0 2024-01-17T23:45:01.290 INFO:tasks.workunit.client.0.smithi067.stdout:3/737: rename d0/d13/d4a to d0/de1 0 2024-01-17T23:45:01.290 INFO:tasks.workunit.client.0.smithi067.stdout:3/738: chown d0/d37/ca1 1948603 1 2024-01-17T23:45:01.321 INFO:tasks.workunit.client.0.smithi067.stdout:1/688: truncate d0/f5 5085641 0 2024-01-17T23:45:01.335 INFO:tasks.workunit.client.0.smithi067.stdout:1/689: write d0/d7/d13/d3a/f5d [1718264,6468] 0 2024-01-17T23:45:01.335 INFO:tasks.workunit.client.0.smithi067.stdout:1/690: dread - d0/d7/d13/d3a/d45/fbd zero size 2024-01-17T23:45:01.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/691: read d0/d74/d31/f86 [2726463,18293] 0 2024-01-17T23:45:01.532 INFO:tasks.workunit.client.0.smithi067.stdout:2/665: rename d5/d1f/d2a/d54/d39/fca to d5/d1f/d16/fe9 0 2024-01-17T23:45:01.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/739: link d0/f80 d0/de1/d82/da6/fe2 0 2024-01-17T23:45:01.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/740: stat d0/f3 0 2024-01-17T23:45:01.908 INFO:tasks.workunit.client.0.smithi067.stdout:1/692: link d0/fca d0/d7/d13/d3d/d48/fd8 0 2024-01-17T23:45:02.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/610: rename d3/d6/d11/l4c to d3/d6/da4/d55/ld9 0 2024-01-17T23:45:02.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/736: write d6/d18/d2e/d7c/fd7 [882587,91974] 0 2024-01-17T23:45:02.148 INFO:tasks.workunit.client.0.smithi067.stdout:9/611: creat d3/d6/d11/d5c/fda x:0 0 0 2024-01-17T23:45:02.148 INFO:tasks.workunit.client.0.smithi067.stdout:9/612: write d3/d6/da4/d55/fa3 [297078,104060] 0 2024-01-17T23:45:02.296 INFO:tasks.workunit.client.0.smithi067.stdout:3/741: mkdir d0/d34/de3 0 2024-01-17T23:45:02.337 INFO:tasks.workunit.client.0.smithi067.stdout:7/726: dwrite d4/d25/f33 [0,4194304] 0 2024-01-17T23:45:02.551 INFO:tasks.workunit.client.0.smithi067.stdout:1/693: unlink d0/d7/d13/d3a/d75/cb1 0 2024-01-17T23:45:02.551 INFO:tasks.workunit.client.0.smithi067.stdout:4/687: rename d3/d5/d93/dcd/fd4 to d3/d8/d35/fe3 0 2024-01-17T23:45:03.586 INFO:tasks.workunit.client.0.smithi067.stdout:9/613: creat d3/d6/d2e/dc8/fdb x:0 0 0 2024-01-17T23:45:03.755 INFO:tasks.workunit.client.0.smithi067.stdout:0/771: mkdir d3/d5/d11d 0 2024-01-17T23:45:03.755 INFO:tasks.workunit.client.0.smithi067.stdout:0/772: write d3/d5/d32/f78 [3524716,3374] 0 2024-01-17T23:45:03.986 INFO:tasks.workunit.client.0.smithi067.stdout:3/742: unlink d0/d17/dc8/dae/fbe 0 2024-01-17T23:45:03.993 INFO:tasks.workunit.client.0.smithi067.stdout:3/743: dread d0/d17/dc8/fa3 [0,4194304] 0 2024-01-17T23:45:04.481 INFO:tasks.workunit.client.0.smithi067.stdout:5/630: rename d10/d24/c31 to d10/d24/d25/d5c/d7e/d7f/cca 0 2024-01-17T23:45:04.514 INFO:tasks.workunit.client.0.smithi067.stdout:5/631: dwrite d10/d24/d46/f6a [0,4194304] 0 2024-01-17T23:45:04.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/694: link d0/d74/d31/c41 d0/d7/d13/d77/cd9 0 2024-01-17T23:45:04.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/695: chown d0/d7/d13/d77/d95 854905202 1 2024-01-17T23:45:04.602 INFO:tasks.workunit.client.0.smithi067.stdout:1/696: write d0/d7/d13/d3d/d48/fad [447600,11812] 0 2024-01-17T23:45:04.859 INFO:tasks.workunit.client.0.smithi067.stdout:4/688: creat d3/d5/d93/dcd/fe4 x:0 0 0 2024-01-17T23:45:05.019 INFO:tasks.workunit.client.0.smithi067.stdout:9/614: creat d3/d6/d47/d88/dc2/fdc x:0 0 0 2024-01-17T23:45:05.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/615: dread d3/d6/d47/d88/fcf [0,4194304] 0 2024-01-17T23:45:05.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/616: creat d3/d6/d2e/dc8/fdd x:0 0 0 2024-01-17T23:45:05.079 INFO:tasks.workunit.client.0.smithi067.stdout:9/617: dwrite d3/d6/d2e/f9b [0,4194304] 0 2024-01-17T23:45:05.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/756: sync 2024-01-17T23:45:05.149 INFO:tasks.workunit.client.0.smithi067.stdout:8/757: read d6/d19/d22/d25/f5d [97126,6496] 0 2024-01-17T23:45:05.149 INFO:tasks.workunit.client.0.smithi067.stdout:8/758: fsync d6/d26/d56/dbb/dfd/fbe 0 2024-01-17T23:45:05.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/759: read d6/d19/fc8 [2962828,119154] 0 2024-01-17T23:45:05.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/760: fsync d6/d26/d7c/fef 0 2024-01-17T23:45:05.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/666: rename d5/d1f/d2a/d54/d39/cde to d5/d1f/d2a/d55/cea 0 2024-01-17T23:45:05.741 INFO:tasks.workunit.client.0.smithi067.stdout:1/697: mknod d0/d7/d13/d3a/d75/cda 0 2024-01-17T23:45:05.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/689: dread d3/d26/d34/d65/f68 [0,4194304] 0 2024-01-17T23:45:05.742 INFO:tasks.workunit.client.0.smithi067.stdout:4/690: write d3/d40/f70 [5945633,42395] 0 2024-01-17T23:45:05.975 INFO:tasks.workunit.client.0.smithi067.stdout:9/618: chown d3/d6/d11/d50/f43 901832 1 2024-01-17T23:45:06.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/761: creat d6/d19/d22/d25/d53/ffe x:0 0 0 2024-01-17T23:45:06.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/762: chown d6/d19/d22/d25/d53/f17 166743130 1 2024-01-17T23:45:06.373 INFO:tasks.workunit.client.0.smithi067.stdout:5/632: truncate d10/d53/d9a/fbc 1180926 0 2024-01-17T23:45:06.373 INFO:tasks.workunit.client.0.smithi067.stdout:5/633: fsync d10/d24/d25/d5c/d7e/fa7 0 2024-01-17T23:45:06.386 INFO:tasks.workunit.client.0.smithi067.stdout:2/667: dread d5/d1f/f3c [0,4194304] 0 2024-01-17T23:45:06.449 INFO:tasks.workunit.client.0.smithi067.stdout:1/698: mknod d0/d7/d13/d3d/d48/da4/cdb 0 2024-01-17T23:45:06.523 INFO:tasks.workunit.client.0.smithi067.stdout:4/691: unlink d3/d8/lba 0 2024-01-17T23:45:06.523 INFO:tasks.workunit.client.0.smithi067.stdout:4/692: chown d3/d5/f3f 2647750 1 2024-01-17T23:45:06.926 INFO:tasks.workunit.client.0.smithi067.stdout:5/634: creat d10/d24/d25/d5c/fcb x:0 0 0 2024-01-17T23:45:07.134 INFO:tasks.workunit.client.0.smithi067.stdout:2/668: creat d5/d1f/d2a/feb x:0 0 0 2024-01-17T23:45:07.292 INFO:tasks.workunit.client.0.smithi067.stdout:1/699: truncate d0/d7/d13/d2e/f49 2663100 0 2024-01-17T23:45:07.617 INFO:tasks.workunit.client.0.smithi067.stdout:5/635: symlink d10/d24/d59/d8c/lcc 0 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/636: write d10/d24/db4/fbf [719804,110641] 0 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/637: fdatasync d10/f6e 0 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/638: chown d10/d24/d25/d5c/d7e/d7f/d92/l99 332 1 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/639: dread - d10/d24/d25/d5c/d7e/d7f/fc0 zero size 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/640: creat d10/d24/d25/d5c/fcd x:0 0 0 2024-01-17T23:45:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/641: read d10/d24/d25/f2b [2044912,4887] 0 2024-01-17T23:45:07.651 INFO:tasks.workunit.client.0.smithi067.stdout:5/642: dwrite d10/f88 [0,4194304] 0 2024-01-17T23:45:07.726 INFO:tasks.workunit.client.0.smithi067.stdout:2/669: rename d5/d1f/d98/d9f/fae to d5/d1f/d2a/d8d/fec 0 2024-01-17T23:45:08.526 INFO:tasks.workunit.client.0.smithi067.stdout:5/643: mkdir d10/d24/d59/d5d/dce 0 2024-01-17T23:45:08.527 INFO:tasks.workunit.client.0.smithi067.stdout:5/644: truncate d10/d24/d25/d5c/d7e/d7f/fc9 469216 0 2024-01-17T23:45:08.690 INFO:tasks.workunit.client.0.smithi067.stdout:2/670: mkdir d5/d1f/d98/ded 0 2024-01-17T23:45:08.891 INFO:tasks.workunit.client.0.smithi067.stdout:1/700: mkdir d0/ddc 0 2024-01-17T23:45:08.891 INFO:tasks.workunit.client.0.smithi067.stdout:4/693: link d3/d26/d34/d3a/d53/dc6/d20/d3b/c83 d3/d26/d34/d3a/d53/dc6/d20/ce5 0 2024-01-17T23:45:08.891 INFO:tasks.workunit.client.0.smithi067.stdout:1/701: readlink d0/d7/d7f/l97 0 2024-01-17T23:45:08.891 INFO:tasks.workunit.client.0.smithi067.stdout:1/702: write d0/d7/d7f/f91 [848794,129860] 0 2024-01-17T23:45:08.892 INFO:tasks.workunit.client.0.smithi067.stdout:1/703: truncate d0/d7/d13/d3d/d48/da4/fcd 1036696 0 2024-01-17T23:45:09.311 INFO:tasks.workunit.client.0.smithi067.stdout:5/645: rename d10/d24/d59/d5d/f41 to d10/d24/d46/d4a/d50/fcf 0 2024-01-17T23:45:09.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/727: creat d4/d25/d39/d46/d78/d93/d94/dc4/fe2 x:0 0 0 2024-01-17T23:45:09.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/728: write d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fb5 [1117783,99818] 0 2024-01-17T23:45:09.328 INFO:tasks.workunit.client.0.smithi067.stdout:7/729: dread d4/d25/d39/d46/d60/f66 [0,4194304] 0 2024-01-17T23:45:09.330 INFO:tasks.workunit.client.0.smithi067.stdout:5/646: write d10/d24/f2d [4039791,90058] 0 2024-01-17T23:45:09.524 INFO:tasks.workunit.client.0.smithi067.stdout:1/704: mkdir d0/d7/d13/d3a/d3e/ddd 0 2024-01-17T23:45:09.524 INFO:tasks.workunit.client.0.smithi067.stdout:1/705: truncate d0/d74/d31/fbe 859850 0 2024-01-17T23:45:09.715 INFO:tasks.workunit.client.0.smithi067.stdout:7/730: dread d4/f27 [0,4194304] 0 2024-01-17T23:45:09.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/671: mkdir d5/d1f/d2a/d54/dee 0 2024-01-17T23:45:10.108 INFO:tasks.workunit.client.0.smithi067.stdout:4/694: truncate d3/d26/d34/d3a/d53/dc6/d20/d3b/f51 798969 0 2024-01-17T23:45:10.119 INFO:tasks.workunit.client.0.smithi067.stdout:4/695: dread d3/d8/d35/f3c [4194304,4194304] 0 2024-01-17T23:45:10.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/696: readlink d3/d26/d34/d3a/d53/dc6/ld8 0 2024-01-17T23:45:10.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/697: dread - d3/d5/d93/dcd/fe4 zero size 2024-01-17T23:45:10.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/698: chown d3/d26/d34/d3a/f4b 12 1 2024-01-17T23:45:10.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/699: write d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fcf [849880,39750] 0 2024-01-17T23:45:10.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/700: chown d3/d26/d34/d3a/d53/dc6/d20 24872 1 2024-01-17T23:45:10.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/706: creat d0/d69/fde x:0 0 0 2024-01-17T23:45:10.182 INFO:tasks.workunit.client.0.smithi067.stdout:1/707: write d0/d7/d13/d3a/fa6 [983854,118044] 0 2024-01-17T23:45:11.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/672: creat d5/d86/fef x:0 0 0 2024-01-17T23:45:11.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/673: truncate d5/d1f/d2a/d54/d8/d4c/fc2 536326 0 2024-01-17T23:45:11.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/674: write d5/d1f/d2a/d55/f99 [2589265,110963] 0 2024-01-17T23:45:11.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/675: fsync d5/d1f/f96 0 2024-01-17T23:45:11.200 INFO:tasks.workunit.client.0.smithi067.stdout:3/744: dwrite d0/d34/d35/d65/d6f/fa2 [0,4194304] 0 2024-01-17T23:45:11.201 INFO:tasks.workunit.client.0.smithi067.stdout:3/745: chown d0/de1/d55/lc2 2413642 1 2024-01-17T23:45:11.691 INFO:tasks.workunit.client.0.smithi067.stdout:1/708: symlink d0/d7/d7f/d82/ldf 0 2024-01-17T23:45:11.709 INFO:tasks.workunit.client.0.smithi067.stdout:1/709: dread d0/d7/d13/f50 [0,4194304] 0 2024-01-17T23:45:11.709 INFO:tasks.workunit.client.0.smithi067.stdout:1/710: chown d0/d7/d13/d3a/f59 1818838 1 2024-01-17T23:45:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/676: creat d5/d1f/d2a/d54/d39/ff0 x:0 0 0 2024-01-17T23:45:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:3/746: creat d0/d37/dbb/fe4 x:0 0 0 2024-01-17T23:45:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:3/747: stat d0/d12/fd1 0 2024-01-17T23:45:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:3/748: readlink d0/d37/l41 0 2024-01-17T23:45:12.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/711: creat d0/d7/d13/d3d/dd0/fe0 x:0 0 0 2024-01-17T23:45:12.441 INFO:tasks.workunit.client.0.smithi067.stdout:2/677: symlink d5/d1f/d2a/d54/d8/d4c/dbf/de2/lf1 0 2024-01-17T23:45:12.441 INFO:tasks.workunit.client.0.smithi067.stdout:2/678: chown d5/d1f/d2a/d54/d39/l3d 693275311 1 2024-01-17T23:45:12.441 INFO:tasks.workunit.client.0.smithi067.stdout:2/679: chown d5/d1f/d16/l7b 2 1 2024-01-17T23:45:12.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/619: write d3/d6/f56 [287413,48337] 0 2024-01-17T23:45:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:9/620: read d3/d25/f9a [1702765,12476] 0 2024-01-17T23:45:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:9/621: readlink d3/d6/d11/d50/d84/da8/d6a/la7 0 2024-01-17T23:45:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:9/622: chown d3/d6/f9 13573667 1 2024-01-17T23:45:12.537 INFO:tasks.workunit.client.0.smithi067.stdout:9/623: write d3/d6/d47/fb6 [641151,50097] 0 2024-01-17T23:45:12.632 INFO:tasks.workunit.client.0.smithi067.stdout:1/712: symlink d0/d7/d7f/le1 0 2024-01-17T23:45:12.862 INFO:tasks.workunit.client.0.smithi067.stdout:2/680: rename d5/d1f/d2a/le5 to d5/d1f/d2a/d54/d8/d4c/db3/lf2 0 2024-01-17T23:45:12.882 INFO:tasks.workunit.client.0.smithi067.stdout:2/681: dread d5/d1f/d98/fc5 [0,4194304] 0 2024-01-17T23:45:12.999 INFO:tasks.workunit.client.0.smithi067.stdout:3/749: getdents d0/d17/d69/d6e 0 2024-01-17T23:45:12.999 INFO:tasks.workunit.client.0.smithi067.stdout:3/750: creat d0/d12/d1b/d4d/fe5 x:0 0 0 2024-01-17T23:45:13.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/751: dread d0/d12/d1b/d4d/fc5 [0,4194304] 0 2024-01-17T23:45:13.249 INFO:tasks.workunit.client.0.smithi067.stdout:9/624: rename d3/d25/f9a to d3/d6/da4/dba/fde 0 2024-01-17T23:45:13.474 INFO:tasks.workunit.client.0.smithi067.stdout:2/682: creat d5/d1f/d2a/d54/ff3 x:0 0 0 2024-01-17T23:45:13.951 INFO:tasks.workunit.client.0.smithi067.stdout:9/625: creat d3/d6/d47/fdf x:0 0 0 2024-01-17T23:45:13.958 INFO:tasks.workunit.client.0.smithi067.stdout:9/626: dread d3/d6/da4/dba/fde [0,4194304] 0 2024-01-17T23:45:13.985 INFO:tasks.workunit.client.0.smithi067.stdout:9/627: dwrite d3/d6/d2a/d34/f45 [0,4194304] 0 2024-01-17T23:45:14.160 INFO:tasks.workunit.client.0.smithi067.stdout:2/683: mkdir d5/d1f/d2a/d54/d8/d4c/dbf/df4 0 2024-01-17T23:45:14.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:14.487 INFO:tasks.workunit.client.0.smithi067.stdout:3/752: truncate d0/d34/d35/f50 660798 0 2024-01-17T23:45:14.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:14.920 INFO:tasks.workunit.client.0.smithi067.stdout:9/628: rename d3/da/lb to d3/d6/da4/le0 0 2024-01-17T23:45:14.921 INFO:tasks.workunit.client.0.smithi067.stdout:9/629: stat d3/d6/d2a/da2/dbd 0 2024-01-17T23:45:15.015 INFO:tasks.workunit.client.0.smithi067.stdout:2/684: symlink d5/d1f/d2a/d8d/lf5 0 2024-01-17T23:45:15.231 INFO:tasks.workunit.client.0.smithi067.stdout:3/753: mknod d0/d34/ce6 0 2024-01-17T23:45:15.231 INFO:tasks.workunit.client.0.smithi067.stdout:3/754: chown d0/de1/d82/da6 1 1 2024-01-17T23:45:15.231 INFO:tasks.workunit.client.0.smithi067.stdout:3/755: fdatasync d0/d12/d1b/f2d 0 2024-01-17T23:45:15.253 INFO:tasks.workunit.client.0.smithi067.stdout:3/756: write d0/d12/d1b/d4d/f7f [4106218,38644] 0 2024-01-17T23:45:15.368 INFO:tasks.workunit.client.0.smithi067.stdout:9/630: creat d3/d6/d2a/d34/d42/d9c/fe1 x:0 0 0 2024-01-17T23:45:15.441 INFO:tasks.workunit.client.0.smithi067.stdout:1/713: creat d0/d7/d13/fe2 x:0 0 0 2024-01-17T23:45:15.441 INFO:tasks.workunit.client.0.smithi067.stdout:1/714: truncate d0/d7/d13/f40 1167349 0 2024-01-17T23:45:15.441 INFO:tasks.workunit.client.0.smithi067.stdout:1/715: fdatasync d0/d7/d13/d3d/d48/d4d/fb8 0 2024-01-17T23:45:15.504 INFO:tasks.workunit.client.0.smithi067.stdout:2/685: truncate d5/d1f/d2a/d54/d8/fce 1295737 0 2024-01-17T23:45:15.770 INFO:tasks.workunit.client.0.smithi067.stdout:3/757: link d0/d12/d1b/f8b d0/d34/d35/d65/d6f/d70/fe7 0 2024-01-17T23:45:15.770 INFO:tasks.workunit.client.0.smithi067.stdout:3/758: creat d0/d17/dc8/dae/fe8 x:0 0 0 2024-01-17T23:45:15.989 INFO:tasks.workunit.client.0.smithi067.stdout:9/631: rename d3/d6/d11/dbe to d3/d6/d2a/da2/de2 0 2024-01-17T23:45:16.239 INFO:tasks.workunit.client.0.smithi067.stdout:0/773: sync 2024-01-17T23:45:16.239 INFO:tasks.workunit.client.0.smithi067.stdout:6/737: sync 2024-01-17T23:45:16.239 INFO:tasks.workunit.client.0.smithi067.stdout:6/738: truncate d6/d9/d1c/d1e/f5e 8611541 0 2024-01-17T23:45:16.561 INFO:tasks.workunit.client.0.smithi067.stdout:2/686: mkdir d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6 0 2024-01-17T23:45:16.777 INFO:tasks.workunit.client.0.smithi067.stdout:3/759: truncate d0/d17/f29 520335 0 2024-01-17T23:45:16.869 INFO:tasks.workunit.client.0.smithi067.stdout:9/632: rename d3/d6/d47/c7e to d3/d58/ce3 0 2024-01-17T23:45:16.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/716: symlink d0/d69/le3 0 2024-01-17T23:45:16.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/717: dwrite d0/d7/d13/fe2 [0,4194304] 0 2024-01-17T23:45:16.964 INFO:tasks.workunit.client.0.smithi067.stdout:1/718: dwrite d0/d7/d7f/fd3 [0,4194304] 0 2024-01-17T23:45:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/739: chown d6/d9/l98 76077525 1 2024-01-17T23:45:17.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/740: dwrite d6/d9/d1c/d1e/dd4/fb2 [0,4194304] 0 2024-01-17T23:45:17.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/741: getdents d6/d9/d65 0 2024-01-17T23:45:17.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/742: chown d6/d9/d1c/d1e/d43/d78/dab/cfc 50137460 1 2024-01-17T23:45:17.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/743: read d6/d9/d30/f7b [1461295,58343] 0 2024-01-17T23:45:17.088 INFO:tasks.workunit.client.0.smithi067.stdout:2/687: dread d5/d1f/d16/fe0 [0,4194304] 0 2024-01-17T23:45:17.088 INFO:tasks.workunit.client.0.smithi067.stdout:2/688: fsync d5/d1f/d2a/d54/d8/d32/fd1 0 2024-01-17T23:45:17.115 INFO:tasks.workunit.client.0.smithi067.stdout:2/689: dwrite d5/d1f/d2a/d54/d8/d32/d33/fcc [0,4194304] 0 2024-01-17T23:45:17.115 INFO:tasks.workunit.client.0.smithi067.stdout:2/690: write d5/d1f/d2a/d54/d39/fdb [1020312,112076] 0 2024-01-17T23:45:17.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/760: unlink d0/d17/d69/d6e/l88 0 2024-01-17T23:45:17.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/761: chown d0/d37/ca1 201695736 1 2024-01-17T23:45:17.287 INFO:tasks.workunit.client.0.smithi067.stdout:3/762: dread d0/d13/d1a/d38/f53 [0,4194304] 0 2024-01-17T23:45:17.469 INFO:tasks.workunit.client.0.smithi067.stdout:9/633: mknod d3/d6/d11/d50/d84/dd7/ce4 0 2024-01-17T23:45:17.864 INFO:tasks.workunit.client.0.smithi067.stdout:1/719: link d0/d7/d7f/d82/ldf d0/d7/d13/d77/d95/le4 0 2024-01-17T23:45:18.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/731: write d4/fb [2327861,108734] 0 2024-01-17T23:45:18.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/732: truncate d4/d25/d39/d46/d78/d93/d94/dc4/fe2 585183 0 2024-01-17T23:45:18.229 INFO:tasks.workunit.client.0.smithi067.stdout:6/744: creat d6/d18/d2e/d61/d9a/dd1/ffd x:0 0 0 2024-01-17T23:45:18.238 INFO:tasks.workunit.client.0.smithi067.stdout:6/745: dread d6/f17 [0,4194304] 0 2024-01-17T23:45:18.238 INFO:tasks.workunit.client.0.smithi067.stdout:6/746: getdents d6/d81/dc7 0 2024-01-17T23:45:18.379 INFO:tasks.workunit.client.0.smithi067.stdout:2/691: mkdir d5/d1f/d2a/d54/d8/d4c/dbf/df4/df7 0 2024-01-17T23:45:18.471 INFO:tasks.workunit.client.0.smithi067.stdout:5/647: dwrite d10/d24/d59/d5d/f9f [4194304,4194304] 0 2024-01-17T23:45:18.678 INFO:tasks.workunit.client.0.smithi067.stdout:9/634: creat d3/d6/d2e/fe5 x:0 0 0 2024-01-17T23:45:18.678 INFO:tasks.workunit.client.0.smithi067.stdout:9/635: write d3/d6/d47/fdf [560309,8129] 0 2024-01-17T23:45:18.798 INFO:tasks.workunit.client.0.smithi067.stdout:1/720: dread d0/d7/f29 [0,4194304] 0 2024-01-17T23:45:18.799 INFO:tasks.workunit.client.0.smithi067.stdout:1/721: stat d0/d7/d13/d3d/d48/da4 0 2024-01-17T23:45:19.277 INFO:tasks.workunit.client.0.smithi067.stdout:7/733: link d4/d4b/d7f/d82/cb2 d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/ce3 0 2024-01-17T23:45:19.278 INFO:tasks.workunit.client.0.smithi067.stdout:6/747: creat d6/d18/ffe x:0 0 0 2024-01-17T23:45:19.278 INFO:tasks.workunit.client.0.smithi067.stdout:6/748: creat d6/d9/d65/da4/fff x:0 0 0 2024-01-17T23:45:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:2/692: unlink d5/d1f/d2a/d54/d8/f58 0 2024-01-17T23:45:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:2/693: chown d5/d1f/d2a/d54/d8/d32/fd1 320 1 2024-01-17T23:45:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:2/694: write d5/d86/fef [157280,62711] 0 2024-01-17T23:45:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:2/695: write d5/d1f/d2a/d73/d95/fd8 [183194,118126] 0 2024-01-17T23:45:19.543 INFO:tasks.workunit.client.0.smithi067.stdout:5/648: unlink d10/d24/d46/d4a/cc1 0 2024-01-17T23:45:19.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/636: creat d3/d6/da4/dba/fe6 x:0 0 0 2024-01-17T23:45:19.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/637: dread - d3/d6/d2a/da2/de2/dd0/da6/fd2 zero size 2024-01-17T23:45:19.870 INFO:tasks.workunit.client.0.smithi067.stdout:1/722: creat d0/d7/d13/d3a/d45/fe5 x:0 0 0 2024-01-17T23:45:19.870 INFO:tasks.workunit.client.0.smithi067.stdout:1/723: dread - d0/d69/fc6 zero size 2024-01-17T23:45:20.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/696: dwrite d5/d1f/d2a/d54/d7c/fcb [4194304,4194304] 0 2024-01-17T23:45:20.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/697: stat d5/d1f/d2a/d54/d8 0 2024-01-17T23:45:20.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/698: chown d5/d1f/d2a/d55/f99 7277 1 2024-01-17T23:45:20.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/699: truncate d5/d2f/f8f 808135 0 2024-01-17T23:45:20.253 INFO:tasks.workunit.client.0.smithi067.stdout:2/700: dwrite d5/d1f/d35/f3b [4194304,4194304] 0 2024-01-17T23:45:20.253 INFO:tasks.workunit.client.0.smithi067.stdout:2/701: creat d5/d1f/d2a/d54/d8/d32/ff8 x:0 0 0 2024-01-17T23:45:20.331 INFO:tasks.workunit.client.0.smithi067.stdout:5/649: truncate d10/d24/d46/d4a/f74 3199399 0 2024-01-17T23:45:20.348 INFO:tasks.workunit.client.0.smithi067.stdout:5/650: write d10/d24/f36 [3136334,17558] 0 2024-01-17T23:45:20.452 INFO:tasks.workunit.client.0.smithi067.stdout:9/638: creat d3/d6/d11/d50/d84/da8/da9/fe7 x:0 0 0 2024-01-17T23:45:20.935 INFO:tasks.workunit.client.0.smithi067.stdout:2/702: mknod d5/d1f/d2a/d54/d8/d4c/dbf/de2/cf9 0 2024-01-17T23:45:20.937 INFO:tasks.workunit.client.0.smithi067.stdout:2/703: dread d5/d1f/d2a/d54/d8/d4c/d84/f8c [4194304,4194304] 0 2024-01-17T23:45:20.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/704: dread d5/d1f/f3c [0,4194304] 0 2024-01-17T23:45:20.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/705: readlink d5/d2f/l6a 0 2024-01-17T23:45:20.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/706: chown d5/d1f/d35/f5c 16 1 2024-01-17T23:45:20.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/707: truncate d5/d1f/d2a/d54/d39/ff0 722355 0 2024-01-17T23:45:20.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/708: chown d5/d1f/d2a/d8d/fc8 0 1 2024-01-17T23:45:21.059 INFO:tasks.workunit.client.0.smithi067.stdout:3/763: rename d0/f94 to d0/d34/d35/d65/d6f/fe9 0 2024-01-17T23:45:21.059 INFO:tasks.workunit.client.0.smithi067.stdout:7/734: rename d4/d25/d39 to d4/d25/d39/d46/d60/dc7/de4 22 2024-01-17T23:45:21.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/735: dread d4/d25/d39/d46/d78/d93/d94/dc4/d40/f42 [4194304,4194304] 0 2024-01-17T23:45:21.081 INFO:tasks.workunit.client.0.smithi067.stdout:7/736: fsync d4/d25/d39/f35 0 2024-01-17T23:45:21.266 INFO:tasks.workunit.client.0.smithi067.stdout:5/651: creat d10/d53/fd0 x:0 0 0 2024-01-17T23:45:21.296 INFO:tasks.workunit.client.0.smithi067.stdout:5/652: dwrite d10/f91 [0,4194304] 0 2024-01-17T23:45:21.515 INFO:tasks.workunit.client.0.smithi067.stdout:9/639: mknod d3/d6/da4/ce8 0 2024-01-17T23:45:21.515 INFO:tasks.workunit.client.0.smithi067.stdout:9/640: dread - d3/d6/d2a/da2/de2/dd0/da6/fce zero size 2024-01-17T23:45:22.158 INFO:tasks.workunit.client.0.smithi067.stdout:8/763: unlink d6/d19/d22/l42 0 2024-01-17T23:45:22.158 INFO:tasks.workunit.client.0.smithi067.stdout:2/709: symlink d5/d1f/d2a/d54/d8/d4c/db3/lfa 0 2024-01-17T23:45:22.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/764: dread d6/d19/d22/d25/d53/d54/f77 [0,4194304] 0 2024-01-17T23:45:22.183 INFO:tasks.workunit.client.0.smithi067.stdout:2/710: read d5/d1f/d2a/d54/d8/d4c/f5f [1454074,72773] 0 2024-01-17T23:45:22.183 INFO:tasks.workunit.client.0.smithi067.stdout:2/711: stat d5/d1f/d2a/d54/d8/d4c/dbf/df4/df7 0 2024-01-17T23:45:22.183 INFO:tasks.workunit.client.0.smithi067.stdout:2/712: fsync d5/d1f/d2a/d54/d8/d32/f9b 0 2024-01-17T23:45:23.389 INFO:tasks.workunit.client.0.smithi067.stdout:8/765: mknod d6/d19/d22/d25/d53/d65/cff 0 2024-01-17T23:45:23.843 INFO:tasks.workunit.client.0.smithi067.stdout:8/766: creat d6/d26/d3e/f100 x:0 0 0 2024-01-17T23:45:24.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/767: mknod d6/d26/d56/dbb/de1/c101 0 2024-01-17T23:45:24.410 INFO:tasks.workunit.client.0.smithi067.stdout:6/749: creat d6/f100 x:0 0 0 2024-01-17T23:45:24.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/750: read d6/d9/d30/d58/fa9 [2632792,116355] 0 2024-01-17T23:45:24.461 INFO:tasks.workunit.client.0.smithi067.stdout:9/641: rename d3/d58/ce3 to d3/d6/da4/d55/da1/ce9 0 2024-01-17T23:45:24.466 INFO:tasks.workunit.client.0.smithi067.stdout:9/642: dread d3/d6/da4/d55/da1/fb3 [0,4194304] 0 2024-01-17T23:45:24.466 INFO:tasks.workunit.client.0.smithi067.stdout:9/643: chown d3/d58/f81 1010517238 1 2024-01-17T23:45:24.628 INFO:tasks.workunit.client.0.smithi067.stdout:6/751: symlink d6/d9/d1c/d1e/d43/def/d51/l101 0 2024-01-17T23:45:24.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/644: mknod d3/d6/da4/d55/da1/cea 0 2024-01-17T23:45:25.177 INFO:tasks.workunit.client.0.smithi067.stdout:9/645: symlink d3/d6/d2a/da2/dd8/leb 0 2024-01-17T23:45:25.177 INFO:tasks.workunit.client.0.smithi067.stdout:9/646: chown d3/d6/d47/d6d 81029 1 2024-01-17T23:45:25.224 INFO:tasks.workunit.client.0.smithi067.stdout:9/647: dwrite d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:45:25.224 INFO:tasks.workunit.client.0.smithi067.stdout:9/648: fsync d3/d6/da4/d55/f7b 0 2024-01-17T23:45:25.537 INFO:tasks.workunit.client.0.smithi067.stdout:6/752: symlink d6/d9/d3e/l102 0 2024-01-17T23:45:25.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/774: dwrite d3/d5/ffc [0,4194304] 0 2024-01-17T23:45:26.310 INFO:tasks.workunit.client.0.smithi067.stdout:0/775: read d3/d5/d1a/d1c/d4e/d7c/ffe [831692,3972] 0 2024-01-17T23:45:26.311 INFO:tasks.workunit.client.0.smithi067.stdout:0/776: fsync d3/dbf/f11c 0 2024-01-17T23:45:26.311 INFO:tasks.workunit.client.0.smithi067.stdout:0/777: fdatasync d3/d5/d1a/d1c/d1d/d2e/f8e 0 2024-01-17T23:45:26.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/649: getdents d3/d6/d47 0 2024-01-17T23:45:26.392 INFO:tasks.workunit.client.0.smithi067.stdout:9/650: stat d3/d6/d47/d6d/f8c 0 2024-01-17T23:45:26.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/651: creat d3/d6/d47/db4/fec x:0 0 0 2024-01-17T23:45:26.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/652: chown d3/d25/d5d 163431748 1 2024-01-17T23:45:26.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/653: truncate d3/d6/da4/d55/f7b 54397 0 2024-01-17T23:45:27.083 INFO:tasks.workunit.client.0.smithi067.stdout:4/701: sync 2024-01-17T23:45:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/654: link d3/d25/d5d/d79/fb7 d3/d6/d2a/d34/d42/d9c/fed 0 2024-01-17T23:45:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/655: dread - d3/d6/da4/dba/fe6 zero size 2024-01-17T23:45:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/656: chown d3/d6/d11/d50/d84 13348885 1 2024-01-17T23:45:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/657: creat d3/d58/fee x:0 0 0 2024-01-17T23:45:27.636 INFO:tasks.workunit.client.0.smithi067.stdout:4/702: mkdir d3/d26/d34/d3a/d53/dc6/de6 0 2024-01-17T23:45:27.636 INFO:tasks.workunit.client.0.smithi067.stdout:4/703: rename d3/d26/d34/d3a/d53/dc6 to d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/dc5/de7 22 2024-01-17T23:45:27.667 INFO:tasks.workunit.client.0.smithi067.stdout:4/704: dwrite d3/d8/d35/db0/fbd [0,4194304] 0 2024-01-17T23:45:27.667 INFO:tasks.workunit.client.0.smithi067.stdout:4/705: fdatasync d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fda 0 2024-01-17T23:45:27.680 INFO:tasks.workunit.client.0.smithi067.stdout:4/706: dread d3/d26/d34/d3a/f4b [0,4194304] 0 2024-01-17T23:45:28.124 INFO:tasks.workunit.client.0.smithi067.stdout:4/707: unlink d3/d26/d34/d3a/d53/dc6/d20/d3b/cdd 0 2024-01-17T23:45:28.134 INFO:tasks.workunit.client.0.smithi067.stdout:4/708: dread d3/d40/f41 [0,4194304] 0 2024-01-17T23:45:28.142 INFO:tasks.workunit.client.0.smithi067.stdout:4/709: dread d3/d40/f41 [0,4194304] 0 2024-01-17T23:45:28.142 INFO:tasks.workunit.client.0.smithi067.stdout:4/710: truncate d3/d8/d35/db0/fbd 4891071 0 2024-01-17T23:45:28.173 INFO:tasks.workunit.client.0.smithi067.stdout:9/658: symlink d3/d6/d11/lef 0 2024-01-17T23:45:28.287 INFO:tasks.workunit.client.0.smithi067.stdout:4/711: symlink d3/le8 0 2024-01-17T23:45:28.547 INFO:tasks.workunit.client.0.smithi067.stdout:4/712: symlink d3/d5/d93/dcd/le9 0 2024-01-17T23:45:28.547 INFO:tasks.workunit.client.0.smithi067.stdout:4/713: chown d3/le8 7 1 2024-01-17T23:45:28.547 INFO:tasks.workunit.client.0.smithi067.stdout:4/714: fdatasync d3/d26/d34/d3a/d53/dc6/d20/f5e 0 2024-01-17T23:45:28.547 INFO:tasks.workunit.client.0.smithi067.stdout:4/715: chown d3/d26/d34/d3a/d53/dc6/ld3 236 1 2024-01-17T23:45:28.573 INFO:tasks.workunit.client.0.smithi067.stdout:4/716: dwrite d3/fc3 [0,4194304] 0 2024-01-17T23:45:28.858 INFO:tasks.workunit.client.0.smithi067.stdout:4/717: creat d3/d26/d34/d3a/d9f/fea x:0 0 0 2024-01-17T23:45:29.835 INFO:tasks.workunit.client.0.smithi067.stdout:8/768: dwrite d6/d26/d56/dbb/fbc [0,4194304] 0 2024-01-17T23:45:29.927 INFO:tasks.workunit.client.0.smithi067.stdout:5/653: creat d10/d24/d59/fd1 x:0 0 0 2024-01-17T23:45:29.927 INFO:tasks.workunit.client.0.smithi067.stdout:5/654: stat d10/d24/d59/d5d/f95 0 2024-01-17T23:45:29.970 INFO:tasks.workunit.client.0.smithi067.stdout:6/753: dwrite d6/d9/f94 [0,4194304] 0 2024-01-17T23:45:29.979 INFO:tasks.workunit.client.0.smithi067.stdout:5/655: dwrite d10/d24/d25/f9b [0,4194304] 0 2024-01-17T23:45:29.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/656: dread d10/d24/d46/d4a/d63/f8b [0,4194304] 0 2024-01-17T23:45:30.325 INFO:tasks.workunit.client.0.smithi067.stdout:8/769: creat d6/d19/d22/dec/f102 x:0 0 0 2024-01-17T23:45:30.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/770: dwrite d6/d19/d22/d25/d53/f7e [0,4194304] 0 2024-01-17T23:45:30.491 INFO:tasks.workunit.client.0.smithi067.stdout:6/754: mknod d6/d9/d1c/d1e/d43/c103 0 2024-01-17T23:45:30.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/778: dwrite d3/d5/d1a/d1c/d1d/f9a [0,4194304] 0 2024-01-17T23:45:30.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/657: mkdir d10/d24/d59/d5d/dd2 0 2024-01-17T23:45:30.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/658: truncate d10/d24/d25/d5c/fcd 318830 0 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/659: mkdir d3/df0 0 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/660: chown d3/d58/fee 1015 1 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/771: unlink d6/d26/d3e/f74 0 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:6/755: stat d6/d18/d2e/d61/ff7 0 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:6/756: chown d6/fd 481311 1 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:6/757: dread - d6/d18/ffe zero size 2024-01-17T23:45:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:2/713: link d5/d1f/d2a/l74 d5/d1f/d2a/d54/lfb 0 2024-01-17T23:45:31.444 INFO:tasks.workunit.client.0.smithi067.stdout:8/772: dread d6/d19/d22/d25/d53/f7e [0,4194304] 0 2024-01-17T23:45:31.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/758: dwrite d6/f100 [0,4194304] 0 2024-01-17T23:45:31.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/759: readlink d6/d9/d65/lf1 0 2024-01-17T23:45:31.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/760: chown d6/d18/d2e/d61/d9a/cc8 421955710 1 2024-01-17T23:45:31.472 INFO:tasks.workunit.client.0.smithi067.stdout:8/773: dwrite d6/d19/f4a [0,4194304] 0 2024-01-17T23:45:31.484 INFO:tasks.workunit.client.0.smithi067.stdout:6/761: dwrite d6/f1f [0,4194304] 0 2024-01-17T23:45:31.819 INFO:tasks.workunit.client.0.smithi067.stdout:9/661: symlink d3/d6/d11/d50/d84/da8/d6a/lf1 0 2024-01-17T23:45:31.819 INFO:tasks.workunit.client.0.smithi067.stdout:9/662: truncate d3/d6/d11/d50/f77 2181881 0 2024-01-17T23:45:32.160 INFO:tasks.workunit.client.0.smithi067.stdout:2/714: getdents d5/d1f/d2a 0 2024-01-17T23:45:32.393 INFO:tasks.workunit.client.0.smithi067.stdout:6/762: fsync d6/fa 0 2024-01-17T23:45:32.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/763: dread d6/d9/d1c/d1e/d7e/f8c [0,4194304] 0 2024-01-17T23:45:32.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/779: mknod d3/d5/d1a/d1c/c11e 0 2024-01-17T23:45:32.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/780: chown d3/d5/d1a/d1c/d1d/d2e/c5f 2502 1 2024-01-17T23:45:33.251 INFO:tasks.workunit.client.0.smithi067.stdout:9/663: rmdir d3/d6/da4/d55/da1/dbc/dc7 0 2024-01-17T23:45:33.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/715: mkdir d5/d1f/dfc 0 2024-01-17T23:45:33.514 INFO:tasks.workunit.client.0.smithi067.stdout:6/764: symlink d6/d9/d65/dde/l104 0 2024-01-17T23:45:33.519 INFO:tasks.workunit.client.0.smithi067.stdout:6/765: dread d6/d9/d1c/d1e/d43/def/fb5 [0,4194304] 0 2024-01-17T23:45:33.529 INFO:tasks.workunit.client.0.smithi067.stdout:6/766: dread d6/d9/d1c/d1e/d43/d86/fe4 [0,4194304] 0 2024-01-17T23:45:33.529 INFO:tasks.workunit.client.0.smithi067.stdout:0/781: rmdir d3/d6/dd 39 2024-01-17T23:45:33.529 INFO:tasks.workunit.client.0.smithi067.stdout:0/782: creat d3/d4c/f11f x:0 0 0 2024-01-17T23:45:33.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/664: unlink d3/d6/d11/d50/d84/da8/da9/lc1 0 2024-01-17T23:45:33.735 INFO:tasks.workunit.client.0.smithi067.stdout:9/665: stat d3/da/dd5 0 2024-01-17T23:45:33.735 INFO:tasks.workunit.client.0.smithi067.stdout:9/666: truncate d3/d25/d5d/d79/fb7 651192 0 2024-01-17T23:45:33.735 INFO:tasks.workunit.client.0.smithi067.stdout:9/667: truncate d3/d6/d11/faa 5172490 0 2024-01-17T23:45:33.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/668: dwrite d3/d6/da4/d55/fa3 [0,4194304] 0 2024-01-17T23:45:34.021 INFO:tasks.workunit.client.0.smithi067.stdout:6/767: symlink d6/d18/d2e/d61/d9a/dd1/l105 0 2024-01-17T23:45:34.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/768: write d6/d9/d65/da4/fff [485167,105622] 0 2024-01-17T23:45:34.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/769: chown d6/d18/fe9 112230385 1 2024-01-17T23:45:34.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/770: chown d6/d9/d30/d58 28943 1 2024-01-17T23:45:34.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/771: readlink d6/d9/d30/d4c/d8d/le3 0 2024-01-17T23:45:34.323 INFO:tasks.workunit.client.0.smithi067.stdout:0/783: unlink d3/dbf/lfb 0 2024-01-17T23:45:34.962 INFO:tasks.workunit.client.0.smithi067.stdout:1/724: mknod d0/d7/d13/ce6 0 2024-01-17T23:45:34.981 INFO:tasks.workunit.client.0.smithi067.stdout:1/725: write d0/d7/f4c [1149791,10549] 0 2024-01-17T23:45:35.174 INFO:tasks.workunit.client.0.smithi067.stdout:0/784: mknod d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/c120 0 2024-01-17T23:45:35.366 INFO:tasks.workunit.client.0.smithi067.stdout:9/669: symlink d3/d6/d11/lf2 0 2024-01-17T23:45:35.366 INFO:tasks.workunit.client.0.smithi067.stdout:9/670: dread - d3/d6/d47/d88/dc2/fdc zero size 2024-01-17T23:45:35.384 INFO:tasks.workunit.client.0.smithi067.stdout:9/671: dread d3/d6/d2a/f3f [0,4194304] 0 2024-01-17T23:45:35.709 INFO:tasks.workunit.client.0.smithi067.stdout:1/726: link d0/d7/d13/d3a/d3e/c8b d0/d7/d13/d3d/d48/ce7 0 2024-01-17T23:45:35.709 INFO:tasks.workunit.client.0.smithi067.stdout:0/785: unlink d3/d5/d1a/f24 0 2024-01-17T23:45:35.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/727: dread d0/d7/d13/d3d/f8e [0,4194304] 0 2024-01-17T23:45:35.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/728: dread - d0/fca zero size 2024-01-17T23:45:35.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/729: readlink d0/d7/d13/d77/l90 0 2024-01-17T23:45:35.937 INFO:tasks.workunit.client.0.smithi067.stdout:0/786: symlink d3/d64/d7d/l121 0 2024-01-17T23:45:35.976 INFO:tasks.workunit.client.0.smithi067.stdout:1/730: getdents d0/d7/d93 0 2024-01-17T23:45:36.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/731: dwrite d0/d7/d13/d3a/f5d [0,4194304] 0 2024-01-17T23:45:36.485 INFO:tasks.workunit.client.0.smithi067.stdout:5/659: dwrite d10/d24/d46/d4a/d50/fab [0,4194304] 0 2024-01-17T23:45:36.904 INFO:tasks.workunit.client.0.smithi067.stdout:1/732: dread d0/fa5 [0,4194304] 0 2024-01-17T23:45:37.151 INFO:tasks.workunit.client.0.smithi067.stdout:5/660: mknod d10/d53/d9a/cd3 0 2024-01-17T23:45:37.847 INFO:tasks.workunit.client.0.smithi067.stdout:1/733: mkdir d0/d7/d13/d3a/d75/da1/de8 0 2024-01-17T23:45:37.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/716: write d5/d1f/f3c [3425331,129612] 0 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:7/737: sync 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/764: sync 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:8/774: sync 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:4/718: sync 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:6/772: sync 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:8/775: chown d6/d19/d22/c50 76688 1 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/765: dread - d0/d34/f63 zero size 2024-01-17T23:45:37.899 INFO:tasks.workunit.client.0.smithi067.stdout:4/719: dread - d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fda zero size 2024-01-17T23:45:37.900 INFO:tasks.workunit.client.0.smithi067.stdout:9/672: sync 2024-01-17T23:45:37.917 INFO:tasks.workunit.client.0.smithi067.stdout:6/773: dread d6/d9/d30/d4c/d8d/f99 [0,4194304] 0 2024-01-17T23:45:37.917 INFO:tasks.workunit.client.0.smithi067.stdout:6/774: write d6/d9/d1c/d1e/d43/f9f [907018,47950] 0 2024-01-17T23:45:38.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/661: mkdir d10/d24/d46/dd4 0 2024-01-17T23:45:38.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/662: fsync d10/d24/d46/d4a/f57 0 2024-01-17T23:45:38.134 INFO:tasks.workunit.client.0.smithi067.stdout:5/663: write d10/f91 [5010621,32304] 0 2024-01-17T23:45:38.401 INFO:tasks.workunit.client.0.smithi067.stdout:7/738: mknod d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/ce5 0 2024-01-17T23:45:38.507 INFO:tasks.workunit.client.0.smithi067.stdout:3/766: mkdir d0/d13/d1a/d38/dea 0 2024-01-17T23:45:38.678 INFO:tasks.workunit.client.0.smithi067.stdout:8/776: creat d6/d26/d7c/df8/dfb/f103 x:0 0 0 2024-01-17T23:45:38.922 INFO:tasks.workunit.client.0.smithi067.stdout:4/720: symlink d3/d26/d34/leb 0 2024-01-17T23:45:38.922 INFO:tasks.workunit.client.0.smithi067.stdout:9/673: symlink d3/d6/d47/d6d/lf3 0 2024-01-17T23:45:38.927 INFO:tasks.workunit.client.0.smithi067.stdout:4/721: read d3/d40/f70 [5665160,124093] 0 2024-01-17T23:45:38.927 INFO:tasks.workunit.client.0.smithi067.stdout:4/722: read - d3/d26/d34/d3a/d53/dc6/d20/d3b/fd2 zero size 2024-01-17T23:45:38.959 INFO:tasks.workunit.client.0.smithi067.stdout:4/723: dwrite d3/d26/d34/d3a/d53/dc6/d20/d3b/d7c/d92/fda [0,4194304] 0 2024-01-17T23:45:39.147 INFO:tasks.workunit.client.0.smithi067.stdout:6/775: link d6/d9/d30/d58/fa6 d6/d9/d1c/d1e/d43/d86/f106 0 2024-01-17T23:45:39.152 INFO:tasks.workunit.client.0.smithi067.stdout:6/776: dread d6/d9/d3e/f92 [0,4194304] 0 2024-01-17T23:45:39.633 INFO:tasks.workunit.client.0.smithi067.stdout:5/664: mkdir d10/d24/d25/dd5 0 2024-01-17T23:45:39.732 INFO:tasks.workunit.client.0.smithi067.stdout:7/739: mknod d4/d25/d39/d46/da8/db0/ce6 0 2024-01-17T23:45:39.732 INFO:tasks.workunit.client.0.smithi067.stdout:7/740: fdatasync d4/fbc 0 2024-01-17T23:45:40.117 INFO:tasks.workunit.client.0.smithi067.stdout:8/777: creat d6/d19/dcf/f104 x:0 0 0 2024-01-17T23:45:40.117 INFO:tasks.workunit.client.0.smithi067.stdout:8/778: creat d6/d19/d22/dec/f105 x:0 0 0 2024-01-17T23:45:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:1/734: write d0/d7/d13/d3d/d48/fd8 [860979,7857] 0 2024-01-17T23:45:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:4/724: stat d3/d4e/l78 0 2024-01-17T23:45:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:4/725: getdents d3/d26/d34/d3a/d53/dc6/de6 0 2024-01-17T23:45:41.129 INFO:tasks.workunit.client.0.smithi067.stdout:5/665: mknod d10/d24/d59/d5d/dce/cd6 0 2024-01-17T23:45:41.155 INFO:tasks.workunit.client.0.smithi067.stdout:5/666: dwrite d10/d24/d59/f67 [4194304,4194304] 0 2024-01-17T23:45:41.157 INFO:tasks.workunit.client.0.smithi067.stdout:5/667: write d10/d24/f5f [4264132,94825] 0 2024-01-17T23:45:41.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/779: truncate d6/d26/d56/dbb/dfd/f6e 6321608 0 2024-01-17T23:45:41.508 INFO:tasks.workunit.client.0.smithi067.stdout:9/674: getdents d3/d6/d11/d50 0 2024-01-17T23:45:41.508 INFO:tasks.workunit.client.0.smithi067.stdout:9/675: fsync d3/d6/d11/d50/fcd 0 2024-01-17T23:45:41.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/780: read d6/d19/d22/d25/d53/f7e [3001736,106023] 0 2024-01-17T23:45:41.553 INFO:tasks.workunit.client.0.smithi067.stdout:8/781: dwrite d6/d26/fd1 [0,4194304] 0 2024-01-17T23:45:41.619 INFO:tasks.workunit.client.0.smithi067.stdout:1/735: link d0/d7/d13/fe2 d0/d7/d13/d3a/d3e/fe9 0 2024-01-17T23:45:41.831 INFO:tasks.workunit.client.0.smithi067.stdout:4/726: unlink d3/d8/l8b 0 2024-01-17T23:45:42.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/668: creat d10/d24/d46/d4a/fd7 x:0 0 0 2024-01-17T23:45:42.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/669: write d10/d24/d46/db1/fb2 [597057,29306] 0 2024-01-17T23:45:42.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/676: getdents d3/da 0 2024-01-17T23:45:42.761 INFO:tasks.workunit.client.0.smithi067.stdout:8/782: mknod d6/d19/d22/ddd/c106 0 2024-01-17T23:45:42.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/736: rmdir d0/d7/d13/d3a/d3e/ddd 0 2024-01-17T23:45:42.934 INFO:tasks.workunit.client.0.smithi067.stdout:1/737: dread d0/d7/d13/d3a/f5d [0,4194304] 0 2024-01-17T23:45:43.044 INFO:tasks.workunit.client.0.smithi067.stdout:0/787: rename d3/d5/d32 to d3/d5/d122 0 2024-01-17T23:45:43.044 INFO:tasks.workunit.client.0.smithi067.stdout:0/788: creat d3/d5/d1a/d1c/d4e/d7c/f123 x:0 0 0 2024-01-17T23:45:43.218 INFO:tasks.workunit.client.0.smithi067.stdout:4/727: creat d3/d26/d34/d3a/d53/dc6/d20/d3b/ddf/fec x:0 0 0 2024-01-17T23:45:43.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/670: symlink d10/d24/d59/d8c/dba/ld8 0 2024-01-17T23:45:43.491 INFO:tasks.workunit.client.0.smithi067.stdout:8/783: mknod d6/d26/d7c/df8/c107 0 2024-01-17T23:45:43.619 INFO:tasks.workunit.client.0.smithi067.stdout:1/738: getdents d0/d7/d7f/d82 0 2024-01-17T23:45:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/789: creat d3/d5/d1a/d1c/d4e/f124 x:0 0 0 2024-01-17T23:45:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/790: stat d3/d64/d7d 0 2024-01-17T23:45:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:2/717: rename d5/d1f/l15 to d5/d1f/d98/d9f/lfd 0 2024-01-17T23:45:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:2/718: fdatasync d5/d1f/d2a/f7f 0 2024-01-17T23:45:43.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/791: creat d3/d64/f125 x:0 0 0 2024-01-17T23:45:43.936 INFO:tasks.workunit.client.0.smithi067.stdout:0/792: dwrite d3/d5/d1a/d1c/d1d/f103 [0,4194304] 0 2024-01-17T23:45:43.943 INFO:tasks.workunit.client.0.smithi067.stdout:2/719: dwrite d5/d1f/d2a/d54/d8/d32/ff8 [0,4194304] 0 2024-01-17T23:45:44.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/728: creat d3/d5/d93/d9e/fed x:0 0 0 2024-01-17T23:45:44.083 INFO:tasks.workunit.client.0.smithi067.stdout:5/671: dread d10/d24/d25/d5c/fcd [0,4194304] 0 2024-01-17T23:45:44.347 INFO:tasks.workunit.client.0.smithi067.stdout:8/784: rmdir d6/d26/d56/d89 39 2024-01-17T23:45:44.347 INFO:tasks.workunit.client.0.smithi067.stdout:1/739: mkdir d0/ddc/dea 0 2024-01-17T23:45:44.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:44.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:45:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/777: write d6/d9/d1c/d1e/f5e [8931977,117622] 0 2024-01-17T23:45:44.695 INFO:tasks.workunit.client.0.smithi067.stdout:6/778: dread d6/d9/d1c/d1e/d43/def/f4e [0,4194304] 0 2024-01-17T23:45:45.279 INFO:tasks.workunit.client.0.smithi067.stdout:2/720: mkdir d5/d1f/d98/dfe 0 2024-01-17T23:45:45.279 INFO:tasks.workunit.client.0.smithi067.stdout:2/721: stat d5/c67 0 2024-01-17T23:45:45.319 INFO:tasks.workunit.client.0.smithi067.stdout:2/722: dwrite d5/d1f/d16/f85 [0,4194304] 0 2024-01-17T23:45:45.332 INFO:tasks.workunit.client.0.smithi067.stdout:7/741: dwrite d4/f26 [0,4194304] 0 2024-01-17T23:45:45.332 INFO:tasks.workunit.client.0.smithi067.stdout:7/742: fdatasync d4/d25/d39/d46/d78/d93/d94/dc4/fe2 0 2024-01-17T23:45:45.353 INFO:tasks.workunit.client.0.smithi067.stdout:7/743: write d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f8e [2882996,124502] 0 2024-01-17T23:45:45.554 INFO:tasks.workunit.client.0.smithi067.stdout:5/672: creat d10/d24/d25/d5c/d7e/fd9 x:0 0 0 2024-01-17T23:45:45.620 INFO:tasks.workunit.client.0.smithi067.stdout:1/740: chown d0/f27 3315 1 2024-01-17T23:45:45.788 INFO:tasks.workunit.client.0.smithi067.stdout:8/785: truncate d6/d19/d22/d25/f59 1167578 0 2024-01-17T23:45:45.788 INFO:tasks.workunit.client.0.smithi067.stdout:8/786: creat d6/d26/d3e/d87/f108 x:0 0 0 2024-01-17T23:45:46.226 INFO:tasks.workunit.client.0.smithi067.stdout:6/779: creat d6/d9/d30/d4c/d8d/f107 x:0 0 0 2024-01-17T23:45:46.226 INFO:tasks.workunit.client.0.smithi067.stdout:6/780: chown d6/d9/d30 3658805 1 2024-01-17T23:45:46.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/793: truncate d3/d5/d1a/d1c/d1d/d2e/d5a/ff1 1758860 0 2024-01-17T23:45:46.596 INFO:tasks.workunit.client.0.smithi067.stdout:2/723: creat d5/d1f/d2a/d54/d8/d4c/de3/fff x:0 0 0 2024-01-17T23:45:46.596 INFO:tasks.workunit.client.0.smithi067.stdout:2/724: readlink d5/d1f/d2a/d54/d8/d4c/db3/lfa 0 2024-01-17T23:45:46.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/794: write d3/d5/d1a/d1c/d4e/f6f [553841,72936] 0 2024-01-17T23:45:46.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/795: getdents d3/d6/dd/d107 0 2024-01-17T23:45:46.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/796: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:45:46.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/797: dread d3/d64/d7d/de6/f100 [0,4194304] 0 2024-01-17T23:45:46.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/798: stat d3/d6/d80 0 2024-01-17T23:45:46.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/799: fsync d3/d5/d122/d9f/fad 0 2024-01-17T23:45:46.647 INFO:tasks.workunit.client.0.smithi067.stdout:0/800: dread d3/d6/f76 [0,4194304] 0 2024-01-17T23:45:47.111 INFO:tasks.workunit.client.0.smithi067.stdout:7/744: truncate d4/d25/d39/d79/fb8 1394769 0 2024-01-17T23:45:47.112 INFO:tasks.workunit.client.0.smithi067.stdout:5/673: truncate d10/d24/d25/f35 1595804 0 2024-01-17T23:45:47.112 INFO:tasks.workunit.client.0.smithi067.stdout:7/745: chown d4/d25/c57 157 1 2024-01-17T23:45:47.129 INFO:tasks.workunit.client.0.smithi067.stdout:7/746: dread d4/d25/d39/d46/d78/d93/d94/dc4/d41/f55 [0,4194304] 0 2024-01-17T23:45:47.144 INFO:tasks.workunit.client.0.smithi067.stdout:7/747: dread d4/f65 [0,4194304] 0 2024-01-17T23:45:47.164 INFO:tasks.workunit.client.0.smithi067.stdout:7/748: read d4/d25/d39/d8a/f97 [1036113,29188] 0 2024-01-17T23:45:47.375 INFO:tasks.workunit.client.0.smithi067.stdout:1/741: link d0/d7/d1c/f54 d0/d74/feb 0 2024-01-17T23:45:47.375 INFO:tasks.workunit.client.0.smithi067.stdout:1/742: stat d0/d7/d7f/l97 0 2024-01-17T23:45:48.192 INFO:tasks.workunit.client.0.smithi067.stdout:9/677: write d3/d6/d2a/d34/d42/d9c/fed [47352,22665] 0 2024-01-17T23:45:48.523 INFO:tasks.workunit.client.0.smithi067.stdout:3/767: sync 2024-01-17T23:45:48.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/674: mkdir d10/d24/d59/d8c/dae/dda 0 2024-01-17T23:45:48.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/675: write d10/d24/d25/d5c/d7e/fa7 [467581,22321] 0 2024-01-17T23:45:48.827 INFO:tasks.workunit.client.0.smithi067.stdout:5/676: dread d10/f19 [0,4194304] 0 2024-01-17T23:45:48.827 INFO:tasks.workunit.client.0.smithi067.stdout:5/677: write d10/d24/d59/d5d/d43/fc8 [487138,34155] 0 2024-01-17T23:45:49.415 INFO:tasks.workunit.client.0.smithi067.stdout:4/729: rename d3/d26/d34/d3a/d53/dc6 to d3/d4e/dee 0 2024-01-17T23:45:49.434 INFO:tasks.workunit.client.0.smithi067.stdout:4/730: read d3/f75 [3244074,2735] 0 2024-01-17T23:45:49.435 INFO:tasks.workunit.client.0.smithi067.stdout:4/731: chown d3/d26/d34/d3a/d9f/ld1 18 1 2024-01-17T23:45:49.435 INFO:tasks.workunit.client.0.smithi067.stdout:4/732: fsync d3/d26/d34/d3a/fa0 0 2024-01-17T23:45:49.435 INFO:tasks.workunit.client.0.smithi067.stdout:4/733: fsync d3/d8/d35/f6e 0 2024-01-17T23:45:49.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/678: mknod d3/d6/d47/db4/cf4 0 2024-01-17T23:45:49.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/679: chown d3/d6/d11/d50/l8a 133344860 1 2024-01-17T23:45:49.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/680: truncate d3/d58/fd3 514163 0 2024-01-17T23:45:49.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/681: write d3/d6/f56 [3922888,27948] 0 2024-01-17T23:45:49.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/682: chown d3/d6/da4/d55/fa3 1527 1 2024-01-17T23:45:49.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/725: getdents d5/d1f/d2a/d8d 0 2024-01-17T23:45:49.964 INFO:tasks.workunit.client.0.smithi067.stdout:3/768: mknod d0/d37/dbb/ceb 0 2024-01-17T23:45:50.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/801: getdents d3/d5/d1a/d1c/d4e 0 2024-01-17T23:45:50.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/802: readlink d3/d5/d1a/d1c/d1d/d2e/d5a/lc1 0 2024-01-17T23:45:50.133 INFO:tasks.workunit.client.0.smithi067.stdout:0/803: write d3/d5/d1a/d1c/d4d/f97 [1191154,95796] 0 2024-01-17T23:45:50.133 INFO:tasks.workunit.client.0.smithi067.stdout:0/804: read - d3/d5/d122/dc5/ff8 zero size 2024-01-17T23:45:50.243 INFO:tasks.workunit.client.0.smithi067.stdout:5/678: dread d10/d24/d46/d4a/f74 [0,4194304] 0 2024-01-17T23:45:51.131 INFO:tasks.workunit.client.0.smithi067.stdout:3/769: symlink d0/d34/d35/d65/lec 0 2024-01-17T23:45:51.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/770: dwrite d0/d12/d98/fb6 [0,4194304] 0 2024-01-17T23:45:51.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/805: unlink d3/d64/cfa 0 2024-01-17T23:45:51.727 INFO:tasks.workunit.client.0.smithi067.stdout:2/726: rmdir d5/d1f/d2a/d55 39 2024-01-17T23:45:51.727 INFO:tasks.workunit.client.0.smithi067.stdout:2/727: write d5/d1f/d16/d61/fa0 [367720,9342] 0 2024-01-17T23:45:51.735 INFO:tasks.workunit.client.0.smithi067.stdout:2/728: dread d5/d1f/f3c [0,4194304] 0 2024-01-17T23:45:51.735 INFO:tasks.workunit.client.0.smithi067.stdout:2/729: stat d5/d1f/d98/fc5 0 2024-01-17T23:45:51.735 INFO:tasks.workunit.client.0.smithi067.stdout:2/730: write d5/d1f/d2a/d73/d95/fb7 [1035830,58064] 0 2024-01-17T23:45:51.755 INFO:tasks.workunit.client.0.smithi067.stdout:2/731: write d5/d1f/d2a/d55/fba [2159375,40564] 0 2024-01-17T23:45:52.234 INFO:tasks.workunit.client.0.smithi067.stdout:2/732: mknod d5/d1f/d2a/d8d/c100 0 2024-01-17T23:45:52.398 INFO:tasks.workunit.client.0.smithi067.stdout:3/771: rmdir d0/d13/d1a/d38 39 2024-01-17T23:45:52.454 INFO:tasks.workunit.client.0.smithi067.stdout:2/733: mknod d5/d1f/d2a/de1/c101 0 2024-01-17T23:45:52.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/734: mknod d5/d1f/d2a/d54/d8/d4c/d84/da5/c102 0 2024-01-17T23:45:52.849 INFO:tasks.workunit.client.0.smithi067.stdout:2/735: symlink d5/d1f/d2a/d54/d7c/l103 0 2024-01-17T23:45:53.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/736: getdents d5/d1f/d2a/d54/d8/d4c/db3 0 2024-01-17T23:45:53.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/737: write d5/d1f/d2a/d54/d8/d32/d9c/f8e [264048,83130] 0 2024-01-17T23:45:53.915 INFO:tasks.workunit.client.0.smithi067.stdout:1/743: dwrite d0/d7/d13/f40 [0,4194304] 0 2024-01-17T23:45:53.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/683: write d3/d6/d11/d50/f94 [1725937,3155] 0 2024-01-17T23:45:54.189 INFO:tasks.workunit.client.0.smithi067.stdout:2/738: link d5/d1f/d2a/d54/d8/d4c/dbf/de2/cf9 d5/d1f/d35/c104 0 2024-01-17T23:45:54.208 INFO:tasks.workunit.client.0.smithi067.stdout:2/739: write d5/d1f/d2a/d54/d8/d32/f42 [853491,7975] 0 2024-01-17T23:45:54.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/744: link d0/d7/d13/d3a/f5d d0/d74/d31/fec 0 2024-01-17T23:45:54.627 INFO:tasks.workunit.client.0.smithi067.stdout:9/684: symlink d3/d6/d2a/da2/dbd/lf5 0 2024-01-17T23:45:55.004 INFO:tasks.workunit.client.0.smithi067.stdout:8/787: mknod d6/d26/c109 0 2024-01-17T23:45:55.004 INFO:tasks.workunit.client.0.smithi067.stdout:8/788: chown d6/d26/d7c/cdc 15 1 2024-01-17T23:45:55.012 INFO:tasks.workunit.client.0.smithi067.stdout:8/789: dread d6/d26/d7c/dd0/fa4 [0,4194304] 0 2024-01-17T23:45:55.082 INFO:tasks.workunit.client.0.smithi067.stdout:9/685: symlink d3/d6/d10/lf6 0 2024-01-17T23:45:55.102 INFO:tasks.workunit.client.0.smithi067.stdout:9/686: dread d3/d6/d47/d6d/f8c [0,4194304] 0 2024-01-17T23:45:55.102 INFO:tasks.workunit.client.0.smithi067.stdout:9/687: write d3/d6/d2a/f71 [3590295,118285] 0 2024-01-17T23:45:55.542 INFO:tasks.workunit.client.0.smithi067.stdout:9/688: link d3/d6/da4/f44 d3/d6/da4/d55/ff7 0 2024-01-17T23:45:55.542 INFO:tasks.workunit.client.0.smithi067.stdout:9/689: write d3/d6/da4/dba/fe6 [672238,62739] 0 2024-01-17T23:45:56.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/679: rename d10/d24/d46/d4a/f74 to d10/d24/fdb 0 2024-01-17T23:45:56.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/690: creat d3/d6/d2a/d34/ff8 x:0 0 0 2024-01-17T23:45:56.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/691: write d3/d6/d2a/da2/f83 [378571,58983] 0 2024-01-17T23:45:56.449 INFO:tasks.workunit.client.0.smithi067.stdout:3/772: rename d0/d12/l7e to d0/d34/d35/d65/led 0 2024-01-17T23:45:56.617 INFO:tasks.workunit.client.0.smithi067.stdout:5/680: link d10/d24/d46/d4a/d4b/l75 d10/d24/db4/ldc 0 2024-01-17T23:45:56.746 INFO:tasks.workunit.client.0.smithi067.stdout:9/692: mkdir d3/d6/d11/d50/d84/da8/da9/df9 0 2024-01-17T23:45:56.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/693: dwrite d3/d6/d2a/d34/d42/f8e [0,4194304] 0 2024-01-17T23:45:56.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/694: readlink d3/d6/da4/d55/l7c 0 2024-01-17T23:45:56.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/695: fsync d3/d6/d2a/fc6 0 2024-01-17T23:45:56.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/696: dread d3/d6/d2a/d34/d42/f4d [0,4194304] 0 2024-01-17T23:45:56.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/697: write d3/d6/d2a/f3f [1372258,103743] 0 2024-01-17T23:45:56.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/698: chown d3/d6/d2a/d34/f45 2641 1 2024-01-17T23:45:56.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/699: stat d3/d6/d11/dd4 0 2024-01-17T23:45:56.945 INFO:tasks.workunit.client.0.smithi067.stdout:2/740: rename d5/d1f/c65 to d5/d1f/d2a/d8d/c105 0 2024-01-17T23:45:56.981 INFO:tasks.workunit.client.0.smithi067.stdout:2/741: dwrite d5/d1f/d2a/d8d/fec [0,4194304] 0 2024-01-17T23:45:56.981 INFO:tasks.workunit.client.0.smithi067.stdout:2/742: fsync d5/d1f/d98/d9f/dbb/fdc 0 2024-01-17T23:45:56.981 INFO:tasks.workunit.client.0.smithi067.stdout:2/743: fsync d5/d1f/d2a/d54/d8/d32/f9b 0 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:6/781: sync 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:7/749: sync 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:0/806: sync 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:7/750: chown d4/d25/d39/d46/d78/d93/d94/dc4/f14 251 1 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:7/751: readlink d4/d16/ld9 0 2024-01-17T23:45:56.982 INFO:tasks.workunit.client.0.smithi067.stdout:4/734: sync 2024-01-17T23:45:56.983 INFO:tasks.workunit.client.0.smithi067.stdout:6/782: creat d6/d9/d30/d58/f108 x:0 0 0 2024-01-17T23:45:56.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/807: write d3/d5/d1a/d1c/d4e/d7c/f94 [204410,90212] 0 2024-01-17T23:45:57.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/744: read d5/d1f/d16/fe9 [2804638,120513] 0 2024-01-17T23:45:57.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/745: read - d5/d1f/d2a/d54/d8/db5/fbe zero size 2024-01-17T23:45:57.011 INFO:tasks.workunit.client.0.smithi067.stdout:0/808: dwrite d3/f11 [0,4194304] 0 2024-01-17T23:45:57.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/746: dread d5/d1f/d2a/d54/d8/d32/f9b [0,4194304] 0 2024-01-17T23:45:57.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/747: write d5/d1f/d2a/d54/d8/d32/f42 [4729363,127983] 0 2024-01-17T23:45:57.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/748: dread - d5/d1f/d2a/d54/d8/db5/fbe zero size 2024-01-17T23:45:57.094 INFO:tasks.workunit.client.0.smithi067.stdout:3/773: unlink d0/de1/d55/f62 0 2024-01-17T23:45:58.530 INFO:tasks.workunit.client.0.smithi067.stdout:9/700: chown d3/da/c92 13 1 2024-01-17T23:45:58.531 INFO:tasks.workunit.client.0.smithi067.stdout:9/701: write d3/d6/da4/d55/da1/fb3 [502029,116690] 0 2024-01-17T23:45:59.253 INFO:tasks.workunit.client.0.smithi067.stdout:7/752: mknod d4/d4b/d7f/ce7 0 2024-01-17T23:45:59.475 INFO:tasks.workunit.client.0.smithi067.stdout:4/735: symlink d3/d4e/dee/dc7/lef 0 2024-01-17T23:45:59.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/736: dread d3/d8/d35/fb1 [0,4194304] 0 2024-01-17T23:45:59.567 INFO:tasks.workunit.client.0.smithi067.stdout:2/749: dwrite d5/d1f/d16/d61/fa0 [0,4194304] 0 2024-01-17T23:45:59.810 INFO:tasks.workunit.client.0.smithi067.stdout:3/774: creat d0/de1/d75/dcb/fee x:0 0 0 2024-01-17T23:46:00.263 INFO:tasks.workunit.client.0.smithi067.stdout:1/745: rename d0/d7/d7f/d82/d35 to d0/d7/d13/d3a/d75/ded 0 2024-01-17T23:46:00.290 INFO:tasks.workunit.client.0.smithi067.stdout:1/746: dwrite d0/d7/d13/d3d/d48/fd6 [0,4194304] 0 2024-01-17T23:46:00.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/753: symlink d4/d25/d39/d79/dde/le8 0 2024-01-17T23:46:00.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/754: creat d4/d25/d39/d8a/fe9 x:0 0 0 2024-01-17T23:46:00.417 INFO:tasks.workunit.client.0.smithi067.stdout:7/755: dwrite d4/d25/d39/d46/da8/fbe [0,4194304] 0 2024-01-17T23:46:01.017 INFO:tasks.workunit.client.0.smithi067.stdout:8/790: rename d6/d26/d7c/cdc to d6/d26/d3e/d6c/c10a 0 2024-01-17T23:46:01.017 INFO:tasks.workunit.client.0.smithi067.stdout:5/681: rename d10/d53 to d10/d53/da4/ddd 22 2024-01-17T23:46:01.017 INFO:tasks.workunit.client.0.smithi067.stdout:8/791: stat d6/d19/dcf/ld7 0 2024-01-17T23:46:01.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/682: dread d10/f91 [4194304,4194304] 0 2024-01-17T23:46:01.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/683: creat d10/d24/db4/fde x:0 0 0 2024-01-17T23:46:01.027 INFO:tasks.workunit.client.0.smithi067.stdout:5/684: write d10/d24/d46/db1/fb2 [584976,28096] 0 2024-01-17T23:46:01.276 INFO:tasks.workunit.client.0.smithi067.stdout:1/747: mkdir d0/d7/d13/d77/dee 0 2024-01-17T23:46:01.695 INFO:tasks.workunit.client.0.smithi067.stdout:7/756: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/dea 0 2024-01-17T23:46:01.843 INFO:tasks.workunit.client.0.smithi067.stdout:2/750: mknod d5/d1f/d16/d7d/c106 0 2024-01-17T23:46:02.011 INFO:tasks.workunit.client.0.smithi067.stdout:0/809: rename d3/d5/f26 to d3/d5/d122/dc5/f126 0 2024-01-17T23:46:02.012 INFO:tasks.workunit.client.0.smithi067.stdout:0/810: write d3/d5/d122/d9f/fad [3973129,127352] 0 2024-01-17T23:46:02.012 INFO:tasks.workunit.client.0.smithi067.stdout:0/811: truncate d3/d5/d1a/f44 2037150 0 2024-01-17T23:46:02.046 INFO:tasks.workunit.client.0.smithi067.stdout:0/812: dwrite d3/d5/d122/f78 [0,4194304] 0 2024-01-17T23:46:02.065 INFO:tasks.workunit.client.0.smithi067.stdout:0/813: dwrite d3/d5/d1a/d1c/d4e/d7c/f123 [0,4194304] 0 2024-01-17T23:46:02.101 INFO:tasks.workunit.client.0.smithi067.stdout:6/783: write d6/d9/d1c/d1e/d43/d78/fb7 [1783935,84012] 0 2024-01-17T23:46:02.102 INFO:tasks.workunit.client.0.smithi067.stdout:6/784: write d6/d9/d65/da4/fe8 [69193,59268] 0 2024-01-17T23:46:02.103 INFO:tasks.workunit.client.0.smithi067.stdout:8/792: dread d6/d19/d22/d25/d53/d65/f60 [0,4194304] 0 2024-01-17T23:46:02.357 INFO:tasks.workunit.client.0.smithi067.stdout:5/685: getdents d10/d24 0 2024-01-17T23:46:02.361 INFO:tasks.workunit.client.0.smithi067.stdout:5/686: write d10/d24/db4/fbf [367411,100243] 0 2024-01-17T23:46:02.361 INFO:tasks.workunit.client.0.smithi067.stdout:5/687: chown d10/d24/d46/d4a/d63/c8f 62854 1 2024-01-17T23:46:02.709 INFO:tasks.workunit.client.0.smithi067.stdout:1/748: truncate d0/d7/d13/d2e/f6d 2579583 0 2024-01-17T23:46:02.710 INFO:tasks.workunit.client.0.smithi067.stdout:7/757: mkdir d4/d25/d39/d8a/d92/deb 0 2024-01-17T23:46:02.710 INFO:tasks.workunit.client.0.smithi067.stdout:2/751: mknod d5/d1f/d2a/d54/d7c/c107 0 2024-01-17T23:46:02.737 INFO:tasks.workunit.client.0.smithi067.stdout:2/752: dwrite d5/d1f/d2a/d54/d8/db5/fbe [0,4194304] 0 2024-01-17T23:46:02.954 INFO:tasks.workunit.client.0.smithi067.stdout:9/702: rename d3/d6/d11/lf2 to d3/d6/da4/d55/da1/lfa 0 2024-01-17T23:46:03.308 INFO:tasks.workunit.client.0.smithi067.stdout:4/737: rmdir d3/d26/d34/d65 39 2024-01-17T23:46:03.842 INFO:tasks.workunit.client.0.smithi067.stdout:0/814: creat d3/d5/d1a/f127 x:0 0 0 2024-01-17T23:46:03.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/815: chown d3/d5/d1a/d1c/d4e/d7c/l86 107622557 1 2024-01-17T23:46:03.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/816: chown d3/d5/d1a/d1c/d1d/d2e/l67 61 1 2024-01-17T23:46:03.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/817: write d3/d5/d1a/d1c/d4e/f124 [303249,57562] 0 2024-01-17T23:46:03.843 INFO:tasks.workunit.client.0.smithi067.stdout:0/818: fdatasync d3/d64/d7d/fff 0 2024-01-17T23:46:03.964 INFO:tasks.workunit.client.0.smithi067.stdout:6/785: creat d6/d81/dc7/f109 x:0 0 0 2024-01-17T23:46:04.118 INFO:tasks.workunit.client.0.smithi067.stdout:8/793: mkdir d6/d19/d22/dec/d10b 0 2024-01-17T23:46:04.118 INFO:tasks.workunit.client.0.smithi067.stdout:8/794: write d6/d26/d56/dbb/dfd/fbe [4829248,39582] 0 2024-01-17T23:46:04.118 INFO:tasks.workunit.client.0.smithi067.stdout:8/795: dread - d6/d26/d3e/f100 zero size 2024-01-17T23:46:04.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/796: dread d6/d26/f36 [0,4194304] 0 2024-01-17T23:46:04.147 INFO:tasks.workunit.client.0.smithi067.stdout:3/775: dwrite d0/d17/f29 [0,4194304] 0 2024-01-17T23:46:05.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/753: creat d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/f108 x:0 0 0 2024-01-17T23:46:05.975 INFO:tasks.workunit.client.0.smithi067.stdout:4/738: mknod d3/d8/d35/d36/cf0 0 2024-01-17T23:46:05.976 INFO:tasks.workunit.client.0.smithi067.stdout:9/703: creat d3/d6/da4/d55/ffb x:0 0 0 2024-01-17T23:46:05.976 INFO:tasks.workunit.client.0.smithi067.stdout:9/704: chown d3/d6/d11/d50/f77 241 1 2024-01-17T23:46:06.310 INFO:tasks.workunit.client.0.smithi067.stdout:0/819: mknod d3/d6/d80/c128 0 2024-01-17T23:46:06.834 INFO:tasks.workunit.client.0.smithi067.stdout:8/797: mknod d6/d26/d3e/da6/c10c 0 2024-01-17T23:46:06.834 INFO:tasks.workunit.client.0.smithi067.stdout:8/798: write d6/d19/d22/ff7 [396874,128212] 0 2024-01-17T23:46:07.034 INFO:tasks.workunit.client.0.smithi067.stdout:3/776: symlink d0/d34/de3/lef 0 2024-01-17T23:46:07.034 INFO:tasks.workunit.client.0.smithi067.stdout:3/777: dread - d0/d17/dc8/dae/fe0 zero size 2024-01-17T23:46:07.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/778: write d0/d17/f4c [213609,94446] 0 2024-01-17T23:46:07.418 INFO:tasks.workunit.client.0.smithi067.stdout:2/754: unlink d5/d1f/d2a/d54/d39/d68/cc4 0 2024-01-17T23:46:07.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/739: symlink d3/d8/d35/lf1 0 2024-01-17T23:46:07.805 INFO:tasks.workunit.client.0.smithi067.stdout:0/820: rename d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/l101 to d3/d64/d82/de8/l129 0 2024-01-17T23:46:07.883 INFO:tasks.workunit.client.0.smithi067.stdout:6/786: mknod d6/d9/ddf/c10a 0 2024-01-17T23:46:07.907 INFO:tasks.workunit.client.0.smithi067.stdout:6/787: dwrite d6/d9/d1c/d1e/ff6 [4194304,4194304] 0 2024-01-17T23:46:08.063 INFO:tasks.workunit.client.0.smithi067.stdout:8/799: mkdir d6/d26/d3e/d10d 0 2024-01-17T23:46:08.063 INFO:tasks.workunit.client.0.smithi067.stdout:3/779: symlink d0/d17/d69/lf0 0 2024-01-17T23:46:08.124 INFO:tasks.workunit.client.0.smithi067.stdout:2/755: getdents d5/d1f/d2a/d54/d8/d4c/d84 0 2024-01-17T23:46:08.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/821: rename d3/c104 to d3/dbf/c12a 0 2024-01-17T23:46:08.613 INFO:tasks.workunit.client.0.smithi067.stdout:0/822: dwrite d3/d5/f36 [0,4194304] 0 2024-01-17T23:46:08.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/800: truncate d6/db/f27 393118 0 2024-01-17T23:46:08.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/801: readlink d6/d26/d56/l82 0 2024-01-17T23:46:09.151 INFO:tasks.workunit.client.0.smithi067.stdout:3/780: link d0/d13/f2c d0/d34/d35/d57/ff1 0 2024-01-17T23:46:09.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/756: mkdir d5/d1f/d2a/d54/dee/d109 0 2024-01-17T23:46:09.227 INFO:tasks.workunit.client.0.smithi067.stdout:5/688: sync 2024-01-17T23:46:09.419 INFO:tasks.workunit.client.0.smithi067.stdout:1/749: write d0/f6f [4647159,59640] 0 2024-01-17T23:46:09.671 INFO:tasks.workunit.client.0.smithi067.stdout:8/802: mknod d6/d26/d56/dbb/dee/c10e 0 2024-01-17T23:46:09.692 INFO:tasks.workunit.client.0.smithi067.stdout:8/803: write d6/d26/d3e/d87/f94 [2530931,97878] 0 2024-01-17T23:46:09.693 INFO:tasks.workunit.client.0.smithi067.stdout:8/804: fsync d6/db/f41 0 2024-01-17T23:46:09.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/757: mknod d5/d86/c10a 0 2024-01-17T23:46:09.838 INFO:tasks.workunit.client.0.smithi067.stdout:3/781: creat d0/d12/d98/ff2 x:0 0 0 2024-01-17T23:46:09.968 INFO:tasks.workunit.client.0.smithi067.stdout:5/689: unlink d10/f1f 0 2024-01-17T23:46:10.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/758: sync 2024-01-17T23:46:10.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/823: unlink d3/d5/d1a/d1c/f3e 0 2024-01-17T23:46:10.227 INFO:tasks.workunit.client.0.smithi067.stdout:1/750: symlink d0/d7/d13/d3d/lef 0 2024-01-17T23:46:10.227 INFO:tasks.workunit.client.0.smithi067.stdout:1/751: creat d0/d7/d13/d3d/dd0/ff0 x:0 0 0 2024-01-17T23:46:10.227 INFO:tasks.workunit.client.0.smithi067.stdout:1/752: write d0/d74/feb [4320005,7486] 0 2024-01-17T23:46:10.685 INFO:tasks.workunit.client.0.smithi067.stdout:8/805: creat d6/d19/d22/ddd/f10f x:0 0 0 2024-01-17T23:46:11.040 INFO:tasks.workunit.client.0.smithi067.stdout:3/782: rename d0/d17/fc7 to d0/d34/ff3 0 2024-01-17T23:46:11.040 INFO:tasks.workunit.client.0.smithi067.stdout:3/783: creat d0/d17/dc8/dae/ff4 x:0 0 0 2024-01-17T23:46:11.418 INFO:tasks.workunit.client.0.smithi067.stdout:7/759: getdents d4/d16 0 2024-01-17T23:46:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:0/824: creat d3/d6/dd/d107/f12b x:0 0 0 2024-01-17T23:46:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:0/825: truncate d3/d6/fcf 1010698 0 2024-01-17T23:46:11.858 INFO:tasks.workunit.client.0.smithi067.stdout:1/753: stat d0/c14 0 2024-01-17T23:46:11.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/806: dread d6/d19/d22/fa8 [0,4194304] 0 2024-01-17T23:46:12.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/784: mknod d0/de1/d75/dcb/cf5 0 2024-01-17T23:46:12.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/785: write d0/d17/dc8/dae/fe0 [152931,49317] 0 2024-01-17T23:46:12.308 INFO:tasks.workunit.client.0.smithi067.stdout:7/760: mknod d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/cec 0 2024-01-17T23:46:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:9/705: sync 2024-01-17T23:46:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:9/706: creat d3/d6/d11/d5c/ffc x:0 0 0 2024-01-17T23:46:12.352 INFO:tasks.workunit.client.0.smithi067.stdout:7/761: dwrite d4/d25/d39/d46/f99 [0,4194304] 0 2024-01-17T23:46:12.363 INFO:tasks.workunit.client.0.smithi067.stdout:7/762: dread d4/d4b/d63/fd1 [4194304,4194304] 0 2024-01-17T23:46:12.397 INFO:tasks.workunit.client.0.smithi067.stdout:7/763: dwrite d4/d4b/fce [0,4194304] 0 2024-01-17T23:46:12.429 INFO:tasks.workunit.client.0.smithi067.stdout:7/764: dwrite d4/f5d [0,4194304] 0 2024-01-17T23:46:12.553 INFO:tasks.workunit.client.0.smithi067.stdout:1/754: creat d0/ff1 x:0 0 0 2024-01-17T23:46:12.819 INFO:tasks.workunit.client.0.smithi067.stdout:4/740: sync 2024-01-17T23:46:12.819 INFO:tasks.workunit.client.0.smithi067.stdout:8/807: creat d6/d26/d7c/df8/f110 x:0 0 0 2024-01-17T23:46:12.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/808: dwrite d6/d26/d56/dbb/fbc [0,4194304] 0 2024-01-17T23:46:12.869 INFO:tasks.workunit.client.0.smithi067.stdout:6/788: dwrite d6/d9/d30/d4c/d82/f95 [0,4194304] 0 2024-01-17T23:46:13.168 INFO:tasks.workunit.client.0.smithi067.stdout:3/786: mkdir d0/d17/dc8/dae/df6 0 2024-01-17T23:46:13.168 INFO:tasks.workunit.client.0.smithi067.stdout:3/787: truncate d0/d17/dc8/dae/ff4 104443 0 2024-01-17T23:46:13.187 INFO:tasks.workunit.client.0.smithi067.stdout:9/707: symlink d3/d6/da4/dba/lfd 0 2024-01-17T23:46:13.632 INFO:tasks.workunit.client.0.smithi067.stdout:7/765: mknod d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/ced 0 2024-01-17T23:46:13.661 INFO:tasks.workunit.client.0.smithi067.stdout:7/766: dwrite d4/d25/d39/d46/f99 [0,4194304] 0 2024-01-17T23:46:13.661 INFO:tasks.workunit.client.0.smithi067.stdout:7/767: chown d4/d25/d39/f70 1567 1 2024-01-17T23:46:13.704 INFO:tasks.workunit.client.0.smithi067.stdout:1/755: chown d0/c5c 934 1 2024-01-17T23:46:13.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/741: truncate d3/d4e/f85 3655931 0 2024-01-17T23:46:13.792 INFO:tasks.workunit.client.0.smithi067.stdout:4/742: dwrite d3/d4e/dee/d20/d3b/d7c/f8f [0,4194304] 0 2024-01-17T23:46:13.792 INFO:tasks.workunit.client.0.smithi067.stdout:4/743: stat d3/d26/d34/d65 0 2024-01-17T23:46:13.793 INFO:tasks.workunit.client.0.smithi067.stdout:4/744: readlink d3/d26/l30 0 2024-01-17T23:46:13.916 INFO:tasks.workunit.client.0.smithi067.stdout:8/809: mknod d6/d26/d7c/c111 0 2024-01-17T23:46:14.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/788: rename d0/d12/d98/cca to d0/de1/d55/cf7 0 2024-01-17T23:46:14.590 INFO:tasks.workunit.client.0.smithi067.stdout:9/708: mkdir d3/d6/d10/dfe 0 2024-01-17T23:46:14.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/758: rmdir d5/d1f/d16/d7d 39 2024-01-17T23:46:14.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/759: dread - d5/d1f/d2a/d54/d8/d4c/de3/fff zero size 2024-01-17T23:46:14.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:14.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:14.985 INFO:tasks.workunit.client.0.smithi067.stdout:7/768: rmdir d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b 39 2024-01-17T23:46:14.985 INFO:tasks.workunit.client.0.smithi067.stdout:7/769: chown d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9 704 1 2024-01-17T23:46:15.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/770: dwrite d4/d25/d39/d46/d78/d93/fd3 [0,4194304] 0 2024-01-17T23:46:15.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/771: truncate d4/d25/d39/d8a/d92/faa 252581 0 2024-01-17T23:46:15.357 INFO:tasks.workunit.client.0.smithi067.stdout:4/745: link d3/d5/d93/d9e/f9c d3/d5/d93/ff2 0 2024-01-17T23:46:15.360 INFO:tasks.workunit.client.0.smithi067.stdout:4/746: dread d3/d5/d93/d9e/f9c [0,4194304] 0 2024-01-17T23:46:15.861 INFO:tasks.workunit.client.0.smithi067.stdout:1/756: rename d0/d7/d93/caf to d0/d7/d13/d3d/d48/da4/cf2 0 2024-01-17T23:46:15.877 INFO:tasks.workunit.client.0.smithi067.stdout:1/757: dread d0/d7/d13/f40 [0,4194304] 0 2024-01-17T23:46:15.877 INFO:tasks.workunit.client.0.smithi067.stdout:1/758: fdatasync d0/d7/d13/d3a/d75/ded/fcf 0 2024-01-17T23:46:15.935 INFO:tasks.workunit.client.0.smithi067.stdout:5/690: sync 2024-01-17T23:46:16.099 INFO:tasks.workunit.client.0.smithi067.stdout:9/709: creat d3/d6/d2a/da2/dbd/fff x:0 0 0 2024-01-17T23:46:16.191 INFO:tasks.workunit.client.0.smithi067.stdout:2/760: truncate d5/d1f/d35/f3b 744530 0 2024-01-17T23:46:16.191 INFO:tasks.workunit.client.0.smithi067.stdout:2/761: readlink d5/d1f/d16/l7b 0 2024-01-17T23:46:16.303 INFO:tasks.workunit.client.0.smithi067.stdout:7/772: mknod d4/d25/d39/d8a/d92/deb/cee 0 2024-01-17T23:46:16.345 INFO:tasks.workunit.client.0.smithi067.stdout:7/773: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fbd [0,4194304] 0 2024-01-17T23:46:16.625 INFO:tasks.workunit.client.0.smithi067.stdout:4/747: rmdir d3/d26/d34/d3a/d53 39 2024-01-17T23:46:16.891 INFO:tasks.workunit.client.0.smithi067.stdout:1/759: symlink d0/d7/d13/d77/dee/lf3 0 2024-01-17T23:46:16.897 INFO:tasks.workunit.client.0.smithi067.stdout:1/760: dread d0/d7/d13/d3d/d48/fad [0,4194304] 0 2024-01-17T23:46:17.071 INFO:tasks.workunit.client.0.smithi067.stdout:5/691: mknod d10/d24/d46/d4a/d4b/da9/cdf 0 2024-01-17T23:46:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/826: sync 2024-01-17T23:46:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:9/710: link d3/d6/d11/d50/c51 d3/d6/d11/d5c/c100 0 2024-01-17T23:46:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:9/711: write d3/d6/d2a/da2/f91 [1417644,92404] 0 2024-01-17T23:46:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:9/712: chown d3/d25/d5d/d79 196 1 2024-01-17T23:46:17.099 INFO:tasks.workunit.client.0.smithi067.stdout:9/713: dwrite d3/d6/d2a/da2/de2/dd0/da6/fd2 [0,4194304] 0 2024-01-17T23:46:17.330 INFO:tasks.workunit.client.0.smithi067.stdout:2/762: mkdir d5/d1f/d98/ded/d10b 0 2024-01-17T23:46:17.677 INFO:tasks.workunit.client.0.smithi067.stdout:6/789: symlink d6/d9/l10b 0 2024-01-17T23:46:17.682 INFO:tasks.workunit.client.0.smithi067.stdout:6/790: dread d6/d9/d30/f70 [0,4194304] 0 2024-01-17T23:46:17.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/791: dread d6/d9/d30/d4c/f54 [4194304,4194304] 0 2024-01-17T23:46:17.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/792: chown d6/d9/d3e/l102 2 1 2024-01-17T23:46:17.724 INFO:tasks.workunit.client.0.smithi067.stdout:7/774: truncate d4/f65 3884372 0 2024-01-17T23:46:17.724 INFO:tasks.workunit.client.0.smithi067.stdout:7/775: chown d4/d25/d39/d8a/d92/deb/cee 9343279 1 2024-01-17T23:46:17.743 INFO:tasks.workunit.client.0.smithi067.stdout:6/793: dwrite d6/d18/f33 [4194304,4194304] 0 2024-01-17T23:46:17.745 INFO:tasks.workunit.client.0.smithi067.stdout:7/776: write d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fbd [3115911,125356] 0 2024-01-17T23:46:17.745 INFO:tasks.workunit.client.0.smithi067.stdout:7/777: chown d4/d25/d39/d46/da8/db0 6185 1 2024-01-17T23:46:17.791 INFO:tasks.workunit.client.0.smithi067.stdout:8/810: symlink d6/d26/d56/d89/l112 0 2024-01-17T23:46:17.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/748: read - d3/d40/f73 zero size 2024-01-17T23:46:17.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/749: readlink d3/d4e/dee/d38/l5f 0 2024-01-17T23:46:17.871 INFO:tasks.workunit.client.0.smithi067.stdout:4/750: dread - d3/d26/d34/d65/f86 zero size 2024-01-17T23:46:17.967 INFO:tasks.workunit.client.0.smithi067.stdout:1/761: symlink d0/d74/lf4 0 2024-01-17T23:46:19.174 INFO:tasks.workunit.client.0.smithi067.stdout:7/778: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/def 0 2024-01-17T23:46:19.175 INFO:tasks.workunit.client.0.smithi067.stdout:7/779: write d4/d4b/d7f/d82/f89 [996891,86855] 0 2024-01-17T23:46:19.337 INFO:tasks.workunit.client.0.smithi067.stdout:8/811: mkdir d6/d19/dcf/d113 0 2024-01-17T23:46:19.337 INFO:tasks.workunit.client.0.smithi067.stdout:8/812: stat d6/d26/d3e/ca9 0 2024-01-17T23:46:19.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/751: truncate d3/d5/fc 561336 0 2024-01-17T23:46:19.541 INFO:tasks.workunit.client.0.smithi067.stdout:4/752: stat d3/d26/d34/d3a/d9f/fea 0 2024-01-17T23:46:19.868 INFO:tasks.workunit.client.0.smithi067.stdout:5/692: getdents d10/d24/db4 0 2024-01-17T23:46:19.875 INFO:tasks.workunit.client.0.smithi067.stdout:5/693: dread d10/d24/d46/d4a/d63/f8b [0,4194304] 0 2024-01-17T23:46:20.072 INFO:tasks.workunit.client.0.smithi067.stdout:9/714: rmdir d3/d6/da4/dba 39 2024-01-17T23:46:20.339 INFO:tasks.workunit.client.0.smithi067.stdout:2/763: mknod d5/d1f/d16/d7d/c10c 0 2024-01-17T23:46:20.354 INFO:tasks.workunit.client.0.smithi067.stdout:2/764: dread d5/d1f/d2a/d54/d8/d4c/d84/f8c [0,4194304] 0 2024-01-17T23:46:20.496 INFO:tasks.workunit.client.0.smithi067.stdout:7/780: getdents d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb 0 2024-01-17T23:46:20.578 INFO:tasks.workunit.client.0.smithi067.stdout:8/813: symlink d6/d26/d56/dbb/l114 0 2024-01-17T23:46:20.995 INFO:tasks.workunit.client.0.smithi067.stdout:4/753: getdents d3/d26/d34/d3a/d53 0 2024-01-17T23:46:21.302 INFO:tasks.workunit.client.0.smithi067.stdout:1/762: rmdir d0/d7/d13/d3a/d75/da1 39 2024-01-17T23:46:21.302 INFO:tasks.workunit.client.0.smithi067.stdout:1/763: dread - d0/d7/d13/d3d/d48/fbc zero size 2024-01-17T23:46:21.318 INFO:tasks.workunit.client.0.smithi067.stdout:3/789: write d0/d34/d35/d65/d6f/fa2 [336423,115338] 0 2024-01-17T23:46:21.501 INFO:tasks.workunit.client.0.smithi067.stdout:5/694: symlink d10/d24/d46/d4a/d4b/da9/le0 0 2024-01-17T23:46:21.501 INFO:tasks.workunit.client.0.smithi067.stdout:5/695: truncate d10/d24/d46/fb9 986219 0 2024-01-17T23:46:21.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/715: creat d3/df0/f101 x:0 0 0 2024-01-17T23:46:21.682 INFO:tasks.workunit.client.0.smithi067.stdout:2/765: mknod d5/d1f/d16/c10d 0 2024-01-17T23:46:21.726 INFO:tasks.workunit.client.0.smithi067.stdout:7/781: rmdir d4/d25/d39/d46/d78/d93/d94/dc4/d41 39 2024-01-17T23:46:21.754 INFO:tasks.workunit.client.0.smithi067.stdout:7/782: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/fc2 [0,4194304] 0 2024-01-17T23:46:21.754 INFO:tasks.workunit.client.0.smithi067.stdout:7/783: truncate d4/d4b/d7f/f87 578525 0 2024-01-17T23:46:21.939 INFO:tasks.workunit.client.0.smithi067.stdout:8/814: symlink d6/d26/d56/dbb/dfd/l115 0 2024-01-17T23:46:21.939 INFO:tasks.workunit.client.0.smithi067.stdout:8/815: creat d6/d93/f116 x:0 0 0 2024-01-17T23:46:21.939 INFO:tasks.workunit.client.0.smithi067.stdout:8/816: readlink d6/d26/d56/dbb/lc1 0 2024-01-17T23:46:21.946 INFO:tasks.workunit.client.0.smithi067.stdout:1/764: getdents d0/d7/d13/d3d/d48/d4d 0 2024-01-17T23:46:21.947 INFO:tasks.workunit.client.0.smithi067.stdout:5/696: rename d10/d24/d25/d5c/d7e/cc2 to d10/d24/d46/db1/ce1 0 2024-01-17T23:46:21.988 INFO:tasks.workunit.client.0.smithi067.stdout:3/790: dread d0/d34/d35/d57/ff1 [0,4194304] 0 2024-01-17T23:46:21.988 INFO:tasks.workunit.client.0.smithi067.stdout:1/765: dwrite d0/d7/d13/d3a/d75/da1/fd2 [0,4194304] 0 2024-01-17T23:46:22.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/766: getdents d5/d1f/d2a/d54/dee 0 2024-01-17T23:46:22.740 INFO:tasks.workunit.client.0.smithi067.stdout:8/817: unlink d6/d19/d22/d25/d53/d54/la0 0 2024-01-17T23:46:23.031 INFO:tasks.workunit.client.0.smithi067.stdout:7/784: rename d4/d4b/d63/d95/dad/fd5 to d4/d25/d39/d46/da8/ff0 0 2024-01-17T23:46:23.031 INFO:tasks.workunit.client.0.smithi067.stdout:7/785: fsync d4/d25/d39/d46/d78/d93/d94/dc4/f8d 0 2024-01-17T23:46:23.063 INFO:tasks.workunit.client.0.smithi067.stdout:7/786: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d41/f55 [0,4194304] 0 2024-01-17T23:46:23.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/791: unlink d0/de1/d55/l61 0 2024-01-17T23:46:23.450 INFO:tasks.workunit.client.0.smithi067.stdout:1/766: symlink d0/d7/d13/d77/lf5 0 2024-01-17T23:46:23.460 INFO:tasks.workunit.client.0.smithi067.stdout:3/792: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:46:23.631 INFO:tasks.workunit.client.0.smithi067.stdout:9/716: mkdir d3/d6/d2e/d102 0 2024-01-17T23:46:23.631 INFO:tasks.workunit.client.0.smithi067.stdout:9/717: truncate d3/d6/d2a/f71 5664020 0 2024-01-17T23:46:23.631 INFO:tasks.workunit.client.0.smithi067.stdout:9/718: stat d3/d6/d11/d50/f94 0 2024-01-17T23:46:23.732 INFO:tasks.workunit.client.0.smithi067.stdout:2/767: symlink d5/d1f/d98/d9f/l10e 0 2024-01-17T23:46:23.895 INFO:tasks.workunit.client.0.smithi067.stdout:8/818: creat d6/d19/d22/d25/d53/d48/f117 x:0 0 0 2024-01-17T23:46:23.895 INFO:tasks.workunit.client.0.smithi067.stdout:8/819: fsync d6/d26/d7c/f8b 0 2024-01-17T23:46:24.429 INFO:tasks.workunit.client.0.smithi067.stdout:6/794: write d6/d9/f27 [5372084,78356] 0 2024-01-17T23:46:24.492 INFO:tasks.workunit.client.0.smithi067.stdout:7/787: mknod d4/d4b/d63/d95/dad/dcc/cf1 0 2024-01-17T23:46:24.604 INFO:tasks.workunit.client.0.smithi067.stdout:1/767: symlink d0/d7/d13/d77/d95/lf6 0 2024-01-17T23:46:24.642 INFO:tasks.workunit.client.0.smithi067.stdout:1/768: dwrite d0/d7/d13/d3a/d45/fbd [0,4194304] 0 2024-01-17T23:46:24.682 INFO:tasks.workunit.client.0.smithi067.stdout:1/769: dwrite d0/d74/f84 [0,4194304] 0 2024-01-17T23:46:24.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/793: truncate d0/d34/d35/d57/ff1 2069640 0 2024-01-17T23:46:24.897 INFO:tasks.workunit.client.0.smithi067.stdout:9/719: mkdir d3/d6/d11/d50/d84/da8/d6a/d103 0 2024-01-17T23:46:24.897 INFO:tasks.workunit.client.0.smithi067.stdout:9/720: chown d3/d6/d11/d5c 17841 1 2024-01-17T23:46:25.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/768: mknod d5/d1f/d2a/d54/d8/d4c/dbf/df4/df7/c10f 0 2024-01-17T23:46:25.145 INFO:tasks.workunit.client.0.smithi067.stdout:2/769: write d5/d1f/d16/fc7 [179905,77497] 0 2024-01-17T23:46:25.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/820: symlink d6/d26/d56/dbb/dfd/l118 0 2024-01-17T23:46:26.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/827: write d3/d5/d1a/fa4 [254638,116494] 0 2024-01-17T23:46:27.228 INFO:tasks.workunit.client.0.smithi067.stdout:1/770: link d0/d7/d13/d3a/d75/ded/fb0 d0/d7/d13/d77/d95/ff7 0 2024-01-17T23:46:27.335 INFO:tasks.workunit.client.0.smithi067.stdout:9/721: unlink d3/d6/d11/d50/d84/da8/da9/cb2 0 2024-01-17T23:46:27.562 INFO:tasks.workunit.client.0.smithi067.stdout:2/770: creat d5/d1f/d2a/d73/f110 x:0 0 0 2024-01-17T23:46:27.611 INFO:tasks.workunit.client.0.smithi067.stdout:5/697: dwrite d10/d24/d25/d5c/d7e/f87 [4194304,4194304] 0 2024-01-17T23:46:27.611 INFO:tasks.workunit.client.0.smithi067.stdout:5/698: chown d10/d24/d59/d5d/f95 118530 1 2024-01-17T23:46:27.986 INFO:tasks.workunit.client.0.smithi067.stdout:0/828: mkdir d3/d5/d12c 0 2024-01-17T23:46:27.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/771: rmdir d0/d7/d13/d3a/d3e/db2 0 2024-01-17T23:46:28.048 INFO:tasks.workunit.client.0.smithi067.stdout:9/722: mknod d3/da/dd5/c104 0 2024-01-17T23:46:28.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/699: getdents d10/d24/d25 0 2024-01-17T23:46:28.486 INFO:tasks.workunit.client.0.smithi067.stdout:5/700: dread d10/d24/d46/f7c [0,4194304] 0 2024-01-17T23:46:28.535 INFO:tasks.workunit.client.0.smithi067.stdout:5/701: dwrite d10/d24/d59/d8c/dae/fb0 [0,4194304] 0 2024-01-17T23:46:28.588 INFO:tasks.workunit.client.0.smithi067.stdout:0/829: write d3/d5/d1a/d1c/d4e/d7c/f9e [136981,127916] 0 2024-01-17T23:46:28.706 INFO:tasks.workunit.client.0.smithi067.stdout:1/772: symlink d0/d7/d13/d3d/d48/da4/lf8 0 2024-01-17T23:46:28.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/723: mkdir d3/d25/d5d/d79/d105 0 2024-01-17T23:46:28.780 INFO:tasks.workunit.client.0.smithi067.stdout:9/724: write d3/d6/da4/d55/f7b [970415,10653] 0 2024-01-17T23:46:28.781 INFO:tasks.workunit.client.0.smithi067.stdout:9/725: fdatasync d3/d6/d11/d5c/f6f 0 2024-01-17T23:46:28.781 INFO:tasks.workunit.client.0.smithi067.stdout:9/726: write d3/d6/d11/f23 [13161340,33072] 0 2024-01-17T23:46:29.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/702: symlink d10/d24/d59/d8c/dae/dda/le2 0 2024-01-17T23:46:29.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/773: dread - d0/fb7 zero size 2024-01-17T23:46:29.588 INFO:tasks.workunit.client.0.smithi067.stdout:3/794: dread d0/d34/d35/d57/ff1 [0,4194304] 0 2024-01-17T23:46:29.588 INFO:tasks.workunit.client.0.smithi067.stdout:3/795: fdatasync d0/d12/d98/ff2 0 2024-01-17T23:46:29.595 INFO:tasks.workunit.client.0.smithi067.stdout:3/796: dread d0/de1/f5c [0,4194304] 0 2024-01-17T23:46:29.812 INFO:tasks.workunit.client.0.smithi067.stdout:9/727: truncate d3/d6/f7f 2206697 0 2024-01-17T23:46:29.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/703: read fd [5616859,45939] 0 2024-01-17T23:46:29.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/704: chown d10/d24/d46/d4a/d4b/l80 22728 1 2024-01-17T23:46:29.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/705: creat d10/d53/fe3 x:0 0 0 2024-01-17T23:46:29.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/706: dread d10/d24/db4/fbf [0,4194304] 0 2024-01-17T23:46:29.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/707: stat d10/d24/d46/d4a/f57 0 2024-01-17T23:46:29.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/708: chown d10/d24/d59/c7a 70 1 2024-01-17T23:46:29.927 INFO:tasks.workunit.client.0.smithi067.stdout:0/830: creat d3/d5/d1a/d90/f12d x:0 0 0 2024-01-17T23:46:30.079 INFO:tasks.workunit.client.0.smithi067.stdout:1/774: symlink d0/d7/d13/d3d/d48/da4/lf9 0 2024-01-17T23:46:30.288 INFO:tasks.workunit.client.0.smithi067.stdout:3/797: truncate d0/d12/d1b/d4d/fb9 1197016 0 2024-01-17T23:46:30.288 INFO:tasks.workunit.client.0.smithi067.stdout:3/798: dread - d0/de1/d75/dcb/fee zero size 2024-01-17T23:46:30.563 INFO:tasks.workunit.client.0.smithi067.stdout:9/728: symlink d3/d6/d11/d50/d84/dd7/l106 0 2024-01-17T23:46:30.589 INFO:tasks.workunit.client.0.smithi067.stdout:9/729: dwrite d3/d6/d2a/d34/d42/f8e [0,4194304] 0 2024-01-17T23:46:30.800 INFO:tasks.workunit.client.0.smithi067.stdout:0/831: mkdir d3/d64/d82/d12e 0 2024-01-17T23:46:30.940 INFO:tasks.workunit.client.0.smithi067.stdout:1/775: link d0/d74/f5f d0/d7/d13/d3d/dd0/ffa 0 2024-01-17T23:46:31.256 INFO:tasks.workunit.client.0.smithi067.stdout:3/799: dread d0/d34/d35/f50 [0,4194304] 0 2024-01-17T23:46:31.257 INFO:tasks.workunit.client.0.smithi067.stdout:3/800: read d0/d12/d1b/f2d [771624,100664] 0 2024-01-17T23:46:31.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/730: symlink d3/d6/da4/l107 0 2024-01-17T23:46:31.664 INFO:tasks.workunit.client.0.smithi067.stdout:1/776: getdents d0/d7/d13 0 2024-01-17T23:46:31.690 INFO:tasks.workunit.client.0.smithi067.stdout:9/731: dwrite d3/f13 [0,4194304] 0 2024-01-17T23:46:31.697 INFO:tasks.workunit.client.0.smithi067.stdout:0/832: dwrite d3/d5/d1a/f71 [0,4194304] 0 2024-01-17T23:46:31.698 INFO:tasks.workunit.client.0.smithi067.stdout:0/833: chown d3/d5/d1a/d1c/d4e/lda 13 1 2024-01-17T23:46:32.230 INFO:tasks.workunit.client.0.smithi067.stdout:5/709: rename d10/d24/d59/d5d/d43 to d10/d24/d25/d5c/d7e/de4 0 2024-01-17T23:46:32.526 INFO:tasks.workunit.client.0.smithi067.stdout:1/777: creat d0/d7/d13/d3a/d3e/ffb x:0 0 0 2024-01-17T23:46:32.625 INFO:tasks.workunit.client.0.smithi067.stdout:9/732: getdents d3/d6/d11/d50/d84/da8/d6a 0 2024-01-17T23:46:32.776 INFO:tasks.workunit.client.0.smithi067.stdout:0/834: mknod d3/d5/d1a/d1c/d4e/d7c/dd0/c12f 0 2024-01-17T23:46:32.909 INFO:tasks.workunit.client.0.smithi067.stdout:3/801: truncate d0/d17/d69/d6e/f89 3408164 0 2024-01-17T23:46:32.910 INFO:tasks.workunit.client.0.smithi067.stdout:3/802: write d0/d12/d1b/f8b [79538,65256] 0 2024-01-17T23:46:32.910 INFO:tasks.workunit.client.0.smithi067.stdout:3/803: readlink d0/d17/dc8/l68 0 2024-01-17T23:46:33.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/778: creat d0/d7/d7f/ffc x:0 0 0 2024-01-17T23:46:33.241 INFO:tasks.workunit.client.0.smithi067.stdout:9/733: creat d3/d6/d2a/d34/d42/f108 x:0 0 0 2024-01-17T23:46:33.241 INFO:tasks.workunit.client.0.smithi067.stdout:9/734: readlink d3/d6/d2e/l54 0 2024-01-17T23:46:33.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/735: dwrite d3/d6/d47/d88/fcf [0,4194304] 0 2024-01-17T23:46:34.043 INFO:tasks.workunit.client.0.smithi067.stdout:1/779: mknod d0/d7/d13/d3a/d75/dc3/cfd 0 2024-01-17T23:46:34.164 INFO:tasks.workunit.client.0.smithi067.stdout:7/788: creat d4/ff2 x:0 0 0 2024-01-17T23:46:34.270 INFO:tasks.workunit.client.0.smithi067.stdout:9/736: mkdir d3/d6/d47/d88/dc2/d109 0 2024-01-17T23:46:34.298 INFO:tasks.workunit.client.0.smithi067.stdout:9/737: dwrite d3/d6/da4/dba/fe6 [0,4194304] 0 2024-01-17T23:46:34.298 INFO:tasks.workunit.client.0.smithi067.stdout:9/738: fdatasync d3/f5 0 2024-01-17T23:46:34.696 INFO:tasks.workunit.client.0.smithi067.stdout:7/789: mkdir d4/d25/d39/d8a/d92/df3 0 2024-01-17T23:46:35.020 INFO:tasks.workunit.client.0.smithi067.stdout:9/739: mkdir d3/d6/d47/d10a 0 2024-01-17T23:46:35.050 INFO:tasks.workunit.client.0.smithi067.stdout:9/740: dwrite d3/d6/d2a/d34/d42/d9c/fe1 [0,4194304] 0 2024-01-17T23:46:35.050 INFO:tasks.workunit.client.0.smithi067.stdout:9/741: creat d3/d6/d47/d88/f10b x:0 0 0 2024-01-17T23:46:35.050 INFO:tasks.workunit.client.0.smithi067.stdout:9/742: creat d3/d6/d10/f10c x:0 0 0 2024-01-17T23:46:35.091 INFO:tasks.workunit.client.0.smithi067.stdout:9/743: dwrite d3/d6/d47/db4/fec [0,4194304] 0 2024-01-17T23:46:35.338 INFO:tasks.workunit.client.0.smithi067.stdout:7/790: creat d4/d25/d39/d46/d78/d93/ff4 x:0 0 0 2024-01-17T23:46:35.338 INFO:tasks.workunit.client.0.smithi067.stdout:7/791: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/ff5 x:0 0 0 2024-01-17T23:46:36.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/744: creat d3/d6/d11/dd4/f10d x:0 0 0 2024-01-17T23:46:36.500 INFO:tasks.workunit.client.0.smithi067.stdout:7/792: dread d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fbd [0,4194304] 0 2024-01-17T23:46:37.459 INFO:tasks.workunit.client.0.smithi067.stdout:7/793: rmdir d4/d4b/d63 39 2024-01-17T23:46:37.659 INFO:tasks.workunit.client.0.smithi067.stdout:4/754: creat d3/ff3 x:0 0 0 2024-01-17T23:46:37.659 INFO:tasks.workunit.client.0.smithi067.stdout:4/755: getdents d3/d40/dd7 0 2024-01-17T23:46:38.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/794: link d4/f27 d4/d4b/d7f/ddd/ff6 0 2024-01-17T23:46:38.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/795: fsync d4/d25/d39/d46/d78/d93/d94/dc4/fa5 0 2024-01-17T23:46:38.022 INFO:tasks.workunit.client.0.smithi067.stdout:4/756: unlink d3/d26/d34/leb 0 2024-01-17T23:46:38.042 INFO:tasks.workunit.client.0.smithi067.stdout:7/796: read d4/d25/d39/d46/d78/d93/fa1 [4183380,73431] 0 2024-01-17T23:46:38.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/804: dwrite d0/d17/d69/d6e/f89 [0,4194304] 0 2024-01-17T23:46:38.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/805: truncate d0/de1/d55/f73 1447011 0 2024-01-17T23:46:38.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/806: creat d0/d12/d1b/d4d/ff8 x:0 0 0 2024-01-17T23:46:38.257 INFO:tasks.workunit.client.0.smithi067.stdout:0/835: write d3/d5/d1a/f3f [267135,65601] 0 2024-01-17T23:46:38.289 INFO:tasks.workunit.client.0.smithi067.stdout:1/780: write d0/d7/d13/d2e/f46 [2062392,106224] 0 2024-01-17T23:46:38.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/781: dread d0/f27 [4194304,4194304] 0 2024-01-17T23:46:38.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/782: readlink d0/d7/d7f/l97 0 2024-01-17T23:46:38.694 INFO:tasks.workunit.client.0.smithi067.stdout:4/757: mkdir d3/d4e/dee/d38/dab/df4 0 2024-01-17T23:46:38.694 INFO:tasks.workunit.client.0.smithi067.stdout:7/797: link d4/d25/d39/d46/da8/ff0 d4/d4b/d63/d95/ff7 0 2024-01-17T23:46:39.023 INFO:tasks.workunit.client.0.smithi067.stdout:3/807: mknod d0/d34/de3/cf9 0 2024-01-17T23:46:39.098 INFO:tasks.workunit.client.0.smithi067.stdout:0/836: mknod d3/d4c/c130 0 2024-01-17T23:46:39.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/758: unlink d3/d40/ldb 0 2024-01-17T23:46:39.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/759: dread d3/d8/d35/db0/fbd [0,4194304] 0 2024-01-17T23:46:39.355 INFO:tasks.workunit.client.0.smithi067.stdout:3/808: symlink d0/d13/d1a/d38/lfa 0 2024-01-17T23:46:39.715 INFO:tasks.workunit.client.0.smithi067.stdout:4/760: symlink d3/d8/d35/d36/lf5 0 2024-01-17T23:46:40.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/761: symlink d3/d4e/dee/dc7/lf6 0 2024-01-17T23:46:40.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/762: chown d3/d26/d34/d3a/d9f/ld1 37841 1 2024-01-17T23:46:40.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/763: chown d3/d4e/dee/d38 58930 1 2024-01-17T23:46:40.306 INFO:tasks.workunit.client.0.smithi067.stdout:9/745: dwrite d3/d6/d10/f66 [0,4194304] 0 2024-01-17T23:46:40.306 INFO:tasks.workunit.client.0.smithi067.stdout:9/746: creat d3/d6/d47/d88/f10e x:0 0 0 2024-01-17T23:46:40.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/747: read d3/d6/d11/f23 [3782913,17591] 0 2024-01-17T23:46:40.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/748: chown d3/d6/d2a/da2/f83 3 1 2024-01-17T23:46:40.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/749: dread - d3/d6/d11/d50/d84/da8/f74 zero size 2024-01-17T23:46:40.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/750: truncate d3/d6/d47/d88/dc2/fdc 218871 0 2024-01-17T23:46:40.329 INFO:tasks.workunit.client.0.smithi067.stdout:8/821: sync 2024-01-17T23:46:40.329 INFO:tasks.workunit.client.0.smithi067.stdout:2/771: sync 2024-01-17T23:46:40.329 INFO:tasks.workunit.client.0.smithi067.stdout:6/795: sync 2024-01-17T23:46:40.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/710: rename d10/d24/d46/d4a/d50/d5a/fa2 to d10/d24/d25/d5c/fe5 0 2024-01-17T23:46:41.034 INFO:tasks.workunit.client.0.smithi067.stdout:4/764: mknod d3/d26/d34/d3a/d53/cf7 0 2024-01-17T23:46:41.034 INFO:tasks.workunit.client.0.smithi067.stdout:4/765: stat d3/d4e/dee/d20/d3b/ddf 0 2024-01-17T23:46:41.041 INFO:tasks.workunit.client.0.smithi067.stdout:4/766: dread d3/d4e/f63 [0,4194304] 0 2024-01-17T23:46:41.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/751: mkdir d3/d6/da4/d55/da1/dbc/d10f 0 2024-01-17T23:46:41.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/752: truncate d3/d6/d47/d88/f10b 710025 0 2024-01-17T23:46:41.369 INFO:tasks.workunit.client.0.smithi067.stdout:9/753: dwrite d3/d6/d2e/fe5 [0,4194304] 0 2024-01-17T23:46:41.409 INFO:tasks.workunit.client.0.smithi067.stdout:9/754: dwrite d3/d6/d11/f4f [0,4194304] 0 2024-01-17T23:46:41.409 INFO:tasks.workunit.client.0.smithi067.stdout:9/755: stat d3/d6/d2e 0 2024-01-17T23:46:41.409 INFO:tasks.workunit.client.0.smithi067.stdout:9/756: write d3/d6/da4/f67 [980650,122298] 0 2024-01-17T23:46:41.694 INFO:tasks.workunit.client.0.smithi067.stdout:8/822: mknod d6/d26/d7c/c119 0 2024-01-17T23:46:41.722 INFO:tasks.workunit.client.0.smithi067.stdout:8/823: dwrite d6/d19/d22/dec/f105 [0,4194304] 0 2024-01-17T23:46:41.753 INFO:tasks.workunit.client.0.smithi067.stdout:8/824: dwrite d6/d19/f3a [0,4194304] 0 2024-01-17T23:46:41.763 INFO:tasks.workunit.client.0.smithi067.stdout:8/825: dread d6/d26/d56/dbb/dfd/fb9 [0,4194304] 0 2024-01-17T23:46:41.814 INFO:tasks.workunit.client.0.smithi067.stdout:2/772: rmdir d5/d1f/d2a/d55/dbd 0 2024-01-17T23:46:41.972 INFO:tasks.workunit.client.0.smithi067.stdout:6/796: mkdir d6/d9/d30/d58/d10c 0 2024-01-17T23:46:42.120 INFO:tasks.workunit.client.0.smithi067.stdout:1/783: rename d0/ddc/dea to d0/d7/d13/d3a/d3e/dfe 0 2024-01-17T23:46:42.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/711: creat d10/d24/d59/fe6 x:0 0 0 2024-01-17T23:46:42.579 INFO:tasks.workunit.client.0.smithi067.stdout:4/767: mkdir d3/d4e/dee/df8 0 2024-01-17T23:46:42.589 INFO:tasks.workunit.client.0.smithi067.stdout:4/768: dread d3/f75 [0,4194304] 0 2024-01-17T23:46:42.589 INFO:tasks.workunit.client.0.smithi067.stdout:4/769: fsync d3/d40/f41 0 2024-01-17T23:46:42.929 INFO:tasks.workunit.client.0.smithi067.stdout:9/757: dread d3/d6/d2a/d34/d42/f6b [0,4194304] 0 2024-01-17T23:46:42.932 INFO:tasks.workunit.client.0.smithi067.stdout:9/758: dread d3/d6/d47/fb6 [0,4194304] 0 2024-01-17T23:46:42.957 INFO:tasks.workunit.client.0.smithi067.stdout:9/759: dwrite d3/d6/d2e/f99 [0,4194304] 0 2024-01-17T23:46:43.617 INFO:tasks.workunit.client.0.smithi067.stdout:6/797: symlink d6/d9/d65/da4/l10d 0 2024-01-17T23:46:43.617 INFO:tasks.workunit.client.0.smithi067.stdout:6/798: chown d6/d9/d1c/d1e/d43/def/d51/cb4 2682 1 2024-01-17T23:46:44.057 INFO:tasks.workunit.client.0.smithi067.stdout:1/784: mknod d0/ddc/cff 0 2024-01-17T23:46:44.057 INFO:tasks.workunit.client.0.smithi067.stdout:1/785: fsync d0/f5 0 2024-01-17T23:46:44.155 INFO:tasks.workunit.client.0.smithi067.stdout:5/712: creat d10/d53/da4/dc6/fe7 x:0 0 0 2024-01-17T23:46:44.528 INFO:tasks.workunit.client.0.smithi067.stdout:9/760: link d3/d6/da4/f86 d3/d6/da4/d55/da1/dbc/d10f/f110 0 2024-01-17T23:46:44.776 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:44.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:46:44.949 INFO:tasks.workunit.client.0.smithi067.stdout:8/826: rmdir d6/d19/dcf 39 2024-01-17T23:46:44.949 INFO:tasks.workunit.client.0.smithi067.stdout:8/827: write d6/d19/d22/d25/d53/fca [703165,56228] 0 2024-01-17T23:46:44.957 INFO:tasks.workunit.client.0.smithi067.stdout:8/828: fsync d6/d19/d22/d25/d53/fca 0 2024-01-17T23:46:45.063 INFO:tasks.workunit.client.0.smithi067.stdout:6/799: mknod d6/d9/d1c/d1e/c10e 0 2024-01-17T23:46:45.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/800: dwrite d6/d9/d1c/d1e/d43/def/fbe [0,4194304] 0 2024-01-17T23:46:45.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/801: dread - d6/d9/d1c/d1e/d43/def/d51/fbb zero size 2024-01-17T23:46:45.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/802: fdatasync d6/d9/d1c/d1e/d43/d86/da5/fc3 0 2024-01-17T23:46:45.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/803: write d6/f1f [4420220,128544] 0 2024-01-17T23:46:45.280 INFO:tasks.workunit.client.0.smithi067.stdout:1/786: creat d0/d7/d13/d3d/f100 x:0 0 0 2024-01-17T23:46:45.459 INFO:tasks.workunit.client.0.smithi067.stdout:5/713: rmdir d10/d24/d59/d5d 39 2024-01-17T23:46:45.491 INFO:tasks.workunit.client.0.smithi067.stdout:5/714: dwrite d10/d24/d46/d4a/d50/f89 [0,4194304] 0 2024-01-17T23:46:45.787 INFO:tasks.workunit.client.0.smithi067.stdout:9/761: mknod d3/d6/d47/d10a/c111 0 2024-01-17T23:46:45.815 INFO:tasks.workunit.client.0.smithi067.stdout:6/804: creat d6/f10f x:0 0 0 2024-01-17T23:46:45.815 INFO:tasks.workunit.client.0.smithi067.stdout:1/787: mknod d0/d7/d13/d3d/d48/da4/c101 0 2024-01-17T23:46:45.815 INFO:tasks.workunit.client.0.smithi067.stdout:1/788: chown d0/d7/d13/d3a/fa6 59735104 1 2024-01-17T23:46:46.113 INFO:tasks.workunit.client.0.smithi067.stdout:5/715: creat d10/d24/d25/d5c/d7e/de4/fe8 x:0 0 0 2024-01-17T23:46:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:9/762: rmdir d3/d6/d47 39 2024-01-17T23:46:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:1/789: mknod d0/d7/d13/d77/dee/c102 0 2024-01-17T23:46:46.524 INFO:tasks.workunit.client.0.smithi067.stdout:9/763: write d3/d6/d11/d50/d84/da8/f74 [72066,96758] 0 2024-01-17T23:46:46.525 INFO:tasks.workunit.client.0.smithi067.stdout:5/716: symlink d10/d24/d25/le9 0 2024-01-17T23:46:46.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/717: dwrite d10/d24/d25/f9b [0,4194304] 0 2024-01-17T23:46:46.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/718: write d10/d24/f93 [412882,2521] 0 2024-01-17T23:46:46.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/719: chown d10/d24/d59/d8c/dba/ld8 27675 1 2024-01-17T23:46:46.568 INFO:tasks.workunit.client.0.smithi067.stdout:5/720: chown d10/d24/d46/d4a 1932185 1 2024-01-17T23:46:46.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/721: write d10/f91 [1907970,1098] 0 2024-01-17T23:46:46.587 INFO:tasks.workunit.client.0.smithi067.stdout:5/722: dread d10/d24/d46/f7c [0,4194304] 0 2024-01-17T23:46:46.602 INFO:tasks.workunit.client.0.smithi067.stdout:5/723: dread d10/d24/d25/f2b [0,4194304] 0 2024-01-17T23:46:46.602 INFO:tasks.workunit.client.0.smithi067.stdout:5/724: write d10/d24/d59/d5d/fc5 [928760,53528] 0 2024-01-17T23:46:46.627 INFO:tasks.workunit.client.0.smithi067.stdout:5/725: dwrite d10/d24/d46/d4a/fa1 [0,4194304] 0 2024-01-17T23:46:46.922 INFO:tasks.workunit.client.0.smithi067.stdout:9/764: mknod d3/c112 0 2024-01-17T23:46:46.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/765: dwrite d3/d6/d2e/fe5 [4194304,4194304] 0 2024-01-17T23:46:46.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/766: chown d3/d6/da4/le0 1599620 1 2024-01-17T23:46:46.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/767: chown d3/d6/d2a/da2/de2/dd0/da6/cbf 382588735 1 2024-01-17T23:46:47.527 INFO:tasks.workunit.client.0.smithi067.stdout:4/770: write d3/d26/d34/d65/f68 [214708,63382] 0 2024-01-17T23:46:47.588 INFO:tasks.workunit.client.0.smithi067.stdout:5/726: symlink d10/d24/d46/d4a/d4b/lea 0 2024-01-17T23:46:47.588 INFO:tasks.workunit.client.0.smithi067.stdout:5/727: dread - d10/d24/d59/fe6 zero size 2024-01-17T23:46:48.843 INFO:tasks.workunit.client.0.smithi067.stdout:4/771: dread d3/d26/d34/d3a/f47 [4194304,4194304] 0 2024-01-17T23:46:48.844 INFO:tasks.workunit.client.0.smithi067.stdout:4/772: creat d3/d8/d35/d36/ff9 x:0 0 0 2024-01-17T23:46:48.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/829: dwrite d6/d19/d22/d25/d53/d65/f44 [0,4194304] 0 2024-01-17T23:46:48.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/830: chown d6/d26/d3e/fb2 61915 1 2024-01-17T23:46:48.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/831: fdatasync d6/d26/d56/dbb/dfd/d5f/dc0/f9f 0 2024-01-17T23:46:49.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/728: symlink d10/d24/d25/d5c/d7e/d7f/d92/leb 0 2024-01-17T23:46:49.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/798: rename d4/d25/l6c to d4/d25/d39/d46/d78/lf8 0 2024-01-17T23:46:49.523 INFO:tasks.workunit.client.0.smithi067.stdout:8/832: mknod d6/d19/d22/d25/d53/d65/c11a 0 2024-01-17T23:46:49.523 INFO:tasks.workunit.client.0.smithi067.stdout:8/833: write d6/d26/d3e/d6c/fc9 [789484,10283] 0 2024-01-17T23:46:49.770 INFO:tasks.workunit.client.0.smithi067.stdout:5/729: creat d10/d24/d46/d4a/fec x:0 0 0 2024-01-17T23:46:49.770 INFO:tasks.workunit.client.0.smithi067.stdout:4/773: getdents d3/d40/dc8 0 2024-01-17T23:46:49.945 INFO:tasks.workunit.client.0.smithi067.stdout:0/837: rename d3/d5/d1a/d1c/d1d/d2e/d5a/laf to d3/d5/d122/d9f/dee/l131 0 2024-01-17T23:46:49.945 INFO:tasks.workunit.client.0.smithi067.stdout:0/838: fdatasync d3/d5/d1a/d1c/f11a 0 2024-01-17T23:46:50.143 INFO:tasks.workunit.client.0.smithi067.stdout:7/799: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/df9 0 2024-01-17T23:46:50.169 INFO:tasks.workunit.client.0.smithi067.stdout:6/805: dwrite d6/d18/d2e/d61/ff7 [4194304,4194304] 0 2024-01-17T23:46:50.169 INFO:tasks.workunit.client.0.smithi067.stdout:6/806: chown d6/d9/d30/d58/l59 6 1 2024-01-17T23:46:50.169 INFO:tasks.workunit.client.0.smithi067.stdout:6/807: getdents d6/d9/d30/d4c/d82 0 2024-01-17T23:46:50.169 INFO:tasks.workunit.client.0.smithi067.stdout:6/808: readlink d6/d9/d1c/d1e/d43/ld0 0 2024-01-17T23:46:50.251 INFO:tasks.workunit.client.0.smithi067.stdout:8/834: getdents d6/db 0 2024-01-17T23:46:50.455 INFO:tasks.workunit.client.0.smithi067.stdout:5/730: rmdir d10/d24/d59/d8c/dae 39 2024-01-17T23:46:50.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/731: dwrite d10/d24/d46/d4a/d63/f8b [0,4194304] 0 2024-01-17T23:46:50.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/732: fdatasync d10/d24/f5f 0 2024-01-17T23:46:50.856 INFO:tasks.workunit.client.0.smithi067.stdout:0/839: mknod d3/d5/d1a/d1c/d1d/c132 0 2024-01-17T23:46:50.873 INFO:tasks.workunit.client.0.smithi067.stdout:0/840: dread d3/d5/d1a/d1c/d1d/f103 [0,4194304] 0 2024-01-17T23:46:50.873 INFO:tasks.workunit.client.0.smithi067.stdout:0/841: dread - d3/d5/d1a/d1c/d1d/d2e/d5a/f88 zero size 2024-01-17T23:46:51.161 INFO:tasks.workunit.client.0.smithi067.stdout:6/809: symlink d6/d9/d1c/d1e/d7e/l110 0 2024-01-17T23:46:51.233 INFO:tasks.workunit.client.0.smithi067.stdout:8/835: rmdir d6/d26/d56/dbb/de1 39 2024-01-17T23:46:51.233 INFO:tasks.workunit.client.0.smithi067.stdout:8/836: readlink d6/d19/d22/l7f 0 2024-01-17T23:46:51.623 INFO:tasks.workunit.client.0.smithi067.stdout:5/733: rmdir d10/d53/da4 39 2024-01-17T23:46:51.660 INFO:tasks.workunit.client.0.smithi067.stdout:5/734: dwrite d10/d24/d25/f2b [0,4194304] 0 2024-01-17T23:46:51.865 INFO:tasks.workunit.client.0.smithi067.stdout:4/774: truncate d3/d4e/dee/d20/d3b/f51 250481 0 2024-01-17T23:46:52.218 INFO:tasks.workunit.client.0.smithi067.stdout:0/842: unlink d3/d5/d1a/d1c/d4d/f97 0 2024-01-17T23:46:52.656 INFO:tasks.workunit.client.0.smithi067.stdout:8/837: mkdir d6/d26/d3e/d87/dd8/d11b 0 2024-01-17T23:46:52.656 INFO:tasks.workunit.client.0.smithi067.stdout:8/838: write d6/d19/d22/d25/d53/ffe [496341,76200] 0 2024-01-17T23:46:52.815 INFO:tasks.workunit.client.0.smithi067.stdout:5/735: symlink d10/d24/d46/d4a/d50/led 0 2024-01-17T23:46:53.294 INFO:tasks.workunit.client.0.smithi067.stdout:4/775: unlink d3/d4e/dee/d20/f5e 0 2024-01-17T23:46:53.414 INFO:tasks.workunit.client.0.smithi067.stdout:0/843: creat d3/d5/d122/d9f/f133 x:0 0 0 2024-01-17T23:46:53.415 INFO:tasks.workunit.client.0.smithi067.stdout:1/790: sync 2024-01-17T23:46:53.415 INFO:tasks.workunit.client.0.smithi067.stdout:9/768: sync 2024-01-17T23:46:53.415 INFO:tasks.workunit.client.0.smithi067.stdout:9/769: fdatasync d3/d6/d47/d88/f10e 0 2024-01-17T23:46:53.415 INFO:tasks.workunit.client.0.smithi067.stdout:9/770: write d3/d6/d11/d5c/ffc [155989,104090] 0 2024-01-17T23:46:53.416 INFO:tasks.workunit.client.0.smithi067.stdout:9/771: dread - d3/d6/d2a/da2/fb9 zero size 2024-01-17T23:46:53.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/791: dwrite d0/d7/d13/fa9 [0,4194304] 0 2024-01-17T23:46:53.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/792: chown d0/ddc/cff 3 1 2024-01-17T23:46:53.605 INFO:tasks.workunit.client.0.smithi067.stdout:6/810: creat d6/d9/de1/f111 x:0 0 0 2024-01-17T23:46:53.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/839: symlink d6/d26/d3e/d10d/l11c 0 2024-01-17T23:46:53.762 INFO:tasks.workunit.client.0.smithi067.stdout:8/840: read d6/d19/d22/d25/d53/d65/f78 [297929,70845] 0 2024-01-17T23:46:53.762 INFO:tasks.workunit.client.0.smithi067.stdout:8/841: readlink d6/d19/d22/d25/d53/dbd/ld3 0 2024-01-17T23:46:53.762 INFO:tasks.workunit.client.0.smithi067.stdout:8/842: write d6/d19/d22/d25/d53/f7e [2324318,14738] 0 2024-01-17T23:46:53.971 INFO:tasks.workunit.client.0.smithi067.stdout:3/809: rename d0/d17/f28 to d0/d34/d35/d65/d6f/d70/ddc/ffb 0 2024-01-17T23:46:53.971 INFO:tasks.workunit.client.0.smithi067.stdout:3/810: truncate d0/d12/d1b/d4d/fe5 665696 0 2024-01-17T23:46:53.971 INFO:tasks.workunit.client.0.smithi067.stdout:3/811: chown d0/d34/d35/d57/fa0 58265 1 2024-01-17T23:46:54.343 INFO:tasks.workunit.client.0.smithi067.stdout:5/736: creat d10/d24/d46/d4a/d4b/da9/fee x:0 0 0 2024-01-17T23:46:54.343 INFO:tasks.workunit.client.0.smithi067.stdout:5/737: write d10/d24/d25/d5c/d7e/fa7 [1254609,4060] 0 2024-01-17T23:46:54.343 INFO:tasks.workunit.client.0.smithi067.stdout:5/738: getdents d10/d24 0 2024-01-17T23:46:54.596 INFO:tasks.workunit.client.0.smithi067.stdout:0/844: link d3/d6/d80/c116 d3/d5/d122/c134 0 2024-01-17T23:46:54.794 INFO:tasks.workunit.client.0.smithi067.stdout:1/793: mknod d0/d7/d13/d3a/d75/c103 0 2024-01-17T23:46:54.794 INFO:tasks.workunit.client.0.smithi067.stdout:1/794: truncate d0/d7/d13/d3d/dd0/ff0 45417 0 2024-01-17T23:46:54.978 INFO:tasks.workunit.client.0.smithi067.stdout:7/800: write d4/d25/d39/d79/fb8 [486682,72545] 0 2024-01-17T23:46:54.979 INFO:tasks.workunit.client.0.smithi067.stdout:7/801: chown d4/d25/d39/d46/d60/ddc 1937313709 1 2024-01-17T23:46:54.979 INFO:tasks.workunit.client.0.smithi067.stdout:7/802: chown d4/d25/d39/d46/d78/lf8 470820 1 2024-01-17T23:46:54.984 INFO:tasks.workunit.client.0.smithi067.stdout:7/803: read d4/d25/d39/d46/d78/d93/d94/fb9 [647956,104599] 0 2024-01-17T23:46:55.011 INFO:tasks.workunit.client.0.smithi067.stdout:7/804: dwrite d4/d25/f90 [0,4194304] 0 2024-01-17T23:46:55.011 INFO:tasks.workunit.client.0.smithi067.stdout:7/805: truncate d4/d25/d39/d46/d78/d93/d94/dc4/f3a 5226684 0 2024-01-17T23:46:55.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/806: dread d4/d25/d39/d46/d78/f86 [0,4194304] 0 2024-01-17T23:46:55.312 INFO:tasks.workunit.client.0.smithi067.stdout:8/843: mknod d6/d26/d3e/d87/c11d 0 2024-01-17T23:46:55.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/773: rename d5/d1f/d2a/d54/d8/d4c/lbc to d5/d1f/d2a/d54/d8/d4c/dbf/df4/df7/l111 0 2024-01-17T23:46:55.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/774: dwrite d5/d1f/d2a/d54/d39/fdb [0,4194304] 0 2024-01-17T23:46:55.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/812: creat d0/d13/d1a/d38/dea/ffc x:0 0 0 2024-01-17T23:46:55.651 INFO:tasks.workunit.client.0.smithi067.stdout:5/739: rmdir d10/d24/d59/d5d/dd2 0 2024-01-17T23:46:55.762 INFO:tasks.workunit.client.0.smithi067.stdout:0/845: creat d3/d64/d7d/f135 x:0 0 0 2024-01-17T23:46:55.892 INFO:tasks.workunit.client.0.smithi067.stdout:1/795: mkdir d0/d7/d13/d77/d95/d104 0 2024-01-17T23:46:55.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/796: read d0/f27 [2411976,32977] 0 2024-01-17T23:46:56.231 INFO:tasks.workunit.client.0.smithi067.stdout:7/807: unlink d4/d25/d39/d46/d78/d93/d94/dc4/d41/f55 0 2024-01-17T23:46:56.703 INFO:tasks.workunit.client.0.smithi067.stdout:4/776: rmdir d3/d4e 39 2024-01-17T23:46:57.055 INFO:tasks.workunit.client.0.smithi067.stdout:6/811: rename d6/d9/d65/da4/fff to d6/d9/d30/f112 0 2024-01-17T23:46:57.069 INFO:tasks.workunit.client.0.smithi067.stdout:6/812: write d6/d9/d3e/f6c [2038983,19142] 0 2024-01-17T23:46:57.069 INFO:tasks.workunit.client.0.smithi067.stdout:6/813: stat d6/d18/d2e/d61/d9a/dd1/l105 0 2024-01-17T23:46:57.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/775: mkdir d5/d1f/d16/d61/d112 0 2024-01-17T23:46:57.979 INFO:tasks.workunit.client.0.smithi067.stdout:5/740: mknod d10/d24/d25/dd5/cef 0 2024-01-17T23:46:58.207 INFO:tasks.workunit.client.0.smithi067.stdout:1/797: link d0/d62/f65 d0/d7/d13/d3d/d48/d4d/f105 0 2024-01-17T23:46:58.490 INFO:tasks.workunit.client.0.smithi067.stdout:4/777: stat d3/d26/d34/d3a/f5b 0 2024-01-17T23:46:58.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/808: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/ffa x:0 0 0 2024-01-17T23:46:58.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/778: dwrite d3/d5/d93/dcd/fe4 [0,4194304] 0 2024-01-17T23:46:58.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/814: rename d6/d9/d1c/d1e/c37 to d6/d9/d30/d58/c113 0 2024-01-17T23:46:58.871 INFO:tasks.workunit.client.0.smithi067.stdout:6/815: write d6/d18/d2e/d61/d9a/fac [424707,57198] 0 2024-01-17T23:46:58.893 INFO:tasks.workunit.client.0.smithi067.stdout:6/816: read d6/d9/f31 [4248149,61950] 0 2024-01-17T23:46:59.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/809: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/dfb 0 2024-01-17T23:46:59.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/810: dread - d4/d25/d39/d46/da8/fe0 zero size 2024-01-17T23:46:59.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/811: read - d4/d4b/fac zero size 2024-01-17T23:46:59.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/812: write d4/d25/d39/d46/f50 [1153894,92248] 0 2024-01-17T23:46:59.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/813: chown d4/d25/d39 107913199 1 2024-01-17T23:46:59.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/779: getdents d3/d5/d93 0 2024-01-17T23:46:59.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/780: chown d3/d4e/dee/d20/d3b/d7c/d92/f99 1080396779 1 2024-01-17T23:46:59.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/781: chown d3/d26/d34/d3a/f5b 182008732 1 2024-01-17T23:46:59.606 INFO:tasks.workunit.client.0.smithi067.stdout:4/782: read - d3/d4e/fd6 zero size 2024-01-17T23:46:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:2/776: mknod d5/d1f/d2a/d73/c113 0 2024-01-17T23:46:59.811 INFO:tasks.workunit.client.0.smithi067.stdout:2/777: chown d5/d1f/d16/l18 2877416 1 2024-01-17T23:46:59.816 INFO:tasks.workunit.client.0.smithi067.stdout:2/778: read d5/d1f/d2a/d55/f99 [4403738,48575] 0 2024-01-17T23:47:00.527 INFO:tasks.workunit.client.0.smithi067.stdout:4/783: rename d3/d4e/dee/dc7/fd9 to d3/d4e/dee/df8/ffa 0 2024-01-17T23:47:00.527 INFO:tasks.workunit.client.0.smithi067.stdout:6/817: link d6/d9/d1c/d1e/d43/d86/cfb d6/d9/de1/c114 0 2024-01-17T23:47:00.528 INFO:tasks.workunit.client.0.smithi067.stdout:2/779: creat d5/d1f/d2a/d54/d8/d4c/dbf/f114 x:0 0 0 2024-01-17T23:47:00.528 INFO:tasks.workunit.client.0.smithi067.stdout:2/780: creat d5/d2f/f115 x:0 0 0 2024-01-17T23:47:00.528 INFO:tasks.workunit.client.0.smithi067.stdout:2/781: read - d5/d1f/d2a/d54/d8/d32/fd1 zero size 2024-01-17T23:47:00.532 INFO:tasks.workunit.client.0.smithi067.stdout:9/772: sync 2024-01-17T23:47:00.532 INFO:tasks.workunit.client.0.smithi067.stdout:9/773: chown d3/d6/d47/d88/dc2 222 1 2024-01-17T23:47:00.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/774: readlink d3/d6/da4/d55/ld9 0 2024-01-17T23:47:00.540 INFO:tasks.workunit.client.0.smithi067.stdout:6/818: dread d6/d9/d1c/f4b [0,4194304] 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/819: read d6/d18/f1d [972486,40387] 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/820: readlink d6/d9/d65/lf1 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/821: write d6/d9/d1c/d1e/d43/d78/dab/fc9 [338283,61793] 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/822: dread - d6/d9/d30/dbd/fdb zero size 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/823: fsync d6/d9/d1c/f66 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/824: dread - d6/d9/d1c/d1e/d43/d78/dab/fc1 zero size 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/825: creat d6/d9/d1c/d1e/d43/d78/f115 x:0 0 0 2024-01-17T23:47:00.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/826: creat d6/d9/d3e/f116 x:0 0 0 2024-01-17T23:47:00.560 INFO:tasks.workunit.client.0.smithi067.stdout:6/827: write d6/d9/d1c/d1e/d43/d86/da5/faa [1221473,75744] 0 2024-01-17T23:47:01.321 INFO:tasks.workunit.client.0.smithi067.stdout:4/784: creat d3/d4e/dee/d38/dab/ffb x:0 0 0 2024-01-17T23:47:01.675 INFO:tasks.workunit.client.0.smithi067.stdout:2/782: readlink d5/d1f/d2a/d54/d39/l60 0 2024-01-17T23:47:01.791 INFO:tasks.workunit.client.0.smithi067.stdout:9/775: mknod d3/d25/d5d/d79/d105/c113 0 2024-01-17T23:47:01.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/776: chown d3/d6/d47/d88/dc2/d109 625 1 2024-01-17T23:47:01.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/777: chown d3/d25 1632400 1 2024-01-17T23:47:01.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/778: creat d3/d6/d2a/d34/d42/d9c/f114 x:0 0 0 2024-01-17T23:47:01.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/779: dwrite d3/d6/d2e/f9b [0,4194304] 0 2024-01-17T23:47:02.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/844: sync 2024-01-17T23:47:02.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/828: symlink d6/d9/ddf/l117 0 2024-01-17T23:47:02.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/845: stat d6/d19/db4/dde 0 2024-01-17T23:47:02.334 INFO:tasks.workunit.client.0.smithi067.stdout:8/846: truncate d6/d26/d7c/f8b 2107785 0 2024-01-17T23:47:02.335 INFO:tasks.workunit.client.0.smithi067.stdout:6/829: creat d6/d9/d3e/f118 x:0 0 0 2024-01-17T23:47:02.335 INFO:tasks.workunit.client.0.smithi067.stdout:6/830: readlink d6/d9/d1c/d1e/d7e/lb9 0 2024-01-17T23:47:02.335 INFO:tasks.workunit.client.0.smithi067.stdout:6/831: fsync d6/d9/d30/f112 0 2024-01-17T23:47:02.675 INFO:tasks.workunit.client.0.smithi067.stdout:2/783: stat d5/l53 0 2024-01-17T23:47:02.675 INFO:tasks.workunit.client.0.smithi067.stdout:2/784: dread - d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/f108 zero size 2024-01-17T23:47:02.697 INFO:tasks.workunit.client.0.smithi067.stdout:3/813: write d0/d17/fa8 [1098124,4687] 0 2024-01-17T23:47:02.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/780: rmdir d3/d6/d2a/da2/de2 39 2024-01-17T23:47:03.629 INFO:tasks.workunit.client.0.smithi067.stdout:6/832: symlink d6/d9/d30/d4c/l119 0 2024-01-17T23:47:03.818 INFO:tasks.workunit.client.0.smithi067.stdout:4/785: link d3/d26/d34/d3a/c3d d3/d5/d93/dcd/cfc 0 2024-01-17T23:47:03.845 INFO:tasks.workunit.client.0.smithi067.stdout:4/786: dwrite d3/d4e/dee/d20/d52/f95 [0,4194304] 0 2024-01-17T23:47:03.845 INFO:tasks.workunit.client.0.smithi067.stdout:4/787: chown d3/fc1 145206 1 2024-01-17T23:47:04.182 INFO:tasks.workunit.client.0.smithi067.stdout:9/781: mkdir d3/d6/da4/d55/d115 0 2024-01-17T23:47:04.182 INFO:tasks.workunit.client.0.smithi067.stdout:9/782: write d3/d6/d2a/d34/d42/d9c/fed [768856,102532] 0 2024-01-17T23:47:04.182 INFO:tasks.workunit.client.0.smithi067.stdout:9/783: truncate d3/d6/d11/d5c/fda 479482 0 2024-01-17T23:47:04.539 INFO:tasks.workunit.client.0.smithi067.stdout:0/846: rmdir d3/d5/d1a/d1c/d4d 39 2024-01-17T23:47:04.539 INFO:tasks.workunit.client.0.smithi067.stdout:0/847: write d3/d6/f4b [6241097,56591] 0 2024-01-17T23:47:04.539 INFO:tasks.workunit.client.0.smithi067.stdout:0/848: chown d3/d5/d1a/d1c/d4e/lc3 50 1 2024-01-17T23:47:04.539 INFO:tasks.workunit.client.0.smithi067.stdout:0/849: fdatasync d3/d6/dd/d107/f12b 0 2024-01-17T23:47:04.614 INFO:tasks.workunit.client.0.smithi067.stdout:6/833: creat d6/d18/d2e/d7c/f11a x:0 0 0 2024-01-17T23:47:04.614 INFO:tasks.workunit.client.0.smithi067.stdout:6/834: dread - d6/d9/d1c/f66 zero size 2024-01-17T23:47:04.645 INFO:tasks.workunit.client.0.smithi067.stdout:6/835: dwrite d6/d9/d30/d4c/d8d/f99 [0,4194304] 0 2024-01-17T23:47:04.645 INFO:tasks.workunit.client.0.smithi067.stdout:6/836: write d6/fd [5048187,122596] 0 2024-01-17T23:47:04.663 INFO:tasks.workunit.client.0.smithi067.stdout:6/837: dread d6/d9/d1c/d1e/f5e [0,4194304] 0 2024-01-17T23:47:05.128 INFO:tasks.workunit.client.0.smithi067.stdout:4/788: symlink d3/d4e/dee/d38/dab/lfd 0 2024-01-17T23:47:05.128 INFO:tasks.workunit.client.0.smithi067.stdout:9/784: creat d3/d6/d2e/f116 x:0 0 0 2024-01-17T23:47:05.281 INFO:tasks.workunit.client.0.smithi067.stdout:8/847: rename d6/d19/d22/ddd to d6/d19/db4/dde/d11e 0 2024-01-17T23:47:05.514 INFO:tasks.workunit.client.0.smithi067.stdout:0/850: truncate d3/d5/d1a/d1c/d4e/d6b/fc7 3282006 0 2024-01-17T23:47:05.834 INFO:tasks.workunit.client.0.smithi067.stdout:6/838: getdents d6/d9/d1c/d1e/d43/d78/dab 0 2024-01-17T23:47:06.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/789: symlink d3/d5/d93/d9e/lfe 0 2024-01-17T23:47:06.125 INFO:tasks.workunit.client.0.smithi067.stdout:4/790: dwrite d3/d5/d93/d9e/f9c [0,4194304] 0 2024-01-17T23:47:06.125 INFO:tasks.workunit.client.0.smithi067.stdout:4/791: write d3/d4e/fd6 [561745,100306] 0 2024-01-17T23:47:06.125 INFO:tasks.workunit.client.0.smithi067.stdout:4/792: fdatasync d3/d26/d34/d65/f86 0 2024-01-17T23:47:06.132 INFO:tasks.workunit.client.0.smithi067.stdout:4/793: dread d3/d8/d35/db0/fbd [0,4194304] 0 2024-01-17T23:47:06.781 INFO:tasks.workunit.client.0.smithi067.stdout:8/848: truncate d6/d19/fc8 3454680 0 2024-01-17T23:47:07.462 INFO:tasks.workunit.client.0.smithi067.stdout:4/794: dread d3/d4e/dee/f77 [0,4194304] 0 2024-01-17T23:47:07.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/795: dwrite d3/ff3 [0,4194304] 0 2024-01-17T23:47:07.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/796: dread - d3/d4e/dee/df8/ffa zero size 2024-01-17T23:47:07.495 INFO:tasks.workunit.client.0.smithi067.stdout:4/797: write d3/d4e/fce [872800,129850] 0 2024-01-17T23:47:07.522 INFO:tasks.workunit.client.0.smithi067.stdout:4/798: dwrite d3/d26/f33 [0,4194304] 0 2024-01-17T23:47:07.971 INFO:tasks.workunit.client.0.smithi067.stdout:8/849: link d6/d19/d22/d25/d53/fce d6/d26/d56/dbb/dfd/f11f 0 2024-01-17T23:47:07.971 INFO:tasks.workunit.client.0.smithi067.stdout:8/850: readlink d6/d19/dcf/ld7 0 2024-01-17T23:47:08.360 INFO:tasks.workunit.client.0.smithi067.stdout:4/799: mkdir d3/d4e/dee/df8/dff 0 2024-01-17T23:47:08.360 INFO:tasks.workunit.client.0.smithi067.stdout:4/800: fdatasync d3/d4e/dee/d20/d3b/d7c/f89 0 2024-01-17T23:47:08.694 INFO:tasks.workunit.client.0.smithi067.stdout:8/851: symlink d6/d26/d56/dbb/l120 0 2024-01-17T23:47:08.831 INFO:tasks.workunit.client.0.smithi067.stdout:5/741: rmdir d10/d24/d46/dd4 0 2024-01-17T23:47:08.846 INFO:tasks.workunit.client.0.smithi067.stdout:0/851: symlink d3/d5/l136 0 2024-01-17T23:47:08.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/852: write d3/d6/dd/dc4/ff4 [833257,31858] 0 2024-01-17T23:47:09.951 INFO:tasks.workunit.client.0.smithi067.stdout:0/853: mknod d3/d5/d1a/d1c/c137 0 2024-01-17T23:47:10.799 INFO:tasks.workunit.client.0.smithi067.stdout:0/854: symlink d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/l138 0 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:7/814: sync 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:9/785: sync 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:1/798: sync 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/814: sync 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/815: chown d0/d13/d1a/d38 395752 1 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/816: fsync d0/d17/f5f 0 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/817: fdatasync d0/d12/d1b/f1d 0 2024-01-17T23:47:10.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/818: creat d0/d34/d35/d57/ffd x:0 0 0 2024-01-17T23:47:10.823 INFO:tasks.workunit.client.0.smithi067.stdout:3/819: dwrite d0/f14 [4194304,4194304] 0 2024-01-17T23:47:10.836 INFO:tasks.workunit.client.0.smithi067.stdout:3/820: write d0/d34/ff3 [4022287,45986] 0 2024-01-17T23:47:11.056 INFO:tasks.workunit.client.0.smithi067.stdout:5/742: dwrite d10/d24/d25/d5c/d7e/d7f/fc9 [0,4194304] 0 2024-01-17T23:47:11.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/815: creat d4/ffc x:0 0 0 2024-01-17T23:47:11.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/786: link d3/d6/da4/c1a d3/d6/d11/d50/d84/da8/d6a/d103/c117 0 2024-01-17T23:47:11.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/787: dread - d3/d6/d2a/da2/dbd/fff zero size 2024-01-17T23:47:12.202 INFO:tasks.workunit.client.0.smithi067.stdout:5/743: creat d10/ff0 x:0 0 0 2024-01-17T23:47:12.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/785: rename d5/d1f/d2a/c9e to d5/d1f/d2a/d54/d39/c116 0 2024-01-17T23:47:12.202 INFO:tasks.workunit.client.0.smithi067.stdout:2/786: dread - d5/d1f/d2a/d54/d8/d32/fd1 zero size 2024-01-17T23:47:12.231 INFO:tasks.workunit.client.0.smithi067.stdout:2/787: dwrite d5/d1f/d2a/d54/d8/d4c/f5f [0,4194304] 0 2024-01-17T23:47:12.780 INFO:tasks.workunit.client.0.smithi067.stdout:0/855: unlink d3/d5/d1a/d1c/l5c 0 2024-01-17T23:47:13.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/816: symlink d4/d4b/d7f/d82/lfd 0 2024-01-17T23:47:13.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/817: stat d4/d25/f90 0 2024-01-17T23:47:13.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/818: dread d4/f6 [4194304,4194304] 0 2024-01-17T23:47:13.035 INFO:tasks.workunit.client.0.smithi067.stdout:7/819: stat d4/d25/d39/d46/d78/d93/d94/fba 0 2024-01-17T23:47:13.484 INFO:tasks.workunit.client.0.smithi067.stdout:6/839: rename d6/d9/d30/l6b to d6/d9/ddf/l11b 0 2024-01-17T23:47:13.515 INFO:tasks.workunit.client.0.smithi067.stdout:6/840: dwrite d6/d9/d1c/d1e/d7e/f8c [0,4194304] 0 2024-01-17T23:47:13.515 INFO:tasks.workunit.client.0.smithi067.stdout:6/841: chown d6/d18/d2e/d7c/f11a 1 1 2024-01-17T23:47:13.544 INFO:tasks.workunit.client.0.smithi067.stdout:6/842: dwrite d6/d9/d1c/d1e/d43/f8b [4194304,4194304] 0 2024-01-17T23:47:13.590 INFO:tasks.workunit.client.0.smithi067.stdout:2/788: creat d5/d1f/d2a/de1/f117 x:0 0 0 2024-01-17T23:47:13.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/744: write d10/d24/d59/d5d/f95 [1773031,26091] 0 2024-01-17T23:47:13.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/745: dread - d10/d24/d46/d4a/fd7 zero size 2024-01-17T23:47:13.619 INFO:tasks.workunit.client.0.smithi067.stdout:3/821: dwrite d0/d13/d1a/fb5 [0,4194304] 0 2024-01-17T23:47:13.813 INFO:tasks.workunit.client.0.smithi067.stdout:0/856: link d3/d6/dd/c57 d3/d5/d122/d9f/c139 0 2024-01-17T23:47:13.908 INFO:tasks.workunit.client.0.smithi067.stdout:9/788: getdents d3/d6/d2a/d34/d42/d9c 0 2024-01-17T23:47:14.141 INFO:tasks.workunit.client.0.smithi067.stdout:4/801: rename d3/d26/caa to d3/d4e/dee/d20/d3b/d7c/d92/c100 0 2024-01-17T23:47:14.142 INFO:tasks.workunit.client.0.smithi067.stdout:4/802: fsync d3/fc3 0 2024-01-17T23:47:14.471 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:48:02.689 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.475 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:48:02.692 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.518 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:48:02.831 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.523 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:48:02.835 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.529 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:48:02.841 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.529 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:48:02.842 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.539 INFO:tasks.workunit.client.0.smithi067.stdout:2/789: symlink d5/d1f/d16/d61/d112/l118 0 2024-01-17T23:47:14.539 INFO:tasks.workunit.client.0.smithi067.stdout:6/843: mkdir d6/d81/dc7/d11c 0 2024-01-17T23:47:14.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/790: readlink d5/d1f/d2a/d54/d8/d32/d9c/l3a 0 2024-01-17T23:47:14.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/791: chown d5/d86/cc3 0 1 2024-01-17T23:47:14.554 INFO:tasks.workunit.client.0.smithi067.stdout:2/792: dread d5/d1f/d2a/d54/d7c/fcb [4194304,4194304] 0 2024-01-17T23:47:14.574 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:48:02.792 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.664 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:48:02.977 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.667 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:48:02.979 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:47:14.865 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:14.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:15.017 INFO:tasks.workunit.client.0.smithi067.stdout:5/746: truncate d10/d24/d46/f54 3894695 0 2024-01-17T23:47:15.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/822: mkdir d0/d12/d1b/d4d/dfe 0 2024-01-17T23:47:15.017 INFO:tasks.workunit.client.0.smithi067.stdout:3/823: dread - d0/d12/d1b/d4d/ff8 zero size 2024-01-17T23:47:15.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/820: truncate d4/f27 660982 0 2024-01-17T23:47:15.040 INFO:tasks.workunit.client.0.smithi067.stdout:0/857: mkdir d3/d4c/d13a 0 2024-01-17T23:47:15.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/789: mknod d3/d6/d47/d88/dc2/c118 0 2024-01-17T23:47:15.041 INFO:tasks.workunit.client.0.smithi067.stdout:9/790: chown d3/d6/d2a/d34/d42/f4d 9886 1 2024-01-17T23:47:15.041 INFO:tasks.workunit.client.0.smithi067.stdout:9/791: creat d3/d25/d5d/d79/f119 x:0 0 0 2024-01-17T23:47:15.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/852: rename d6/d19/dcf/ce9 to d6/d26/d56/dbb/dfd/c121 0 2024-01-17T23:47:15.058 INFO:tasks.workunit.client.0.smithi067.stdout:5/747: dwrite d10/d24/d25/d5c/d7e/fd9 [0,4194304] 0 2024-01-17T23:47:15.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/821: dwrite d4/d25/d39/d46/d78/d93/d94/fb9 [0,4194304] 0 2024-01-17T23:47:15.085 INFO:tasks.workunit.client.0.smithi067.stdout:7/822: dwrite f1 [0,4194304] 0 2024-01-17T23:47:15.237 INFO:tasks.workunit.client.0.smithi067.stdout:2/793: rmdir d5/d1f/d98/ded/d10b 0 2024-01-17T23:47:15.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/794: dwrite d5/d1f/d2a/d55/f99 [0,4194304] 0 2024-01-17T23:47:15.265 INFO:tasks.workunit.client.0.smithi067.stdout:2/795: read f4 [2662565,9231] 0 2024-01-17T23:47:15.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/824: creat d0/d17/dc8/dae/df6/fff x:0 0 0 2024-01-17T23:47:15.673 INFO:tasks.workunit.client.0.smithi067.stdout:0/858: symlink d3/d5/d1a/d90/l13b 0 2024-01-17T23:47:15.994 INFO:tasks.workunit.client.0.smithi067.stdout:9/792: unlink d3/d6/da4/c21 0 2024-01-17T23:47:16.167 INFO:tasks.workunit.client.0.smithi067.stdout:8/853: chown d6/d26/d56/dd5/ffc 1726 1 2024-01-17T23:47:16.610 INFO:tasks.workunit.client.0.smithi067.stdout:5/748: mknod d10/d24/d46/d4a/d63/cf1 0 2024-01-17T23:47:17.017 INFO:tasks.workunit.client.0.smithi067.stdout:6/844: mknod d6/d9/de1/c11d 0 2024-01-17T23:47:17.017 INFO:tasks.workunit.client.0.smithi067.stdout:6/845: write d6/d9/d30/fc2 [1041205,18509] 0 2024-01-17T23:47:17.234 INFO:tasks.workunit.client.0.smithi067.stdout:3/825: symlink d0/d34/d35/d65/l100 0 2024-01-17T23:47:17.235 INFO:tasks.workunit.client.0.smithi067.stdout:3/826: readlink d0/d17/dc8/la5 0 2024-01-17T23:47:17.235 INFO:tasks.workunit.client.0.smithi067.stdout:3/827: chown d0/d17/dc8/dae/fe8 1913082 1 2024-01-17T23:47:17.421 INFO:tasks.workunit.client.0.smithi067.stdout:0/859: mkdir d3/d5/d1a/d1c/d4e/d6b/d13c 0 2024-01-17T23:47:17.455 INFO:tasks.workunit.client.0.smithi067.stdout:0/860: dwrite d3/d5/d1a/d1c/d4e/d6b/f8f [0,4194304] 0 2024-01-17T23:47:17.455 INFO:tasks.workunit.client.0.smithi067.stdout:0/861: fsync d3/d6/f17 0 2024-01-17T23:47:17.605 INFO:tasks.workunit.client.0.smithi067.stdout:1/799: rename d0/d7/d13/d3a/d3e/f57 to d0/d69/f106 0 2024-01-17T23:47:17.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/854: creat d6/d19/dcf/f122 x:0 0 0 2024-01-17T23:47:17.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/855: dread - d6/d19/db4/dde/d11e/f10f zero size 2024-01-17T23:47:17.952 INFO:tasks.workunit.client.0.smithi067.stdout:5/749: creat d10/d24/d46/d4a/d63/ff2 x:0 0 0 2024-01-17T23:47:18.107 INFO:tasks.workunit.client.0.smithi067.stdout:6/846: truncate d6/d9/d1c/d1e/d43/f9f 127086 0 2024-01-17T23:47:18.108 INFO:tasks.workunit.client.0.smithi067.stdout:6/847: fdatasync d6/d18/fec 0 2024-01-17T23:47:18.133 INFO:tasks.workunit.client.0.smithi067.stdout:6/848: dwrite d6/d9/d1c/d1e/f7f [0,4194304] 0 2024-01-17T23:47:18.173 INFO:tasks.workunit.client.0.smithi067.stdout:2/796: unlink d5/d1f/d2a/de1/f117 0 2024-01-17T23:47:18.173 INFO:tasks.workunit.client.0.smithi067.stdout:2/797: fsync d5/d1f/d2a/d73/d95/fa8 0 2024-01-17T23:47:19.422 INFO:tasks.workunit.client.0.smithi067.stdout:4/803: mkdir d3/d4e/dee/d20/d101 0 2024-01-17T23:47:19.636 INFO:tasks.workunit.client.0.smithi067.stdout:7/823: rename d4/d25/d39/d46/da8/db0/ce6 to d4/d25/cfe 0 2024-01-17T23:47:19.843 INFO:tasks.workunit.client.0.smithi067.stdout:1/800: creat d0/d62/f107 x:0 0 0 2024-01-17T23:47:19.876 INFO:tasks.workunit.client.0.smithi067.stdout:1/801: dwrite d0/d62/f65 [0,4194304] 0 2024-01-17T23:47:20.080 INFO:tasks.workunit.client.0.smithi067.stdout:8/856: mknod d6/d26/d56/dbb/dfd/d5f/c123 0 2024-01-17T23:47:20.310 INFO:tasks.workunit.client.0.smithi067.stdout:5/750: mkdir d10/d24/d59/d8c/dba/df3 0 2024-01-17T23:47:20.314 INFO:tasks.workunit.client.0.smithi067.stdout:5/751: read d10/d24/d46/f7c [204081,95730] 0 2024-01-17T23:47:20.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/849: getdents d6/d9/d1c/d1e/d43/def/d51 0 2024-01-17T23:47:20.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/850: stat d6/d9/d1c/d1e/d43/d78 0 2024-01-17T23:47:20.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/851: write d6/d9/d1c/d1e/d43/d78/dab/fc1 [886648,121673] 0 2024-01-17T23:47:20.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/852: write d6/d9/d3e/f92 [423807,76205] 0 2024-01-17T23:47:20.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/853: write d6/d9/d1c/f96 [1516819,107919] 0 2024-01-17T23:47:20.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/854: truncate d6/d9/d3e/fe2 207473 0 2024-01-17T23:47:20.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/855: write d6/d9/de1/f111 [775403,95168] 0 2024-01-17T23:47:21.129 INFO:tasks.workunit.client.0.smithi067.stdout:2/798: mkdir d5/d1f/d16/d61/d112/d119 0 2024-01-17T23:47:21.129 INFO:tasks.workunit.client.0.smithi067.stdout:2/799: readlink d5/d1f/d16/d61/d112/l118 0 2024-01-17T23:47:21.467 INFO:tasks.workunit.client.0.smithi067.stdout:4/804: link d3/d4e/dee/f54 d3/d8/d35/db0/f102 0 2024-01-17T23:47:21.598 INFO:tasks.workunit.client.0.smithi067.stdout:9/793: rename d3/d6/d11/d50/d84/da8/f74 to d3/d6/d47/d88/f11a 0 2024-01-17T23:47:21.817 INFO:tasks.workunit.client.0.smithi067.stdout:7/824: truncate d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f8e 3734844 0 2024-01-17T23:47:22.344 INFO:tasks.workunit.client.0.smithi067.stdout:5/752: getdents d10/d24/d59/d8c/dae 0 2024-01-17T23:47:22.573 INFO:tasks.workunit.client.0.smithi067.stdout:6/856: unlink d6/d9/d30/d4c/d82/cd2 0 2024-01-17T23:47:22.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/800: mkdir d5/d1f/d2a/d54/d8/d11a 0 2024-01-17T23:47:22.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/801: truncate d5/d2f/f115 994333 0 2024-01-17T23:47:23.045 INFO:tasks.workunit.client.0.smithi067.stdout:4/805: symlink d3/d5/l103 0 2024-01-17T23:47:23.658 INFO:tasks.workunit.client.0.smithi067.stdout:7/825: getdents d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca 0 2024-01-17T23:47:23.667 INFO:tasks.workunit.client.0.smithi067.stdout:0/862: write d3/d64/f95 [2035665,87613] 0 2024-01-17T23:47:23.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/828: sync 2024-01-17T23:47:23.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/829: stat d0/d12/d1b/f26 0 2024-01-17T23:47:23.815 INFO:tasks.workunit.client.0.smithi067.stdout:3/830: dread d0/d34/d35/d65/d6f/fe9 [0,4194304] 0 2024-01-17T23:47:23.862 INFO:tasks.workunit.client.0.smithi067.stdout:5/753: rmdir d10/d24/d59/d8c 39 2024-01-17T23:47:23.868 INFO:tasks.workunit.client.0.smithi067.stdout:5/754: write d10/d24/d25/d5c/d7e/de4/fc8 [238310,116977] 0 2024-01-17T23:47:23.868 INFO:tasks.workunit.client.0.smithi067.stdout:5/755: dread - d10/d53/fd0 zero size 2024-01-17T23:47:24.607 INFO:tasks.workunit.client.0.smithi067.stdout:2/802: truncate d5/d1f/d2a/d55/fba 1112866 0 2024-01-17T23:47:24.608 INFO:tasks.workunit.client.0.smithi067.stdout:2/803: chown d5/d1f/d35/f3b 28 1 2024-01-17T23:47:25.563 INFO:tasks.workunit.client.0.smithi067.stdout:0/863: dwrite d3/d5/d1a/f2c [0,4194304] 0 2024-01-17T23:47:25.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/831: dread d0/f2a [4194304,4194304] 0 2024-01-17T23:47:25.748 INFO:tasks.workunit.client.0.smithi067.stdout:3/832: readlink d0/d12/d1b/l49 0 2024-01-17T23:47:25.812 INFO:tasks.workunit.client.0.smithi067.stdout:5/756: truncate d10/f1c 2637482 0 2024-01-17T23:47:26.095 INFO:tasks.workunit.client.0.smithi067.stdout:2/804: dread d5/d1f/d2a/d54/d8/fce [0,4194304] 0 2024-01-17T23:47:26.095 INFO:tasks.workunit.client.0.smithi067.stdout:2/805: readlink d5/d1f/d35/l8b 0 2024-01-17T23:47:26.108 INFO:tasks.workunit.client.0.smithi067.stdout:2/806: dread d5/d1f/d98/d9f/dbb/fdc [0,4194304] 0 2024-01-17T23:47:26.108 INFO:tasks.workunit.client.0.smithi067.stdout:2/807: chown d5/d1f/d2a/d54/d8/d4c/db3/lfa 415 1 2024-01-17T23:47:26.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/857: dwrite d6/d19/d22/d25/d53/d65/f23 [0,4194304] 0 2024-01-17T23:47:26.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/858: chown d6/l40 0 1 2024-01-17T23:47:26.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/859: write d6/d26/d3e/d87/f94 [1112072,69273] 0 2024-01-17T23:47:26.700 INFO:tasks.workunit.client.0.smithi067.stdout:3/833: link d0/d37/l41 d0/de1/d75/l101 0 2024-01-17T23:47:26.700 INFO:tasks.workunit.client.0.smithi067.stdout:3/834: dread - d0/d13/d1a/fc9 zero size 2024-01-17T23:47:26.937 INFO:tasks.workunit.client.0.smithi067.stdout:5/757: truncate d10/d24/d46/fb9 266252 0 2024-01-17T23:47:27.043 INFO:tasks.workunit.client.0.smithi067.stdout:4/806: truncate d3/d26/d34/d3a/d53/fb3 2185817 0 2024-01-17T23:47:27.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/807: dwrite d3/d5/fde [0,4194304] 0 2024-01-17T23:47:27.082 INFO:tasks.workunit.client.0.smithi067.stdout:4/808: dread - d3/d26/d34/d65/f86 zero size 2024-01-17T23:47:27.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/808: link d5/d1f/d2a/d54/d8/d4c/dbf/ld2 d5/d1f/d98/d9f/l11b 0 2024-01-17T23:47:27.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/809: chown d5/d1f/d2a/d73/f83 12 1 2024-01-17T23:47:27.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/810: stat d5/d1f/d2a/d54/d8/d32/f9b 0 2024-01-17T23:47:27.278 INFO:tasks.workunit.client.0.smithi067.stdout:8/860: rename d6/d19/db4/fe2 to d6/d93/f124 0 2024-01-17T23:47:27.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/861: dwrite d6/d26/d56/dbb/ff5 [0,4194304] 0 2024-01-17T23:47:27.333 INFO:tasks.workunit.client.0.smithi067.stdout:8/862: dwrite d6/d19/d22/dec/f105 [0,4194304] 0 2024-01-17T23:47:27.350 INFO:tasks.workunit.client.0.smithi067.stdout:8/863: dread d6/db/f55 [0,4194304] 0 2024-01-17T23:47:27.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/758: symlink d10/d24/d46/d4a/d63/d85/lf4 0 2024-01-17T23:47:27.846 INFO:tasks.workunit.client.0.smithi067.stdout:4/809: link d3/d5/d93/dcd/le9 d3/d4e/dee/d20/d3b/d7c/l104 0 2024-01-17T23:47:28.681 INFO:tasks.workunit.client.0.smithi067.stdout:8/864: link c3 d6/d26/d7c/df8/dfb/c125 0 2024-01-17T23:47:28.681 INFO:tasks.workunit.client.0.smithi067.stdout:8/865: chown d6/d26/d56/c5b 1 1 2024-01-17T23:47:28.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/866: dread d6/f1a [0,4194304] 0 2024-01-17T23:47:28.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/867: dread - d6/d93/fcd zero size 2024-01-17T23:47:28.723 INFO:tasks.workunit.client.0.smithi067.stdout:8/868: dwrite d6/d93/f116 [0,4194304] 0 2024-01-17T23:47:28.800 INFO:tasks.workunit.client.0.smithi067.stdout:5/759: unlink d10/d24/d25/d5c/la3 0 2024-01-17T23:47:29.148 INFO:tasks.workunit.client.0.smithi067.stdout:4/810: rmdir d3/d26 39 2024-01-17T23:47:29.281 INFO:tasks.workunit.client.0.smithi067.stdout:0/864: creat d3/d5/d1a/f13d x:0 0 0 2024-01-17T23:47:29.282 INFO:tasks.workunit.client.0.smithi067.stdout:0/865: dread - d3/d5/f45 zero size 2024-01-17T23:47:29.509 INFO:tasks.workunit.client.0.smithi067.stdout:9/794: rmdir d3/d6/da4 39 2024-01-17T23:47:29.509 INFO:tasks.workunit.client.0.smithi067.stdout:9/795: chown d3/d25/d5d/l61 12747 1 2024-01-17T23:47:29.830 INFO:tasks.workunit.client.0.smithi067.stdout:8/869: creat d6/d26/d56/dbb/dfd/d5f/f126 x:0 0 0 2024-01-17T23:47:29.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/760: creat d10/d24/d25/d5c/d7e/ff5 x:0 0 0 2024-01-17T23:47:29.830 INFO:tasks.workunit.client.0.smithi067.stdout:8/870: write d6/d19/dcf/f104 [696208,82744] 0 2024-01-17T23:47:29.844 INFO:tasks.workunit.client.0.smithi067.stdout:7/826: write d4/d25/d39/d46/d78/f86 [1891526,82485] 0 2024-01-17T23:47:29.859 INFO:tasks.workunit.client.0.smithi067.stdout:8/871: dwrite d6/d26/d3e/d6c/ff0 [0,4194304] 0 2024-01-17T23:47:30.189 INFO:tasks.workunit.client.0.smithi067.stdout:0/866: mknod d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d115/c13e 0 2024-01-17T23:47:30.190 INFO:tasks.workunit.client.0.smithi067.stdout:0/867: chown d3/d5/d122/d9f/l10e 1 1 2024-01-17T23:47:30.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/796: rename d3/d6/d11/d50/l2f to d3/d58/l11b 0 2024-01-17T23:47:30.397 INFO:tasks.workunit.client.0.smithi067.stdout:1/802: symlink d0/l108 0 2024-01-17T23:47:30.397 INFO:tasks.workunit.client.0.smithi067.stdout:1/803: chown d0/d7/d13/d3a/d45 15 1 2024-01-17T23:47:30.428 INFO:tasks.workunit.client.0.smithi067.stdout:1/804: dwrite d0/d7/d13/d3d/dd0/fe0 [0,4194304] 0 2024-01-17T23:47:30.437 INFO:tasks.workunit.client.0.smithi067.stdout:5/761: readlink d10/d24/d59/d5d/lbb 0 2024-01-17T23:47:30.437 INFO:tasks.workunit.client.0.smithi067.stdout:5/762: truncate d10/d24/d25/d5c/d7e/d7f/f98 138201 0 2024-01-17T23:47:30.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/763: chown fa 851 1 2024-01-17T23:47:30.470 INFO:tasks.workunit.client.0.smithi067.stdout:5/764: dwrite d10/d24/db4/fde [0,4194304] 0 2024-01-17T23:47:30.470 INFO:tasks.workunit.client.0.smithi067.stdout:5/765: fdatasync d10/d24/d25/d5c/fcd 0 2024-01-17T23:47:30.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/766: dwrite d10/d24/d25/d5c/d7e/d7f/fc9 [4194304,4194304] 0 2024-01-17T23:47:30.534 INFO:tasks.workunit.client.0.smithi067.stdout:7/827: mkdir d4/d25/d39/d46/da8/db0/dff 0 2024-01-17T23:47:31.364 INFO:tasks.workunit.client.0.smithi067.stdout:0/868: mkdir d3/d6/dd/d13f 0 2024-01-17T23:47:31.388 INFO:tasks.workunit.client.0.smithi067.stdout:0/869: write d3/d75/fd7 [1867921,91439] 0 2024-01-17T23:47:31.420 INFO:tasks.workunit.client.0.smithi067.stdout:0/870: dwrite d3/d64/d82/ff7 [0,4194304] 0 2024-01-17T23:47:31.421 INFO:tasks.workunit.client.0.smithi067.stdout:0/871: write d3/d64/f114 [205511,100696] 0 2024-01-17T23:47:31.431 INFO:tasks.workunit.client.0.smithi067.stdout:0/872: dread d3/d6/f55 [0,4194304] 0 2024-01-17T23:47:31.587 INFO:tasks.workunit.client.0.smithi067.stdout:9/797: link d3/d6/d11/c5a d3/d6/d2a/d34/c11c 0 2024-01-17T23:47:31.587 INFO:tasks.workunit.client.0.smithi067.stdout:9/798: fdatasync d3/d6/d11/d50/d84/fa0 0 2024-01-17T23:47:32.337 INFO:tasks.workunit.client.0.smithi067.stdout:5/767: symlink d10/d24/d59/lf6 0 2024-01-17T23:47:32.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/768: dread - d10/d24/d46/d4a/fec zero size 2024-01-17T23:47:32.378 INFO:tasks.workunit.client.0.smithi067.stdout:3/835: dwrite d0/de1/d55/f73 [0,4194304] 0 2024-01-17T23:47:32.378 INFO:tasks.workunit.client.0.smithi067.stdout:3/836: fsync d0/de1/d82/da6/fe2 0 2024-01-17T23:47:32.505 INFO:tasks.workunit.client.0.smithi067.stdout:7/828: rename d4/d25/d39/d46/d78/d93/d94/dc4/f58 to d4/d25/d39/d79/f100 0 2024-01-17T23:47:32.505 INFO:tasks.workunit.client.0.smithi067.stdout:2/811: write d5/d1f/d2a/d54/d8/d4c/d84/f8c [5943020,24710] 0 2024-01-17T23:47:32.528 INFO:tasks.workunit.client.0.smithi067.stdout:2/812: write d5/d2f/f4b [3392321,91050] 0 2024-01-17T23:47:32.546 INFO:tasks.workunit.client.0.smithi067.stdout:2/813: dread d5/d1f/d2a/d54/d39/fdb [0,4194304] 0 2024-01-17T23:47:32.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/873: mkdir d3/d6/dd/d13f/d140 0 2024-01-17T23:47:32.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/874: chown d3/dbf/lf2 14 1 2024-01-17T23:47:32.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/875: chown d3/d5/d122/d7f 10 1 2024-01-17T23:47:32.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/876: stat d3/d5/d1a/d1c 0 2024-01-17T23:47:32.935 INFO:tasks.workunit.client.0.smithi067.stdout:0/877: dwrite d3/d6/dd/fd1 [0,4194304] 0 2024-01-17T23:47:33.113 INFO:tasks.workunit.client.0.smithi067.stdout:9/799: truncate d3/d6/d11/d50/f43 1341373 0 2024-01-17T23:47:33.113 INFO:tasks.workunit.client.0.smithi067.stdout:9/800: fsync d3/d6/d11/d50/fcd 0 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi067.stdout:3/837: mkdir d0/de1/d82/da6/d102 0 2024-01-17T23:47:34.135 INFO:tasks.workunit.client.0.smithi067.stdout:3/838: write d0/d12/d1b/d4d/fb9 [1078547,56183] 0 2024-01-17T23:47:34.897 INFO:tasks.workunit.client.0.smithi067.stdout:0/878: rename d3/dbf/f11c to d3/d6/dd/d107/f141 0 2024-01-17T23:47:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:9/801: mkdir d3/d6/da4/d55/d115/d11d 0 2024-01-17T23:47:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:4/811: write d3/d5/fc [40322,62857] 0 2024-01-17T23:47:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:4/812: chown d3/d4e/c9d 12657518 1 2024-01-17T23:47:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:4/813: getdents d3/d40/dc8 0 2024-01-17T23:47:34.918 INFO:tasks.workunit.client.0.smithi067.stdout:4/814: chown d3/d4e/dee/d20/fb5 1 1 2024-01-17T23:47:35.243 INFO:tasks.workunit.client.0.smithi067.stdout:5/769: getdents d10/d24/d59/d5d/dce 0 2024-01-17T23:47:35.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/857: sync 2024-01-17T23:47:35.312 INFO:tasks.workunit.client.0.smithi067.stdout:6/858: read d6/fa [7136494,12622] 0 2024-01-17T23:47:35.412 INFO:tasks.workunit.client.0.smithi067.stdout:3/839: unlink d0/d34/d35/d65/d6f/d70/ddc/ffb 0 2024-01-17T23:47:35.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/879: mknod d3/d5/d12c/c142 0 2024-01-17T23:47:35.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/880: readlink d3/d64/lba 0 2024-01-17T23:47:35.706 INFO:tasks.workunit.client.0.smithi067.stdout:0/881: chown d3/d5/d1a/d1c/d4e/d6b/fc7 42489 1 2024-01-17T23:47:35.706 INFO:tasks.workunit.client.0.smithi067.stdout:0/882: write d3/d6/fdc [1881783,97138] 0 2024-01-17T23:47:35.800 INFO:tasks.workunit.client.0.smithi067.stdout:9/802: creat d3/d6/d11/d50/f11e x:0 0 0 2024-01-17T23:47:35.800 INFO:tasks.workunit.client.0.smithi067.stdout:9/803: creat d3/d6/d2a/da2/dbd/f11f x:0 0 0 2024-01-17T23:47:35.815 INFO:tasks.workunit.client.0.smithi067.stdout:9/804: dread d3/d6/d2a/da2/de2/dd0/da6/fd2 [0,4194304] 0 2024-01-17T23:47:35.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/815: link d3/d4e/dee/d20/d3b/ddf/ce1 d3/d4e/dee/d20/d101/c105 0 2024-01-17T23:47:35.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/770: symlink d10/d24/d46/d4a/d63/lf7 0 2024-01-17T23:47:35.987 INFO:tasks.workunit.client.0.smithi067.stdout:5/771: write d10/d24/d59/f67 [3930838,28944] 0 2024-01-17T23:47:36.157 INFO:tasks.workunit.client.0.smithi067.stdout:6/859: rename d6/d9/d30/d58/f108 to d6/d18/d2e/d61/f11e 0 2024-01-17T23:47:36.240 INFO:tasks.workunit.client.0.smithi067.stdout:3/840: creat d0/d34/de3/f103 x:0 0 0 2024-01-17T23:47:36.429 INFO:tasks.workunit.client.0.smithi067.stdout:0/883: truncate d3/d5/d1a/f71 6697624 0 2024-01-17T23:47:36.496 INFO:tasks.workunit.client.0.smithi067.stdout:9/805: mknod d3/d6/d11/d5c/c120 0 2024-01-17T23:47:36.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/872: sync 2024-01-17T23:47:36.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/873: chown d6/d26/d3e/da6 1075211 1 2024-01-17T23:47:36.574 INFO:tasks.workunit.client.0.smithi067.stdout:8/874: dread d6/d26/d7c/fc4 [0,4194304] 0 2024-01-17T23:47:36.585 INFO:tasks.workunit.client.0.smithi067.stdout:8/875: dread d6/d19/d22/d25/d53/d54/f77 [0,4194304] 0 2024-01-17T23:47:36.585 INFO:tasks.workunit.client.0.smithi067.stdout:8/876: truncate d6/d26/d56/dbb/dfd/d5f/f126 358508 0 2024-01-17T23:47:36.585 INFO:tasks.workunit.client.0.smithi067.stdout:8/877: stat d6/d19/d22/dec/f105 0 2024-01-17T23:47:36.663 INFO:tasks.workunit.client.0.smithi067.stdout:4/816: mknod d3/d4e/dee/d20/d3b/c106 0 2024-01-17T23:47:36.695 INFO:tasks.workunit.client.0.smithi067.stdout:4/817: dwrite d3/d4e/dee/f54 [0,4194304] 0 2024-01-17T23:47:36.851 INFO:tasks.workunit.client.0.smithi067.stdout:5/772: link d10/d24/db4/fbf d10/d24/d25/d5c/d7e/d7f/d92/ff8 0 2024-01-17T23:47:37.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/841: rename d0/d37/c83 to d0/d37/c104 0 2024-01-17T23:47:37.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/842: write d0/d13/d1a/fc9 [100796,72359] 0 2024-01-17T23:47:37.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/806: creat d3/d6/da4/dba/f121 x:0 0 0 2024-01-17T23:47:37.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/807: readlink d3/d6/da4/d55/l7c 0 2024-01-17T23:47:37.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/805: sync 2024-01-17T23:47:37.911 INFO:tasks.workunit.client.0.smithi067.stdout:1/806: chown d0/d7/d13/d3d/dd0/fe0 57794 1 2024-01-17T23:47:37.911 INFO:tasks.workunit.client.0.smithi067.stdout:1/807: truncate d0/d7/d13/f50 4367262 0 2024-01-17T23:47:37.911 INFO:tasks.workunit.client.0.smithi067.stdout:1/808: creat d0/d7/d13/d77/f109 x:0 0 0 2024-01-17T23:47:38.203 INFO:tasks.workunit.client.0.smithi067.stdout:4/818: rmdir d3/d8/d35 39 2024-01-17T23:47:38.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/819: write d3/d8/d35/f3c [210154,108634] 0 2024-01-17T23:47:38.916 INFO:tasks.workunit.client.0.smithi067.stdout:3/843: mkdir d0/de1/d75/d105 0 2024-01-17T23:47:38.916 INFO:tasks.workunit.client.0.smithi067.stdout:3/844: chown d0/d13/d1a/d38/lfa 930883306 1 2024-01-17T23:47:39.250 INFO:tasks.workunit.client.0.smithi067.stdout:9/808: getdents d3/d6 0 2024-01-17T23:47:39.421 INFO:tasks.workunit.client.0.smithi067.stdout:4/820: write d3/d26/fa9 [146555,51583] 0 2024-01-17T23:47:39.792 INFO:tasks.workunit.client.0.smithi067.stdout:3/845: creat d0/d34/d35/d65/f106 x:0 0 0 2024-01-17T23:47:39.792 INFO:tasks.workunit.client.0.smithi067.stdout:3/846: write d0/d34/d35/d57/ffd [363140,43887] 0 2024-01-17T23:47:40.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/809: unlink d3/d6/d2a/d34/f45 0 2024-01-17T23:47:40.071 INFO:tasks.workunit.client.0.smithi067.stdout:4/821: mknod d3/d4e/dee/d20/c107 0 2024-01-17T23:47:40.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/810: write d3/d6/d47/d88/f10e [778026,7910] 0 2024-01-17T23:47:40.242 INFO:tasks.workunit.client.0.smithi067.stdout:7/829: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/f4d [0,4194304] 0 2024-01-17T23:47:40.462 INFO:tasks.workunit.client.0.smithi067.stdout:2/814: sync 2024-01-17T23:47:40.463 INFO:tasks.workunit.client.0.smithi067.stdout:2/815: dread - d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/f108 zero size 2024-01-17T23:47:40.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/816: dwrite d5/d1f/d16/fc7 [0,4194304] 0 2024-01-17T23:47:40.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/817: write d5/d1f/d2a/d54/ff3 [816270,89381] 0 2024-01-17T23:47:40.809 INFO:tasks.workunit.client.0.smithi067.stdout:9/811: unlink d3/d6/d11/d5c/l75 0 2024-01-17T23:47:41.431 INFO:tasks.workunit.client.0.smithi067.stdout:9/812: truncate d3/d6/f9f 2087166 0 2024-01-17T23:47:41.431 INFO:tasks.workunit.client.0.smithi067.stdout:9/813: chown d3/d25/d5d 3243 1 2024-01-17T23:47:41.458 INFO:tasks.workunit.client.0.smithi067.stdout:9/814: dwrite d3/d6/d11/d50/d84/fa0 [0,4194304] 0 2024-01-17T23:47:41.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/815: symlink d3/d6/da4/dba/l122 0 2024-01-17T23:47:41.972 INFO:tasks.workunit.client.0.smithi067.stdout:0/884: dread d3/d5/d122/f41 [0,4194304] 0 2024-01-17T23:47:42.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/860: dwrite d6/d18/f2a [0,4194304] 0 2024-01-17T23:47:42.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/861: dread d6/fd [0,4194304] 0 2024-01-17T23:47:42.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/862: write d6/f88 [5769137,90078] 0 2024-01-17T23:47:42.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/863: dread - d6/d81/dc7/f109 zero size 2024-01-17T23:47:42.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/864: fsync d6/fd 0 2024-01-17T23:47:42.305 INFO:tasks.workunit.client.0.smithi067.stdout:9/816: unlink d3/d6/da4/d55/da1/ce9 0 2024-01-17T23:47:42.320 INFO:tasks.workunit.client.0.smithi067.stdout:9/817: dread d3/d6/d2e/fe5 [4194304,4194304] 0 2024-01-17T23:47:42.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/885: mkdir d3/d6/dd/d107/d143 0 2024-01-17T23:47:42.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/886: write d3/d6/dd/dc4/ff4 [2371881,74598] 0 2024-01-17T23:47:43.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/878: sync 2024-01-17T23:47:43.057 INFO:tasks.workunit.client.0.smithi067.stdout:8/879: write d6/d19/d22/f4f [630021,84716] 0 2024-01-17T23:47:44.041 INFO:tasks.workunit.client.0.smithi067.stdout:1/809: dwrite d0/fa5 [0,4194304] 0 2024-01-17T23:47:44.041 INFO:tasks.workunit.client.0.smithi067.stdout:1/810: write d0/d74/f8c [4408921,127466] 0 2024-01-17T23:47:44.301 INFO:tasks.workunit.client.0.smithi067.stdout:4/822: dwrite d3/d4e/fd6 [0,4194304] 0 2024-01-17T23:47:44.313 INFO:tasks.workunit.client.0.smithi067.stdout:4/823: dread d3/d4e/dee/f54 [0,4194304] 0 2024-01-17T23:47:44.450 INFO:tasks.workunit.client.0.smithi067.stdout:5/773: creat d10/d24/d46/ff9 x:0 0 0 2024-01-17T23:47:44.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/818: symlink d5/d1f/l11c 0 2024-01-17T23:47:44.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/819: write d5/d1f/d2a/d54/d8/f45 [984970,75455] 0 2024-01-17T23:47:44.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/820: creat d5/d1f/d2a/de1/f11d x:0 0 0 2024-01-17T23:47:44.475 INFO:tasks.workunit.client.0.smithi067.stdout:2/821: dwrite d5/d1f/d2a/d54/d8/db5/fd3 [0,4194304] 0 2024-01-17T23:47:44.858 INFO:tasks.workunit.client.0.smithi067.stdout:1/811: symlink d0/d7/d13/d3a/d75/da1/de8/l10a 0 2024-01-17T23:47:44.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:44.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:47:45.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/865: dwrite d6/d9/d3e/fe2 [0,4194304] 0 2024-01-17T23:47:45.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/866: chown d6/d9/de1/c114 6 1 2024-01-17T23:47:45.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/867: chown d6/d9/d30/d4c/d8d/f107 2064568 1 2024-01-17T23:47:45.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/868: dread - d6/d9/d1c/d1e/d43/def/d51/feb zero size 2024-01-17T23:47:45.220 INFO:tasks.workunit.client.0.smithi067.stdout:4/824: creat d3/d4e/dee/df8/f108 x:0 0 0 2024-01-17T23:47:45.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/830: unlink d4/d25/d39/d46/c64 0 2024-01-17T23:47:45.382 INFO:tasks.workunit.client.0.smithi067.stdout:9/818: write d3/d58/fd3 [1102519,84959] 0 2024-01-17T23:47:45.400 INFO:tasks.workunit.client.0.smithi067.stdout:7/831: dread d4/d25/d39/d46/d78/d93/fa4 [0,4194304] 0 2024-01-17T23:47:45.417 INFO:tasks.workunit.client.0.smithi067.stdout:0/887: dwrite d3/d6/fa2 [0,4194304] 0 2024-01-17T23:47:45.418 INFO:tasks.workunit.client.0.smithi067.stdout:7/832: dread d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/fc2 [0,4194304] 0 2024-01-17T23:47:45.433 INFO:tasks.workunit.client.0.smithi067.stdout:7/833: dread d4/f26 [0,4194304] 0 2024-01-17T23:47:45.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/774: creat d10/d24/d25/d5c/d7e/de4/ffa x:0 0 0 2024-01-17T23:47:45.519 INFO:tasks.workunit.client.0.smithi067.stdout:8/880: dwrite d6/d26/d56/dbb/dfd/d5f/f126 [0,4194304] 0 2024-01-17T23:47:45.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/881: dread d6/d26/d56/dbb/dfd/fbe [0,4194304] 0 2024-01-17T23:47:45.850 INFO:tasks.workunit.client.0.smithi067.stdout:2/822: truncate d5/d1f/d16/faa 2520468 0 2024-01-17T23:47:45.952 INFO:tasks.workunit.client.0.smithi067.stdout:1/812: rmdir d0/d7/d13/d3a/d75 39 2024-01-17T23:47:45.952 INFO:tasks.workunit.client.0.smithi067.stdout:1/813: fsync d0/d7/d13/d3d/dd0/ff0 0 2024-01-17T23:47:45.980 INFO:tasks.workunit.client.0.smithi067.stdout:1/814: dwrite d0/d7/d13/d3a/d75/ded/f79 [12582912,4194304] 0 2024-01-17T23:47:45.980 INFO:tasks.workunit.client.0.smithi067.stdout:1/815: creat d0/d62/f10b x:0 0 0 2024-01-17T23:47:45.980 INFO:tasks.workunit.client.0.smithi067.stdout:1/816: chown d0/d7/d13/d3a/d75/dc3 25592 1 2024-01-17T23:47:46.125 INFO:tasks.workunit.client.0.smithi067.stdout:6/869: creat d6/d9/de1/f11f x:0 0 0 2024-01-17T23:47:46.125 INFO:tasks.workunit.client.0.smithi067.stdout:6/870: chown d6/d18/d2e/d7c/fd7 1 1 2024-01-17T23:47:46.135 INFO:tasks.workunit.client.0.smithi067.stdout:6/871: dread d6/d9/d1c/d1e/d43/d86/fe4 [0,4194304] 0 2024-01-17T23:47:46.135 INFO:tasks.workunit.client.0.smithi067.stdout:6/872: dread - d6/d9/d30/d4c/d8d/fcf zero size 2024-01-17T23:47:46.521 INFO:tasks.workunit.client.0.smithi067.stdout:3/847: sync 2024-01-17T23:47:46.807 INFO:tasks.workunit.client.0.smithi067.stdout:4/825: chown d3/d26/f88 8 1 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/819: mkdir d3/d6/d47/d10a/d123 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/820: write d3/d6/d2e/dc8/fdd [50744,96592] 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/821: readlink d3/d6/da4/l20 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/822: readlink d3/d6/d47/d6d/lf3 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/823: truncate d3/d6/da4/d55/da1/fb3 755886 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/824: write d3/d6/d2a/da2/de2/dd0/fc3 [613511,101530] 0 2024-01-17T23:47:46.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/825: truncate d3/f5 4376228 0 2024-01-17T23:47:46.898 INFO:tasks.workunit.client.0.smithi067.stdout:9/826: write d3/d6/d11/f23 [11315667,64863] 0 2024-01-17T23:47:46.911 INFO:tasks.workunit.client.0.smithi067.stdout:9/827: read d3/d6/da4/d55/da1/dbc/d10f/f110 [901747,49394] 0 2024-01-17T23:47:46.937 INFO:tasks.workunit.client.0.smithi067.stdout:9/828: dwrite d3/d25/d5d/fc0 [0,4194304] 0 2024-01-17T23:47:46.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/829: dwrite d3/d6/da4/dba/f121 [0,4194304] 0 2024-01-17T23:47:46.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/830: write d3/d6/d11/d50/f11e [1000341,75200] 0 2024-01-17T23:47:47.689 INFO:tasks.workunit.client.0.smithi067.stdout:5/775: creat d10/d24/d25/d5c/d7e/d7f/d92/ffb x:0 0 0 2024-01-17T23:47:47.703 INFO:tasks.workunit.client.0.smithi067.stdout:5/776: dread d10/d24/d25/d5c/d7e/f87 [4194304,4194304] 0 2024-01-17T23:47:48.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/882: rename d6/d26/d56/dbb/dfd/d5f/dc0/c8f to d6/d19/db4/dde/d11e/c127 0 2024-01-17T23:47:48.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/883: truncate d6/d19/db4/dde/d11e/f10f 509759 0 2024-01-17T23:47:48.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/823: creat d5/d1f/d2a/d54/d8/d32/f11e x:0 0 0 2024-01-17T23:47:48.536 INFO:tasks.workunit.client.0.smithi067.stdout:2/824: read d5/d1f/d16/fc7 [12888,57431] 0 2024-01-17T23:47:49.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/817: unlink d0/d7/d13/d3a/d75/da1/fd2 0 2024-01-17T23:47:49.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/818: chown d0/d69/c7b 765619 1 2024-01-17T23:47:49.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/819: dwrite d0/d7/d1c/fd1 [0,4194304] 0 2024-01-17T23:47:49.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/820: write d0/ff1 [295392,4508] 0 2024-01-17T23:47:49.157 INFO:tasks.workunit.client.0.smithi067.stdout:4/826: creat d3/d8/d35/f109 x:0 0 0 2024-01-17T23:47:49.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/831: mknod d3/d6/c124 0 2024-01-17T23:47:49.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/832: read - d3/d6/da4/d55/ffb zero size 2024-01-17T23:47:49.967 INFO:tasks.workunit.client.0.smithi067.stdout:5/777: symlink d10/d24/d59/d8c/dba/lfc 0 2024-01-17T23:47:50.095 INFO:tasks.workunit.client.0.smithi067.stdout:6/873: rename d6/d9/d30/d4c/d82/lc4 to d6/d9/d30/d4c/l120 0 2024-01-17T23:47:50.095 INFO:tasks.workunit.client.0.smithi067.stdout:6/874: chown d6/d9/d1c/d1e/d7e/f8c 5392 1 2024-01-17T23:47:50.203 INFO:tasks.workunit.client.0.smithi067.stdout:8/884: mknod d6/d26/d3e/d87/dd8/c128 0 2024-01-17T23:47:50.421 INFO:tasks.workunit.client.0.smithi067.stdout:0/888: write d3/d6/fcf [1210594,33223] 0 2024-01-17T23:47:50.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/821: creat d0/d7/d13/d3a/f10c x:0 0 0 2024-01-17T23:47:50.711 INFO:tasks.workunit.client.0.smithi067.stdout:4/827: link d3/d4e/dee/d20/d3b/f51 d3/d4e/dee/df8/f10a 0 2024-01-17T23:47:50.750 INFO:tasks.workunit.client.0.smithi067.stdout:4/828: dwrite d3/d40/dc8/fd0 [0,4194304] 0 2024-01-17T23:47:51.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/778: mknod d10/d53/cfd 0 2024-01-17T23:47:51.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/779: creat d10/d24/d25/d5c/d7e/d7f/d92/ffe x:0 0 0 2024-01-17T23:47:51.601 INFO:tasks.workunit.client.0.smithi067.stdout:6/875: unlink d6/d9/f94 0 2024-01-17T23:47:51.601 INFO:tasks.workunit.client.0.smithi067.stdout:7/834: sync 2024-01-17T23:47:51.615 INFO:tasks.workunit.client.0.smithi067.stdout:8/885: link d6/d19/dcf/ld7 d6/d19/d22/d25/d53/l129 0 2024-01-17T23:47:51.615 INFO:tasks.workunit.client.0.smithi067.stdout:8/886: dread - d6/d26/d7c/df8/f110 zero size 2024-01-17T23:47:51.866 INFO:tasks.workunit.client.0.smithi067.stdout:0/889: mkdir d3/d5/d1a/d1c/d4e/d6b/d144 0 2024-01-17T23:47:52.612 INFO:tasks.workunit.client.0.smithi067.stdout:1/822: link d0/d7/d13/f50 d0/d7/d13/d77/d95/f10d 0 2024-01-17T23:47:52.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/829: creat d3/d8/d35/f10b x:0 0 0 2024-01-17T23:47:53.086 INFO:tasks.workunit.client.0.smithi067.stdout:5/780: mkdir d10/d24/d25/d5c/d7e/de4/dff 0 2024-01-17T23:47:53.086 INFO:tasks.workunit.client.0.smithi067.stdout:5/781: fdatasync d10/d24/d25/d5c/d7e/fa7 0 2024-01-17T23:47:53.107 INFO:tasks.workunit.client.0.smithi067.stdout:5/782: dread d10/d24/d59/fb3 [0,4194304] 0 2024-01-17T23:47:53.107 INFO:tasks.workunit.client.0.smithi067.stdout:5/783: chown d10/d24/d46/d4a/d50/f89 1 1 2024-01-17T23:47:53.107 INFO:tasks.workunit.client.0.smithi067.stdout:5/784: write d10/d24/d46/d4a/d63/ff2 [244726,21919] 0 2024-01-17T23:47:53.337 INFO:tasks.workunit.client.0.smithi067.stdout:3/848: rename d0/d13/d1a/d38 to d0/d17/dc8/dae/d107 0 2024-01-17T23:47:53.337 INFO:tasks.workunit.client.0.smithi067.stdout:6/876: symlink d6/d9/d1c/l121 0 2024-01-17T23:47:53.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/835: dread d4/f65 [0,4194304] 0 2024-01-17T23:47:53.542 INFO:tasks.workunit.client.0.smithi067.stdout:7/836: chown d4/d25/d39/d46/d78/d93/cc9 268 1 2024-01-17T23:47:53.570 INFO:tasks.workunit.client.0.smithi067.stdout:7/837: dwrite d4/d4b/d7f/d82/f89 [0,4194304] 0 2024-01-17T23:47:53.631 INFO:tasks.workunit.client.0.smithi067.stdout:8/887: symlink d6/d19/d22/l12a 0 2024-01-17T23:47:53.952 INFO:tasks.workunit.client.0.smithi067.stdout:0/890: unlink d3/d5/d1a/d1c/d1d/c30 0 2024-01-17T23:47:53.952 INFO:tasks.workunit.client.0.smithi067.stdout:0/891: getdents d3/d6/dd/d107/d143 0 2024-01-17T23:47:54.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/830: mkdir d3/d4e/dee/d20/d3b/d7c/d92/d10c 0 2024-01-17T23:47:54.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/831: dwrite d3/d4e/dee/d20/d52/f95 [4194304,4194304] 0 2024-01-17T23:47:54.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/785: rename d10/d24/d46/c8a to d10/d24/d25/dd5/c100 0 2024-01-17T23:47:54.555 INFO:tasks.workunit.client.0.smithi067.stdout:2/825: write d5/d1f/d2a/d54/d7c/f82 [994172,107325] 0 2024-01-17T23:47:54.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/849: mknod d0/de1/dd5/c108 0 2024-01-17T23:47:55.104 INFO:tasks.workunit.client.0.smithi067.stdout:8/888: readlink d6/d26/d56/d89/l98 0 2024-01-17T23:47:55.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/889: write d6/db/f55 [103256,6827] 0 2024-01-17T23:47:55.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/890: write d6/d19/dcf/f104 [46822,25303] 0 2024-01-17T23:47:55.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/891: creat d6/d19/d22/d25/d53/d65/f12b x:0 0 0 2024-01-17T23:47:55.131 INFO:tasks.workunit.client.0.smithi067.stdout:8/892: write d6/d19/d22/d25/d53/f7e [4749108,94223] 0 2024-01-17T23:47:55.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/892: creat d3/d5/d1a/d1c/d1d/d2e/d5a/f145 x:0 0 0 2024-01-17T23:47:55.320 INFO:tasks.workunit.client.0.smithi067.stdout:9/833: dwrite d3/d6/d2e/f63 [0,4194304] 0 2024-01-17T23:47:55.441 INFO:tasks.workunit.client.0.smithi067.stdout:1/823: symlink d0/d7/d13/d2e/l10e 0 2024-01-17T23:47:55.861 INFO:tasks.workunit.client.0.smithi067.stdout:5/786: mknod d10/d24/d46/c101 0 2024-01-17T23:47:55.861 INFO:tasks.workunit.client.0.smithi067.stdout:2/826: symlink d5/d1f/d16/d61/d112/l11f 0 2024-01-17T23:47:56.841 INFO:tasks.workunit.client.0.smithi067.stdout:0/893: symlink d3/d5/d122/d7f/l146 0 2024-01-17T23:47:56.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/894: dwrite d3/d6/f55 [0,4194304] 0 2024-01-17T23:47:56.888 INFO:tasks.workunit.client.0.smithi067.stdout:0/895: dread d3/d64/d82/ff7 [0,4194304] 0 2024-01-17T23:47:58.377 INFO:tasks.workunit.client.0.smithi067.stdout:2/827: getdents d5/d1f/d2a/d54 0 2024-01-17T23:47:58.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/850: rmdir d0/d34/d35/d65 39 2024-01-17T23:47:58.666 INFO:tasks.workunit.client.0.smithi067.stdout:0/896: symlink d3/d5/d122/d9f/dee/l147 0 2024-01-17T23:47:58.682 INFO:tasks.workunit.client.0.smithi067.stdout:0/897: write d3/d5/d1a/d1c/d1d/f9a [3870827,78029] 0 2024-01-17T23:47:58.682 INFO:tasks.workunit.client.0.smithi067.stdout:0/898: stat d3/d6/d80/cbb 0 2024-01-17T23:47:59.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/828: rename d5/d1f/d2a/d54/d8/ce4 to d5/d1f/d98/d9f/dbb/c120 0 2024-01-17T23:47:59.284 INFO:tasks.workunit.client.0.smithi067.stdout:3/851: getdents d0/d13 0 2024-01-17T23:47:59.285 INFO:tasks.workunit.client.0.smithi067.stdout:3/852: readlink d0/d37/l48 0 2024-01-17T23:47:59.285 INFO:tasks.workunit.client.0.smithi067.stdout:3/853: stat d0/d34/d35/d57/fdd 0 2024-01-17T23:47:59.602 INFO:tasks.workunit.client.0.smithi067.stdout:0/899: symlink d3/d64/d82/l148 0 2024-01-17T23:47:59.602 INFO:tasks.workunit.client.0.smithi067.stdout:0/900: getdents d3/d64/d7d/de6 0 2024-01-17T23:48:00.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/854: truncate d0/f11 5086162 0 2024-01-17T23:48:00.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/855: write d0/d12/f8f [913231,60071] 0 2024-01-17T23:48:00.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/856: readlink d0/lbd 0 2024-01-17T23:48:00.856 INFO:tasks.workunit.client.0.smithi067.stdout:4/832: creat d3/f10d x:0 0 0 2024-01-17T23:48:00.902 INFO:tasks.workunit.client.0.smithi067.stdout:8/893: dwrite d6/fe [0,4194304] 0 2024-01-17T23:48:00.905 INFO:tasks.workunit.client.0.smithi067.stdout:8/894: dread d6/d19/d22/d25/f5d [0,4194304] 0 2024-01-17T23:48:00.906 INFO:tasks.workunit.client.0.smithi067.stdout:8/895: write d6/d26/d7c/f9a [4640048,50022] 0 2024-01-17T23:48:01.068 INFO:tasks.workunit.client.0.smithi067.stdout:3/857: mkdir d0/de1/d75/dd0/dd8/d109 0 2024-01-17T23:48:01.396 INFO:tasks.workunit.client.0.smithi067.stdout:4/833: creat d3/d4e/dee/d20/d3b/ddf/f10e x:0 0 0 2024-01-17T23:48:01.710 INFO:tasks.workunit.client.0.smithi067.stdout:8/896: mkdir d6/d19/d22/dec/d12c 0 2024-01-17T23:48:01.736 INFO:tasks.workunit.client.0.smithi067.stdout:5/787: dwrite d10/d24/d25/d5c/d7e/d7f/f98 [0,4194304] 0 2024-01-17T23:48:01.845 INFO:tasks.workunit.client.0.smithi067.stdout:3/858: link d0/d12/d1b/d4d/f7f d0/de1/d75/dd0/dd8/d109/f10a 0 2024-01-17T23:48:01.845 INFO:tasks.workunit.client.0.smithi067.stdout:3/859: dread - d0/d12/d1b/fcd zero size 2024-01-17T23:48:02.124 INFO:tasks.workunit.client.0.smithi067.stdout:4/834: mknod d3/d4e/dee/df8/dff/c10f 0 2024-01-17T23:48:02.293 INFO:tasks.workunit.client.0.smithi067.stdout:8/897: rmdir d6/d26/d3e 39 2024-01-17T23:48:02.293 INFO:tasks.workunit.client.0.smithi067.stdout:8/898: write d6/d26/d56/dbb/dfd/fbe [5761489,79841] 0 2024-01-17T23:48:02.293 INFO:tasks.workunit.client.0.smithi067.stdout:8/899: getdents d6/d19/d22/dec/d10b 0 2024-01-17T23:48:02.308 INFO:tasks.workunit.client.0.smithi067.stdout:8/900: dread d6/d19/f4a [0,4194304] 0 2024-01-17T23:48:02.528 INFO:tasks.workunit.client.0.smithi067.stdout:1/824: dwrite d0/d7/d13/d77/d95/f10d [0,4194304] 0 2024-01-17T23:48:02.540 INFO:tasks.workunit.client.0.smithi067.stdout:1/825: write d0/d62/f65 [2914288,6991] 0 2024-01-17T23:48:02.540 INFO:tasks.workunit.client.0.smithi067.stdout:1/826: chown d0/d62/cc1 2098720739 1 2024-01-17T23:48:03.052 INFO:tasks.workunit.client.0.smithi067.stdout:3/860: mknod d0/d17/dc8/dae/df6/c10b 0 2024-01-17T23:48:03.052 INFO:tasks.workunit.client.0.smithi067.stdout:3/861: stat d0/d34/d35/d65/d6f/fb2 0 2024-01-17T23:48:03.052 INFO:tasks.workunit.client.0.smithi067.stdout:7/838: link d4/c9 d4/c101 0 2024-01-17T23:48:03.052 INFO:tasks.workunit.client.0.smithi067.stdout:7/839: dread - d4/d4b/d63/db7/fd2 zero size 2024-01-17T23:48:03.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/835: symlink d3/d4e/dee/d20/d3b/l110 0 2024-01-17T23:48:03.190 INFO:tasks.workunit.client.0.smithi067.stdout:8/901: mknod d6/d26/d56/c12d 0 2024-01-17T23:48:03.202 INFO:tasks.workunit.client.0.smithi067.stdout:4/836: dread d3/d4e/dee/da6/fb9 [0,4194304] 0 2024-01-17T23:48:03.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/902: write d6/d26/d3e/d6c/ff0 [1345509,119740] 0 2024-01-17T23:48:03.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/903: stat d6/d26/d56/dbb/dee 0 2024-01-17T23:48:03.237 INFO:tasks.workunit.client.0.smithi067.stdout:8/904: write d6/f7b [1230926,115059] 0 2024-01-17T23:48:03.237 INFO:tasks.workunit.client.0.smithi067.stdout:8/905: chown d6/d19/d22/d25/d53/d65/f28 12288 1 2024-01-17T23:48:03.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/827: dread d0/d74/d31/fbe [0,4194304] 0 2024-01-17T23:48:03.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/828: fdatasync d0/d7/d13/d3a/f5d 0 2024-01-17T23:48:03.335 INFO:tasks.workunit.client.0.smithi067.stdout:1/829: write d0/d7/d13/d77/d95/f10d [2809091,67845] 0 2024-01-17T23:48:03.389 INFO:tasks.workunit.client.0.smithi067.stdout:3/862: truncate d0/d13/d1a/f97 791454 0 2024-01-17T23:48:03.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/863: write d0/d17/dc8/fa3 [1152744,24039] 0 2024-01-17T23:48:03.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/864: fdatasync d0/d34/d35/d57/f79 0 2024-01-17T23:48:03.642 INFO:tasks.workunit.client.0.smithi067.stdout:7/840: getdents d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84 0 2024-01-17T23:48:03.643 INFO:tasks.workunit.client.0.smithi067.stdout:7/841: chown d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/cec 0 1 2024-01-17T23:48:03.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/837: creat d3/d26/d34/d65/f111 x:0 0 0 2024-01-17T23:48:03.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/838: truncate d3/d4e/f63 1947368 0 2024-01-17T23:48:03.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/839: creat d3/d26/d34/d3a/d9f/f112 x:0 0 0 2024-01-17T23:48:04.188 INFO:tasks.workunit.client.0.smithi067.stdout:0/901: dwrite d3/d5/d122/fd3 [0,4194304] 0 2024-01-17T23:48:04.191 INFO:tasks.workunit.client.0.smithi067.stdout:0/902: write d3/d5/d1a/d1c/d4e/f124 [184149,122983] 0 2024-01-17T23:48:04.203 INFO:tasks.workunit.client.0.smithi067.stdout:0/903: dread d3/d5/d122/dc5/fe2 [0,4194304] 0 2024-01-17T23:48:04.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/829: mkdir d5/d1f/d121 0 2024-01-17T23:48:04.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/830: write d5/d1f/f43 [2494279,32224] 0 2024-01-17T23:48:04.366 INFO:tasks.workunit.client.0.smithi067.stdout:1/830: truncate d0/d7/d13/d77/fcb 1180088 0 2024-01-17T23:48:05.344 INFO:tasks.workunit.client.0.smithi067.stdout:4/840: creat d3/d4e/dee/d20/d101/f113 x:0 0 0 2024-01-17T23:48:05.604 INFO:tasks.workunit.client.0.smithi067.stdout:0/904: creat d3/d6/f149 x:0 0 0 2024-01-17T23:48:05.615 INFO:tasks.workunit.client.0.smithi067.stdout:0/905: dread d3/d5/d122/dc5/fe2 [0,4194304] 0 2024-01-17T23:48:05.615 INFO:tasks.workunit.client.0.smithi067.stdout:0/906: chown d3/d64/d82/de8 18414 1 2024-01-17T23:48:05.652 INFO:tasks.workunit.client.0.smithi067.stdout:0/907: dwrite d3/d64/d82/ff7 [0,4194304] 0 2024-01-17T23:48:05.652 INFO:tasks.workunit.client.0.smithi067.stdout:0/908: readlink d3/d6/d80/lb4 0 2024-01-17T23:48:05.884 INFO:tasks.workunit.client.0.smithi067.stdout:2/831: mknod d5/d1f/d98/d9f/dbb/c122 0 2024-01-17T23:48:05.884 INFO:tasks.workunit.client.0.smithi067.stdout:2/832: fsync d5/d1f/d2a/d54/d8/f45 0 2024-01-17T23:48:05.959 INFO:tasks.workunit.client.0.smithi067.stdout:3/865: truncate d0/d34/d35/f9d 293955 0 2024-01-17T23:48:06.243 INFO:tasks.workunit.client.0.smithi067.stdout:6/877: mkdir d6/d122 0 2024-01-17T23:48:06.247 INFO:tasks.workunit.client.0.smithi067.stdout:6/878: write d6/d18/d2e/d61/d9a/fac [102403,51827] 0 2024-01-17T23:48:06.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/909: creat d3/d64/f14a x:0 0 0 2024-01-17T23:48:06.714 INFO:tasks.workunit.client.0.smithi067.stdout:1/831: getdents d0/d62 0 2024-01-17T23:48:06.866 INFO:tasks.workunit.client.0.smithi067.stdout:2/833: creat d5/d1f/f123 x:0 0 0 2024-01-17T23:48:06.907 INFO:tasks.workunit.client.0.smithi067.stdout:3/866: rmdir d0/d34/d35/d65/d6f/d70 39 2024-01-17T23:48:06.945 INFO:tasks.workunit.client.0.smithi067.stdout:6/879: symlink d6/d18/d2e/l123 0 2024-01-17T23:48:07.021 INFO:tasks.workunit.client.0.smithi067.stdout:0/910: dread d3/f11 [0,4194304] 0 2024-01-17T23:48:07.047 INFO:tasks.workunit.client.0.smithi067.stdout:0/911: dwrite d3/d5/d1a/d1c/d1d/d2e/d5a/f88 [0,4194304] 0 2024-01-17T23:48:07.532 INFO:tasks.workunit.client.0.smithi067.stdout:6/880: mkdir d6/d9/d30/dbd/d124 0 2024-01-17T23:48:07.532 INFO:tasks.workunit.client.0.smithi067.stdout:6/881: truncate d6/d9/d1c/d1e/d43/def/d51/feb 72303 0 2024-01-17T23:48:07.538 INFO:tasks.workunit.client.0.smithi067.stdout:6/882: read d6/d9/d1c/d1e/d43/d78/dab/fc1 [541850,59339] 0 2024-01-17T23:48:07.544 INFO:tasks.workunit.client.0.smithi067.stdout:6/883: write d6/d9/d1c/f96 [1291148,37718] 0 2024-01-17T23:48:07.544 INFO:tasks.workunit.client.0.smithi067.stdout:6/884: write d6/d9/d1c/d1e/d7e/fc0 [343119,126159] 0 2024-01-17T23:48:07.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/912: creat d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/f14b x:0 0 0 2024-01-17T23:48:07.705 INFO:tasks.workunit.client.0.smithi067.stdout:0/913: dread - d3/d4c/f11f zero size 2024-01-17T23:48:07.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/914: write d3/d75/fd7 [7899181,60620] 0 2024-01-17T23:48:07.769 INFO:tasks.workunit.client.0.smithi067.stdout:1/832: getdents d0/d7/d13/d77 0 2024-01-17T23:48:07.870 INFO:tasks.workunit.client.0.smithi067.stdout:2/834: getdents d5/d1f/d2a/d73 0 2024-01-17T23:48:07.870 INFO:tasks.workunit.client.0.smithi067.stdout:2/835: dread - d5/d1f/d2a/d55/fcf zero size 2024-01-17T23:48:07.885 INFO:tasks.workunit.client.0.smithi067.stdout:2/836: dread d5/d1f/d2a/d54/d8/d32/f9b [0,4194304] 0 2024-01-17T23:48:08.087 INFO:tasks.workunit.client.0.smithi067.stdout:0/915: mknod d3/d6/dd/d13f/d140/c14c 0 2024-01-17T23:48:08.142 INFO:tasks.workunit.client.0.smithi067.stdout:1/833: mknod d0/d7/d13/d3a/d75/da1/c10f 0 2024-01-17T23:48:08.225 INFO:tasks.workunit.client.0.smithi067.stdout:2/837: getdents d5/d1f/d2a/d54/d39/d68/dd6 0 2024-01-17T23:48:08.258 INFO:tasks.workunit.client.0.smithi067.stdout:2/838: dwrite d5/f78 [0,4194304] 0 2024-01-17T23:48:08.289 INFO:tasks.workunit.client.0.smithi067.stdout:2/839: dwrite d5/d1f/d2a/d54/d8/d4c/d84/f89 [0,4194304] 0 2024-01-17T23:48:08.289 INFO:tasks.workunit.client.0.smithi067.stdout:2/840: write d5/d2f/f4b [2888478,29186] 0 2024-01-17T23:48:08.356 INFO:tasks.workunit.client.0.smithi067.stdout:0/916: mknod d3/dbf/c14d 0 2024-01-17T23:48:08.360 INFO:tasks.workunit.client.0.smithi067.stdout:0/917: dread d3/d5/d1a/d1c/d4e/f6f [0,4194304] 0 2024-01-17T23:48:08.891 INFO:tasks.workunit.client.0.smithi067.stdout:2/841: symlink d5/d1f/d2a/d54/d8/d4c/dbf/df4/l124 0 2024-01-17T23:48:08.985 INFO:tasks.workunit.client.0.smithi067.stdout:1/834: creat d0/f110 x:0 0 0 2024-01-17T23:48:08.985 INFO:tasks.workunit.client.0.smithi067.stdout:1/835: truncate d0/ff1 1103540 0 2024-01-17T23:48:09.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/918: truncate d3/d5/d1a/d1c/d4d/faa 2663670 0 2024-01-17T23:48:09.277 INFO:tasks.workunit.client.0.smithi067.stdout:0/919: chown d3/d6/dd/d43 1 1 2024-01-17T23:48:09.593 INFO:tasks.workunit.client.0.smithi067.stdout:2/842: unlink d5/d1f/d2a/d54/d8/d4c/d84/da5/c102 0 2024-01-17T23:48:09.959 INFO:tasks.workunit.client.0.smithi067.stdout:7/842: write d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fbd [744873,63586] 0 2024-01-17T23:48:10.230 INFO:tasks.workunit.client.0.smithi067.stdout:0/920: getdents d3/d6/d80 0 2024-01-17T23:48:10.231 INFO:tasks.workunit.client.0.smithi067.stdout:0/921: dread - d3/d64/d7d/f135 zero size 2024-01-17T23:48:10.546 INFO:tasks.workunit.client.0.smithi067.stdout:1/836: unlink d0/d7/l80 0 2024-01-17T23:48:10.560 INFO:tasks.workunit.client.0.smithi067.stdout:9/834: sync 2024-01-17T23:48:10.560 INFO:tasks.workunit.client.0.smithi067.stdout:9/835: fsync d3/d6/d2a/da2/dbd/f11f 0 2024-01-17T23:48:10.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/836: write d3/d6/da4/d55/fa3 [3258703,84909] 0 2024-01-17T23:48:10.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/788: rename d10/d24/d25/d5c/d7e/de4 to d10/d24/d46/d4a/d4b/da9/d102 0 2024-01-17T23:48:10.823 INFO:tasks.workunit.client.0.smithi067.stdout:5/789: creat d10/d53/da4/dc6/f103 x:0 0 0 2024-01-17T23:48:10.824 INFO:tasks.workunit.client.0.smithi067.stdout:3/867: write d0/d12/f21 [1036777,117988] 0 2024-01-17T23:48:10.848 INFO:tasks.workunit.client.0.smithi067.stdout:5/790: dwrite d10/d24/d25/f2b [0,4194304] 0 2024-01-17T23:48:10.866 INFO:tasks.workunit.client.0.smithi067.stdout:3/868: dwrite d0/d17/dc8/dae/fe8 [0,4194304] 0 2024-01-17T23:48:10.866 INFO:tasks.workunit.client.0.smithi067.stdout:3/869: write d0/d17/dc8/dae/d107/dea/ffc [1009562,35563] 0 2024-01-17T23:48:10.866 INFO:tasks.workunit.client.0.smithi067.stdout:3/870: stat d0/d17/l4e 0 2024-01-17T23:48:10.887 INFO:tasks.workunit.client.0.smithi067.stdout:5/791: dwrite d10/d24/d25/d5c/d7e/d7f/fc0 [0,4194304] 0 2024-01-17T23:48:10.894 INFO:tasks.workunit.client.0.smithi067.stdout:3/871: dwrite d0/f1e [0,4194304] 0 2024-01-17T23:48:10.894 INFO:tasks.workunit.client.0.smithi067.stdout:3/872: chown d0 1381558 1 2024-01-17T23:48:11.401 INFO:tasks.workunit.client.0.smithi067.stdout:1/837: readlink d0/d69/l70 0 2024-01-17T23:48:11.402 INFO:tasks.workunit.client.0.smithi067.stdout:1/838: chown d0 5 1 2024-01-17T23:48:11.402 INFO:tasks.workunit.client.0.smithi067.stdout:1/839: readlink d0/d7/d7f/d82/l9f 0 2024-01-17T23:48:11.402 INFO:tasks.workunit.client.0.smithi067.stdout:1/840: chown d0/d7/d1c/fc4 55 1 2024-01-17T23:48:11.432 INFO:tasks.workunit.client.0.smithi067.stdout:6/885: dwrite d6/d18/f33 [4194304,4194304] 0 2024-01-17T23:48:11.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/837: link d3/d6/d11/d50/l3b d3/d6/d2a/da2/de2/dd0/da6/l125 0 2024-01-17T23:48:11.806 INFO:tasks.workunit.client.0.smithi067.stdout:7/843: rename d4/f8 to d4/d25/d39/d46/d60/f102 0 2024-01-17T23:48:11.841 INFO:tasks.workunit.client.0.smithi067.stdout:7/844: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/fd6 [0,4194304] 0 2024-01-17T23:48:12.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/792: mknod d10/d24/d46/d4a/d4b/c104 0 2024-01-17T23:48:12.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/793: getdents d10/d24/d59/d5d/dce 0 2024-01-17T23:48:12.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/794: write d10/d24/d46/d4a/fd7 [758980,18087] 0 2024-01-17T23:48:12.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/795: read - d10/d24/d59/fd1 zero size 2024-01-17T23:48:12.628 INFO:tasks.workunit.client.0.smithi067.stdout:3/873: creat d0/d17/f10c x:0 0 0 2024-01-17T23:48:12.889 INFO:tasks.workunit.client.0.smithi067.stdout:0/922: truncate d3/d6/dd/f4a 1252463 0 2024-01-17T23:48:12.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/841: getdents d0/d7/d13/d3a/d75/ded 0 2024-01-17T23:48:13.049 INFO:tasks.workunit.client.0.smithi067.stdout:6/886: mknod d6/d9/d30/d58/c125 0 2024-01-17T23:48:13.061 INFO:tasks.workunit.client.0.smithi067.stdout:6/887: dread d6/d9/d30/d58/fa8 [0,4194304] 0 2024-01-17T23:48:13.106 INFO:tasks.workunit.client.0.smithi067.stdout:9/838: mknod d3/d6/da4/dba/c126 0 2024-01-17T23:48:13.106 INFO:tasks.workunit.client.0.smithi067.stdout:9/839: chown d3/d6/da4/le0 0 1 2024-01-17T23:48:13.554 INFO:tasks.workunit.client.0.smithi067.stdout:7/845: dread d4/d4b/d7f/ddd/ff6 [0,4194304] 0 2024-01-17T23:48:13.554 INFO:tasks.workunit.client.0.smithi067.stdout:7/846: write d4/f26 [4722065,88755] 0 2024-01-17T23:48:13.878 INFO:tasks.workunit.client.0.smithi067.stdout:3/874: rename d0/d12/d1b/d4d/f7f to d0/de1/d82/da6/dd3/f10d 0 2024-01-17T23:48:14.669 INFO:tasks.workunit.client.0.smithi067.stdout:4/841: sync 2024-01-17T23:48:14.669 INFO:tasks.workunit.client.0.smithi067.stdout:8/906: sync 2024-01-17T23:48:14.700 INFO:tasks.workunit.client.0.smithi067.stdout:4/842: dwrite d3/d4e/dee/f87 [0,4194304] 0 2024-01-17T23:48:14.741 INFO:tasks.workunit.client.0.smithi067.stdout:2/843: write d5/d1f/d35/f5c [865955,126902] 0 2024-01-17T23:48:14.767 INFO:tasks.workunit.client.0.smithi067.stdout:2/844: dwrite d5/d1f/d2a/d54/d8/d32/f11e [0,4194304] 0 2024-01-17T23:48:14.767 INFO:tasks.workunit.client.0.smithi067.stdout:2/845: readlink d5/d1f/d2a/d73/lab 0 2024-01-17T23:48:15.108 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:15.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:16.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/888: read d6/f8 [3620269,34986] 0 2024-01-17T23:48:16.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/889: fdatasync d6/d9/d1c/d1e/d43/def/d51/fbb 0 2024-01-17T23:48:16.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/890: stat d6/d9/d1c/d1e/d43/d78 0 2024-01-17T23:48:16.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/891: truncate d6/d18/d2e/d61/d9a/dd1/ffd 415631 0 2024-01-17T23:48:16.253 INFO:tasks.workunit.client.0.smithi067.stdout:7/847: creat d4/d25/d39/d46/d60/dc7/f103 x:0 0 0 2024-01-17T23:48:16.253 INFO:tasks.workunit.client.0.smithi067.stdout:7/848: readlink d4/d16/ld9 0 2024-01-17T23:48:16.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/796: mknod d10/c105 0 2024-01-17T23:48:16.456 INFO:tasks.workunit.client.0.smithi067.stdout:9/840: rename d3/d6/d11/d5c/fda to d3/d6/d11/d50/d84/f127 0 2024-01-17T23:48:16.457 INFO:tasks.workunit.client.0.smithi067.stdout:9/841: fsync d3/d6/d47/d88/dc2/fdc 0 2024-01-17T23:48:16.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/875: mknod d0/d17/dc8/dae/c10e 0 2024-01-17T23:48:16.578 INFO:tasks.workunit.client.0.smithi067.stdout:3/876: dwrite d0/d34/d35/d57/f79 [0,4194304] 0 2024-01-17T23:48:17.032 INFO:tasks.workunit.client.0.smithi067.stdout:4/843: truncate d3/d26/d34/fb2 2284050 0 2024-01-17T23:48:17.032 INFO:tasks.workunit.client.0.smithi067.stdout:4/844: dread - d3/d4e/dee/d20/f91 zero size 2024-01-17T23:48:17.033 INFO:tasks.workunit.client.0.smithi067.stdout:4/845: chown d3/d4e/dee/d20/d3b/c83 444 1 2024-01-17T23:48:17.309 INFO:tasks.workunit.client.0.smithi067.stdout:2/846: symlink d5/d1f/d2a/d54/d8/d4c/dbf/df4/df7/l125 0 2024-01-17T23:48:17.632 INFO:tasks.workunit.client.0.smithi067.stdout:6/892: mkdir d6/d9/d3e/d126 0 2024-01-17T23:48:17.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/849: mknod d4/d25/d39/d8a/c104 0 2024-01-17T23:48:17.789 INFO:tasks.workunit.client.0.smithi067.stdout:7/850: dread d4/d25/d39/d46/d60/f66 [0,4194304] 0 2024-01-17T23:48:17.789 INFO:tasks.workunit.client.0.smithi067.stdout:7/851: chown d4/d25/d39/d46/d78/d93/d94/dc4/c44 102237860 1 2024-01-17T23:48:17.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/797: creat d10/d24/d46/db1/f106 x:0 0 0 2024-01-17T23:48:18.247 INFO:tasks.workunit.client.0.smithi067.stdout:9/842: creat d3/d6/d47/f128 x:0 0 0 2024-01-17T23:48:18.247 INFO:tasks.workunit.client.0.smithi067.stdout:9/843: fdatasync d3/d6/da4/d55/da1/dbc/d10f/f110 0 2024-01-17T23:48:18.354 INFO:tasks.workunit.client.0.smithi067.stdout:3/877: mknod d0/d13/c10f 0 2024-01-17T23:48:18.377 INFO:tasks.workunit.client.0.smithi067.stdout:3/878: write d0/de1/d82/da6/fe2 [3947304,105824] 0 2024-01-17T23:48:18.440 INFO:tasks.workunit.client.0.smithi067.stdout:8/907: getdents d6/d19/d22/d25/d53/d48 0 2024-01-17T23:48:18.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/908: read d6/d19/d22/d25/d53/f16 [2150680,50512] 0 2024-01-17T23:48:18.799 INFO:tasks.workunit.client.0.smithi067.stdout:4/846: truncate d3/ff3 7796 0 2024-01-17T23:48:18.799 INFO:tasks.workunit.client.0.smithi067.stdout:2/847: symlink d5/d1f/d98/dfe/l126 0 2024-01-17T23:48:18.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/848: dwrite d5/d1f/d2a/d54/d8/d4c/d84/f89 [0,4194304] 0 2024-01-17T23:48:18.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/849: creat d5/d1f/d2a/d54/d8/d4c/dbf/f127 x:0 0 0 2024-01-17T23:48:18.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/850: readlink d5/d2f/l57 0 2024-01-17T23:48:18.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/851: fsync d5/d1f/d2a/d55/fcf 0 2024-01-17T23:48:18.899 INFO:tasks.workunit.client.0.smithi067.stdout:7/852: read d4/d4b/d7f/f87 [198433,80436] 0 2024-01-17T23:48:18.914 INFO:tasks.workunit.client.0.smithi067.stdout:7/853: read d4/f6 [3193719,61192] 0 2024-01-17T23:48:19.129 INFO:tasks.workunit.client.0.smithi067.stdout:9/844: dread d3/d6/d2a/f71 [0,4194304] 0 2024-01-17T23:48:19.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/909: symlink d6/d19/d22/dec/d10b/l12e 0 2024-01-17T23:48:20.122 INFO:tasks.workunit.client.0.smithi067.stdout:1/842: dwrite d0/fca [0,4194304] 0 2024-01-17T23:48:20.122 INFO:tasks.workunit.client.0.smithi067.stdout:1/843: write d0/d7/d13/d3a/d45/fe5 [595331,46677] 0 2024-01-17T23:48:20.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/844: dwrite d0/d7/d13/d3a/d45/fe5 [0,4194304] 0 2024-01-17T23:48:20.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/845: readlink d0/d7/d7f/le1 0 2024-01-17T23:48:20.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/846: chown d0/d7/d13/d3d/d48/d4d/fb8 3 1 2024-01-17T23:48:20.160 INFO:tasks.workunit.client.0.smithi067.stdout:1/847: chown d0/d7/d13/d3a 31 1 2024-01-17T23:48:20.177 INFO:tasks.workunit.client.0.smithi067.stdout:1/848: write d0/d62/f9c [3044837,92044] 0 2024-01-17T23:48:20.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/852: mkdir d5/d1f/d2a/d54/d8/d32/d9c/d128 0 2024-01-17T23:48:20.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/853: truncate d5/d1f/d2a/d54/f1a 5160546 0 2024-01-17T23:48:20.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/854: link d4/c7b d4/d25/d39/d46/da8/db0/dff/c105 0 2024-01-17T23:48:20.785 INFO:tasks.workunit.client.0.smithi067.stdout:0/923: sync 2024-01-17T23:48:21.079 INFO:tasks.workunit.client.0.smithi067.stdout:8/910: unlink d6/d93/f124 0 2024-01-17T23:48:21.782 INFO:tasks.workunit.client.0.smithi067.stdout:2/854: mkdir d5/d1f/d2a/d54/d8/d11a/d129 0 2024-01-17T23:48:22.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/911: mknod d6/d19/d22/d25/d53/d65/c12f 0 2024-01-17T23:48:22.466 INFO:tasks.workunit.client.0.smithi067.stdout:2/855: dread d5/d1f/d16/faa [0,4194304] 0 2024-01-17T23:48:22.480 INFO:tasks.workunit.client.0.smithi067.stdout:2/856: write d5/d1f/d2a/f4a [3662395,56664] 0 2024-01-17T23:48:22.988 INFO:tasks.workunit.client.0.smithi067.stdout:2/857: mknod d5/d1f/d2a/d54/d8/d4c/d84/da9/c12a 0 2024-01-17T23:48:22.989 INFO:tasks.workunit.client.0.smithi067.stdout:2/858: readlink d5/d1f/d98/d9f/la6 0 2024-01-17T23:48:23.808 INFO:tasks.workunit.client.0.smithi067.stdout:4/847: write d3/d4e/dee/df8/f10a [1234584,19459] 0 2024-01-17T23:48:24.041 INFO:tasks.workunit.client.0.smithi067.stdout:0/924: write d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/feb [232432,127816] 0 2024-01-17T23:48:24.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/855: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/f4d [0,4194304] 0 2024-01-17T23:48:24.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/856: fdatasync d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fd7 0 2024-01-17T23:48:24.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/849: dwrite d0/d7/d13/d3a/d75/ded/fb0 [0,4194304] 0 2024-01-17T23:48:24.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/850: truncate d0/d7/d13/d3d/d48/fc8 4587752 0 2024-01-17T23:48:24.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/851: read d0/d7/d7f/f91 [863509,124432] 0 2024-01-17T23:48:24.283 INFO:tasks.workunit.client.0.smithi067.stdout:1/852: dread d0/d74/f8c [0,4194304] 0 2024-01-17T23:48:24.283 INFO:tasks.workunit.client.0.smithi067.stdout:1/853: fdatasync d0/d7/d1c/f54 0 2024-01-17T23:48:24.374 INFO:tasks.workunit.client.0.smithi067.stdout:6/893: symlink d6/d9/l127 0 2024-01-17T23:48:25.166 INFO:tasks.workunit.client.0.smithi067.stdout:3/879: rmdir d0/de1 39 2024-01-17T23:48:25.180 INFO:tasks.workunit.client.0.smithi067.stdout:3/880: write d0/d34/d35/d57/f79 [1256495,107936] 0 2024-01-17T23:48:25.873 INFO:tasks.workunit.client.0.smithi067.stdout:5/798: rename d10/d24/d46 to d10/d24/d25/d5c/d107 0 2024-01-17T23:48:25.873 INFO:tasks.workunit.client.0.smithi067.stdout:5/799: write d10/f2c [2333050,16655] 0 2024-01-17T23:48:26.038 INFO:tasks.workunit.client.0.smithi067.stdout:3/881: dread d0/d34/d35/fb8 [0,4194304] 0 2024-01-17T23:48:26.038 INFO:tasks.workunit.client.0.smithi067.stdout:3/882: chown d0/d17/f5f 246 1 2024-01-17T23:48:26.039 INFO:tasks.workunit.client.0.smithi067.stdout:3/883: truncate d0/d34/d35/d65/f106 162442 0 2024-01-17T23:48:26.360 INFO:tasks.workunit.client.0.smithi067.stdout:5/800: symlink d10/d24/d59/d8c/l108 0 2024-01-17T23:48:26.360 INFO:tasks.workunit.client.0.smithi067.stdout:8/912: rename d6/d19/d22/dec/d10b to d6/d19/dcf/d113/d130 0 2024-01-17T23:48:26.360 INFO:tasks.workunit.client.0.smithi067.stdout:8/913: dread - d6/d19/d22/d25/d53/d65/f12b zero size 2024-01-17T23:48:26.418 INFO:tasks.workunit.client.0.smithi067.stdout:8/914: dwrite d6/db/f34 [0,4194304] 0 2024-01-17T23:48:26.418 INFO:tasks.workunit.client.0.smithi067.stdout:8/915: fdatasync d6/f8e 0 2024-01-17T23:48:26.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/916: dwrite d6/d19/dcf/f104 [0,4194304] 0 2024-01-17T23:48:26.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/917: dread - d6/d19/d22/f91 zero size 2024-01-17T23:48:26.471 INFO:tasks.workunit.client.0.smithi067.stdout:8/918: dread d6/d19/d22/f71 [0,4194304] 0 2024-01-17T23:48:26.930 INFO:tasks.workunit.client.0.smithi067.stdout:1/854: write d0/d7/d13/d77/fcb [1906931,100641] 0 2024-01-17T23:48:26.931 INFO:tasks.workunit.client.0.smithi067.stdout:2/859: rename d5/d1f/d2a/d54/d8/d32/lb6 to d5/d1f/d2a/d54/dee/d109/l12b 0 2024-01-17T23:48:27.015 INFO:tasks.workunit.client.0.smithi067.stdout:5/801: truncate d10/d24/d25/d5c/fe5 296520 0 2024-01-17T23:48:27.015 INFO:tasks.workunit.client.0.smithi067.stdout:5/802: fdatasync d10/d24/d25/d5c/d107/db1/f106 0 2024-01-17T23:48:27.187 INFO:tasks.workunit.client.0.smithi067.stdout:9/845: sync 2024-01-17T23:48:27.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/846: dread d3/d6/d47/d88/f11a [0,4194304] 0 2024-01-17T23:48:27.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/919: creat d6/d19/d22/d25/d53/d54/f131 x:0 0 0 2024-01-17T23:48:27.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/855: mknod d0/d7/d13/d3a/d75/c111 0 2024-01-17T23:48:27.939 INFO:tasks.workunit.client.0.smithi067.stdout:4/848: rename d3/d5/f3f to d3/db8/f114 0 2024-01-17T23:48:28.040 INFO:tasks.workunit.client.0.smithi067.stdout:2/860: mknod d5/d1f/d2a/d54/dee/c12c 0 2024-01-17T23:48:28.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/847: link d3/d6/d47/l60 d3/d6/d11/d50/d84/da8/da9/df9/l129 0 2024-01-17T23:48:29.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/856: mknod d0/d7/d13/d3d/dd0/c112 0 2024-01-17T23:48:29.390 INFO:tasks.workunit.client.0.smithi067.stdout:0/925: rename d3/d64/d7d/de6 to d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d108/d14e 0 2024-01-17T23:48:29.557 INFO:tasks.workunit.client.0.smithi067.stdout:4/849: mknod d3/d4e/dee/d20/d3b/d7c/d92/c115 0 2024-01-17T23:48:29.557 INFO:tasks.workunit.client.0.smithi067.stdout:2/861: symlink d5/d1f/d2a/d54/d8/d4c/l12d 0 2024-01-17T23:48:30.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/848: mkdir d3/d6/da4/d55/da1/d12a 0 2024-01-17T23:48:30.049 INFO:tasks.workunit.client.0.smithi067.stdout:1/857: rmdir d0/d7/d13/d3d/d48/da4 39 2024-01-17T23:48:30.062 INFO:tasks.workunit.client.0.smithi067.stdout:1/858: dread d0/d7/d13/f40 [0,4194304] 0 2024-01-17T23:48:30.067 INFO:tasks.workunit.client.0.smithi067.stdout:9/849: dread d3/d6/d47/d6d/f8c [0,4194304] 0 2024-01-17T23:48:30.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/857: rename d4/d25/d39/d46/d78/d93/d94/dc4/fe2 to d4/d4b/d7f/f106 0 2024-01-17T23:48:30.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/858: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/f107 x:0 0 0 2024-01-17T23:48:30.710 INFO:tasks.workunit.client.0.smithi067.stdout:0/926: mknod d3/d5/d122/d9f/c14f 0 2024-01-17T23:48:30.820 INFO:tasks.workunit.client.0.smithi067.stdout:4/850: link d3/d26/d34/d3a/f4b d3/d4e/dee/da6/f116 0 2024-01-17T23:48:31.045 INFO:tasks.workunit.client.0.smithi067.stdout:1/859: truncate d0/d7/d13/fe2 2711463 0 2024-01-17T23:48:31.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/860: chown d0/c5c 0 1 2024-01-17T23:48:31.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/861: write d0/d7/d13/d3d/d48/fad [123487,49866] 0 2024-01-17T23:48:31.220 INFO:tasks.workunit.client.0.smithi067.stdout:9/850: mkdir d3/d6/da4/d55/d115/d11d/d12b 0 2024-01-17T23:48:31.235 INFO:tasks.workunit.client.0.smithi067.stdout:9/851: dread d3/d6/d2e/fe5 [0,4194304] 0 2024-01-17T23:48:31.236 INFO:tasks.workunit.client.0.smithi067.stdout:9/852: chown d3/d25/d5d/d79/f119 302580370 1 2024-01-17T23:48:31.676 INFO:tasks.workunit.client.0.smithi067.stdout:7/859: creat d4/d25/d39/d46/d78/d93/d94/dc4/d40/f108 x:0 0 0 2024-01-17T23:48:31.677 INFO:tasks.workunit.client.0.smithi067.stdout:5/803: sync 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/804: dread d10/d24/d25/d5c/d7e/d7f/d92/ff8 [0,4194304] 0 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/805: chown d10/d24/d25/f2b 976614459 1 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:7/860: dread d4/f27 [0,4194304] 0 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:7/861: fsync d4/d25/d39/d46/d78/d93/d94/dc4/f8d 0 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:7/862: fsync d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/fd6 0 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/806: write d10/d53/fe3 [633610,116887] 0 2024-01-17T23:48:31.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/807: readlink d10/d24/d25/d5c/d107/d4a/d50/l65 0 2024-01-17T23:48:32.120 INFO:tasks.workunit.client.0.smithi067.stdout:1/862: creat d0/d7/d13/d77/f113 x:0 0 0 2024-01-17T23:48:32.121 INFO:tasks.workunit.client.0.smithi067.stdout:1/863: chown d0/d7/d13/d2e/f92 23616 1 2024-01-17T23:48:32.428 INFO:tasks.workunit.client.0.smithi067.stdout:6/894: rename d6/c3c to d6/d9/d1c/d1e/d43/def/d51/c128 0 2024-01-17T23:48:32.561 INFO:tasks.workunit.client.0.smithi067.stdout:5/808: mknod d10/d24/d59/d8c/dae/c109 0 2024-01-17T23:48:32.633 INFO:tasks.workunit.client.0.smithi067.stdout:4/851: mknod d3/d26/d34/d3a/d53/c117 0 2024-01-17T23:48:32.633 INFO:tasks.workunit.client.0.smithi067.stdout:4/852: chown d3/d4e/dee/d20/fb4 6796352 1 2024-01-17T23:48:32.834 INFO:tasks.workunit.client.0.smithi067.stdout:3/884: rename d0/d12/d1b/d4d/fb9 to d0/de1/d55/f110 0 2024-01-17T23:48:32.835 INFO:tasks.workunit.client.0.smithi067.stdout:3/885: creat d0/de1/d75/dcb/f111 x:0 0 0 2024-01-17T23:48:32.941 INFO:tasks.workunit.client.0.smithi067.stdout:6/895: symlink d6/d9/d30/d58/d10c/l129 0 2024-01-17T23:48:32.941 INFO:tasks.workunit.client.0.smithi067.stdout:6/896: chown d6/d9/d1c/d1e/d43/d78/fa1 368 1 2024-01-17T23:48:33.145 INFO:tasks.workunit.client.0.smithi067.stdout:5/809: unlink d10/d24/d25/d5c/d107/d4a/d4b/da9/fee 0 2024-01-17T23:48:33.216 INFO:tasks.workunit.client.0.smithi067.stdout:4/853: creat d3/d26/d34/f118 x:0 0 0 2024-01-17T23:48:33.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/920: rename d6/d19/d22/d25/d53/d65/c12f to d6/d19/db4/dde/d11e/c132 0 2024-01-17T23:48:33.861 INFO:tasks.workunit.client.0.smithi067.stdout:3/886: rename d0/d37/l41 to d0/d37/l112 0 2024-01-17T23:48:34.028 INFO:tasks.workunit.client.0.smithi067.stdout:6/897: chown d6/l19 232 1 2024-01-17T23:48:34.186 INFO:tasks.workunit.client.0.smithi067.stdout:5/810: unlink d10/d24/d25/l9c 0 2024-01-17T23:48:34.187 INFO:tasks.workunit.client.0.smithi067.stdout:5/811: dread - d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/fe8 zero size 2024-01-17T23:48:34.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/854: unlink d3/d5/fc 0 2024-01-17T23:48:34.260 INFO:tasks.workunit.client.0.smithi067.stdout:4/855: chown d3/d4e/dee/d20/d101 14 1 2024-01-17T23:48:34.465 INFO:tasks.workunit.client.0.smithi067.stdout:2/862: rename d5/d1f/d98/ded to d5/d1f/d2a/d54/d8/d4c/de3/d12e 0 2024-01-17T23:48:34.881 INFO:tasks.workunit.client.0.smithi067.stdout:3/887: symlink d0/de1/d82/l113 0 2024-01-17T23:48:34.881 INFO:tasks.workunit.client.0.smithi067.stdout:3/888: creat d0/d34/d35/d57/f114 x:0 0 0 2024-01-17T23:48:35.275 INFO:tasks.workunit.client.0.smithi067.stdout:6/898: mknod d6/d9/d30/d58/d10c/c12a 0 2024-01-17T23:48:35.275 INFO:tasks.workunit.client.0.smithi067.stdout:6/899: write d6/d9/d3e/fe2 [5144817,74891] 0 2024-01-17T23:48:35.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/900: dread d6/d9/d3e/f92 [0,4194304] 0 2024-01-17T23:48:35.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/901: creat d6/d9/d30/d4c/d8d/f12b x:0 0 0 2024-01-17T23:48:35.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/902: chown d6/d9/d30/fc2 66 1 2024-01-17T23:48:35.291 INFO:tasks.workunit.client.0.smithi067.stdout:6/903: dread d6/d9/d1c/f4b [0,4194304] 0 2024-01-17T23:48:35.310 INFO:tasks.workunit.client.0.smithi067.stdout:6/904: dread d6/d18/d2e/d61/ff7 [4194304,4194304] 0 2024-01-17T23:48:35.342 INFO:tasks.workunit.client.0.smithi067.stdout:6/905: dwrite d6/d9/f27 [0,4194304] 0 2024-01-17T23:48:35.559 INFO:tasks.workunit.client.0.smithi067.stdout:5/812: creat d10/d24/f10a x:0 0 0 2024-01-17T23:48:35.559 INFO:tasks.workunit.client.0.smithi067.stdout:5/813: fdatasync d10/d24/d59/fb3 0 2024-01-17T23:48:35.836 INFO:tasks.workunit.client.0.smithi067.stdout:0/927: rename d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/l138 to d3/d64/l150 0 2024-01-17T23:48:36.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/863: mkdir d5/d1f/d2a/d55/d12f 0 2024-01-17T23:48:36.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/864: creat d5/d1f/d2a/d54/d8/d32/d33/f130 x:0 0 0 2024-01-17T23:48:36.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/889: mkdir d0/d17/dc8/dae/df6/d115 0 2024-01-17T23:48:36.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/890: fdatasync d0/d12/f20 0 2024-01-17T23:48:36.698 INFO:tasks.workunit.client.0.smithi067.stdout:6/906: dread d6/d9/d1c/d1e/d43/def/fe6 [0,4194304] 0 2024-01-17T23:48:36.905 INFO:tasks.workunit.client.0.smithi067.stdout:4/856: mkdir d3/d26/d34/d3a/d119 0 2024-01-17T23:48:36.985 INFO:tasks.workunit.client.0.smithi067.stdout:5/814: mknod d10/d24/d25/d5c/c10b 0 2024-01-17T23:48:37.218 INFO:tasks.workunit.client.0.smithi067.stdout:0/928: mkdir d3/d5/d122/d9f/d151 0 2024-01-17T23:48:37.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/929: dread d3/d6/dd/fce [0,4194304] 0 2024-01-17T23:48:37.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/930: chown d3/f47 1799 1 2024-01-17T23:48:37.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/931: write d3/d64/fd6 [556723,61957] 0 2024-01-17T23:48:37.249 INFO:tasks.workunit.client.0.smithi067.stdout:0/932: write d3/d6/f17 [2155865,69361] 0 2024-01-17T23:48:37.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/864: creat d0/f114 x:0 0 0 2024-01-17T23:48:37.495 INFO:tasks.workunit.client.0.smithi067.stdout:2/865: mkdir d5/d1f/d2a/d54/d8/d4c/d131 0 2024-01-17T23:48:37.525 INFO:tasks.workunit.client.0.smithi067.stdout:2/866: dwrite d5/d1f/d2a/d54/d8/d4c/dbf/f127 [0,4194304] 0 2024-01-17T23:48:38.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/921: write d6/d19/d22/fa8 [3464829,46868] 0 2024-01-17T23:48:38.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/922: write d6/d26/d7c/dd0/fa4 [1720230,28688] 0 2024-01-17T23:48:38.077 INFO:tasks.workunit.client.0.smithi067.stdout:8/923: dwrite d6/db/f5e [0,4194304] 0 2024-01-17T23:48:38.206 INFO:tasks.workunit.client.0.smithi067.stdout:3/891: truncate d0/d12/d1b/f8b 985506 0 2024-01-17T23:48:38.207 INFO:tasks.workunit.client.0.smithi067.stdout:3/892: write d0/d17/f10c [665464,15645] 0 2024-01-17T23:48:38.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/907: mknod d6/d9/d30/d4c/d82/c12c 0 2024-01-17T23:48:38.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/857: mknod d3/d5/d93/d9e/c11a 0 2024-01-17T23:48:38.673 INFO:tasks.workunit.client.0.smithi067.stdout:5/815: truncate d10/f88 2060506 0 2024-01-17T23:48:38.673 INFO:tasks.workunit.client.0.smithi067.stdout:9/853: rename d3/d6/da4/dba/cca to d3/d6/d11/c12c 0 2024-01-17T23:48:38.770 INFO:tasks.workunit.client.0.smithi067.stdout:0/933: creat d3/d64/d82/de8/f152 x:0 0 0 2024-01-17T23:48:39.040 INFO:tasks.workunit.client.0.smithi067.stdout:1/865: symlink d0/ddc/l115 0 2024-01-17T23:48:39.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/893: getdents d0/d34/d35/d65/d6f 0 2024-01-17T23:48:39.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/894: stat d0/d17/d69/d6e/f84 0 2024-01-17T23:48:39.757 INFO:tasks.workunit.client.0.smithi067.stdout:3/895: dwrite d0/d17/dc8/fa3 [0,4194304] 0 2024-01-17T23:48:39.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/908: symlink d6/d81/dc7/l12d 0 2024-01-17T23:48:39.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/858: symlink d3/d4e/dee/l11b 0 2024-01-17T23:48:39.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/909: read d6/d9/d3e/f92 [207707,91739] 0 2024-01-17T23:48:39.770 INFO:tasks.workunit.client.0.smithi067.stdout:3/896: dread d0/d17/dc8/dae/fe8 [0,4194304] 0 2024-01-17T23:48:40.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/863: rename d4/d25/d39/d46/d60/dc7/cd0 to d4/d16/dc3/c109 0 2024-01-17T23:48:40.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/934: mkdir d3/d5/d122/d9f/d153 0 2024-01-17T23:48:40.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/864: write d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/f107 [527337,116148] 0 2024-01-17T23:48:40.228 INFO:tasks.workunit.client.0.smithi067.stdout:9/854: dread d3/d6/da4/dba/fe6 [0,4194304] 0 2024-01-17T23:48:40.544 INFO:tasks.workunit.client.0.smithi067.stdout:1/866: dread d0/d7/d13/d3a/d3e/f88 [0,4194304] 0 2024-01-17T23:48:41.127 INFO:tasks.workunit.client.0.smithi067.stdout:4/859: mknod d3/d4e/dee/d20/d101/c11c 0 2024-01-17T23:48:41.131 INFO:tasks.workunit.client.0.smithi067.stdout:4/860: dread d3/d4e/fa3 [0,4194304] 0 2024-01-17T23:48:41.650 INFO:tasks.workunit.client.0.smithi067.stdout:2/867: rename d5/d1f/d16/d7d to d5/d1f/d2a/d54/d8/d4c/de3/d12e/d132 0 2024-01-17T23:48:41.650 INFO:tasks.workunit.client.0.smithi067.stdout:2/868: fdatasync d5/d1f/d2a/d55/fba 0 2024-01-17T23:48:41.650 INFO:tasks.workunit.client.0.smithi067.stdout:2/869: fdatasync d5/d1f/d2a/d54/d8/d32/ff8 0 2024-01-17T23:48:41.651 INFO:tasks.workunit.client.0.smithi067.stdout:2/870: fsync d5/d2f/f8f 0 2024-01-17T23:48:41.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/935: mknod d3/d5/d122/c154 0 2024-01-17T23:48:41.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/865: link d4/d25/d39/d8a/d92/faa d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb/f10a 0 2024-01-17T23:48:41.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/866: write d4/fbc [569112,66917] 0 2024-01-17T23:48:42.178 INFO:tasks.workunit.client.0.smithi067.stdout:9/855: creat d3/d6/d47/d10a/f12d x:0 0 0 2024-01-17T23:48:43.562 INFO:tasks.workunit.client.0.smithi067.stdout:2/871: mknod d5/d1f/d2a/d54/d8/d4c/db3/c133 0 2024-01-17T23:48:43.596 INFO:tasks.workunit.client.0.smithi067.stdout:2/872: dwrite d5/d1f/d2a/d54/d8/d4c/d84/f89 [0,4194304] 0 2024-01-17T23:48:43.884 INFO:tasks.workunit.client.0.smithi067.stdout:0/936: link d3/d5/d1a/d1c/d4d/lcd d3/d4c/l155 0 2024-01-17T23:48:43.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/867: unlink d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/lc5 0 2024-01-17T23:48:43.960 INFO:tasks.workunit.client.0.smithi067.stdout:9/856: creat d3/d6/d2a/d34/f12e x:0 0 0 2024-01-17T23:48:44.259 INFO:tasks.workunit.client.0.smithi067.stdout:2/873: unlink d5/d1f/d2a/d54/d39/d68/dd6/cd9 0 2024-01-17T23:48:44.259 INFO:tasks.workunit.client.0.smithi067.stdout:2/874: readlink d5/l79 0 2024-01-17T23:48:44.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/924: write d6/d26/d7c/fc4 [237386,93621] 0 2024-01-17T23:48:44.454 INFO:tasks.workunit.client.0.smithi067.stdout:7/868: unlink d4/d25/d39/d46/f50 0 2024-01-17T23:48:44.496 INFO:tasks.workunit.client.0.smithi067.stdout:7/869: dwrite d4/d4b/d63/d95/dad/dcc/fab [0,4194304] 0 2024-01-17T23:48:44.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/870: dwrite d4/d16/f1e [0,4194304] 0 2024-01-17T23:48:44.598 INFO:tasks.workunit.client.0.smithi067.stdout:9/857: creat d3/d6/d2a/da2/de2/f12f x:0 0 0 2024-01-17T23:48:44.823 INFO:tasks.workunit.client.0.smithi067.stdout:2/875: rmdir d5/d1f/d2a/d73/d95 39 2024-01-17T23:48:44.824 INFO:tasks.workunit.client.0.smithi067.stdout:2/876: fsync d5/d1f/d2a/d54/d8/d4c/d84/fe7 0 2024-01-17T23:48:44.923 INFO:tasks.workunit.client.0.smithi067.stdout:0/937: mknod d3/d5/d1a/c156 0 2024-01-17T23:48:45.038 INFO:tasks.workunit.client.0.smithi067.stdout:8/925: mkdir d6/d19/dcf/d113/d130/d133 0 2024-01-17T23:48:45.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:45.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:48:45.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/816: rmdir d10 39 2024-01-17T23:48:45.750 INFO:tasks.workunit.client.0.smithi067.stdout:7/871: creat d4/d4b/d7f/ddd/f10b x:0 0 0 2024-01-17T23:48:45.750 INFO:tasks.workunit.client.0.smithi067.stdout:7/872: chown d4/d4b/d63/d95/dad/dcc/cf1 14964138 1 2024-01-17T23:48:46.003 INFO:tasks.workunit.client.0.smithi067.stdout:1/867: dwrite d0/d7/f66 [0,4194304] 0 2024-01-17T23:48:46.352 INFO:tasks.workunit.client.0.smithi067.stdout:2/877: unlink d5/d1f/d98/fc5 0 2024-01-17T23:48:46.510 INFO:tasks.workunit.client.0.smithi067.stdout:0/938: link d3/d5/d1a/d1c/d4e/d6b/la7 d3/d5/d1a/d1c/d4e/d6b/l157 0 2024-01-17T23:48:46.637 INFO:tasks.workunit.client.0.smithi067.stdout:8/926: creat d6/d26/d3e/da6/f134 x:0 0 0 2024-01-17T23:48:46.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/817: fdatasync d10/d24/d59/d5d/f9f 0 2024-01-17T23:48:46.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/818: truncate d10/d53/fe3 1293947 0 2024-01-17T23:48:46.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/819: chown d10/d24/d25/d5c/d107/d4a/d50/d5a/c60 65 1 2024-01-17T23:48:46.839 INFO:tasks.workunit.client.0.smithi067.stdout:5/820: truncate d10/d24/f81 407200 0 2024-01-17T23:48:47.321 INFO:tasks.workunit.client.0.smithi067.stdout:2/878: truncate d5/d1f/f3c 4348427 0 2024-01-17T23:48:47.321 INFO:tasks.workunit.client.0.smithi067.stdout:8/927: mknod d6/d26/d56/dbb/dfd/c135 0 2024-01-17T23:48:47.321 INFO:tasks.workunit.client.0.smithi067.stdout:8/928: readlink d6/d19/d22/le6 0 2024-01-17T23:48:47.321 INFO:tasks.workunit.client.0.smithi067.stdout:0/939: creat d3/d5/d122/dc5/f158 x:0 0 0 2024-01-17T23:48:47.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/879: dwrite d5/d86/fef [0,4194304] 0 2024-01-17T23:48:47.479 INFO:tasks.workunit.client.0.smithi067.stdout:5/821: link d10/d24/d59/d8c/caf d10/d24/d59/d8c/dba/c10c 0 2024-01-17T23:48:47.633 INFO:tasks.workunit.client.0.smithi067.stdout:7/873: getdents d4/d4b/d63/d9c 0 2024-01-17T23:48:48.031 INFO:tasks.workunit.client.0.smithi067.stdout:0/940: symlink d3/d5/d1a/d1c/d4e/d7c/dd0/l159 0 2024-01-17T23:48:48.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/941: dread d3/d5/f38 [0,4194304] 0 2024-01-17T23:48:48.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/942: read d3/d5/d1a/d1c/d4e/f124 [154884,73438] 0 2024-01-17T23:48:48.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/943: chown d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/ced 8272887 1 2024-01-17T23:48:48.049 INFO:tasks.workunit.client.0.smithi067.stdout:0/944: chown d3/d6/dd/d107/f12b 180580 1 2024-01-17T23:48:48.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/929: rename d6/d19/d22/d25/f59 to d6/d19/d22/d25/d53/dbd/f136 0 2024-01-17T23:48:48.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/930: readlink d6/d19/d22/d25/d53/l129 0 2024-01-17T23:48:48.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/931: dwrite d6/d26/d56/dbb/dfd/d5f/fb7 [0,4194304] 0 2024-01-17T23:48:48.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/932: readlink d6/l1c 0 2024-01-17T23:48:48.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/933: chown d6/d19/d22/le6 3840 1 2024-01-17T23:48:48.171 INFO:tasks.workunit.client.0.smithi067.stdout:8/934: read - d6/d19/d22/d25/d53/d65/f12b zero size 2024-01-17T23:48:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:0/945: mknod d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d108/c15a 0 2024-01-17T23:48:49.261 INFO:tasks.workunit.client.0.smithi067.stdout:8/935: creat d6/d26/d7c/dd0/f137 x:0 0 0 2024-01-17T23:48:49.440 INFO:tasks.workunit.client.0.smithi067.stdout:0/946: rmdir d3/d5 39 2024-01-17T23:48:49.440 INFO:tasks.workunit.client.0.smithi067.stdout:0/947: creat d3/d75/f15b x:0 0 0 2024-01-17T23:48:49.909 INFO:tasks.workunit.client.0.smithi067.stdout:0/948: unlink d3/la9 0 2024-01-17T23:48:49.909 INFO:tasks.workunit.client.0.smithi067.stdout:0/949: chown d3/d4c/l155 37 1 2024-01-17T23:48:50.026 INFO:tasks.workunit.client.0.smithi067.stdout:5/822: rename d10/d24/d25/d5c/d7e/d7f/d92 to d10/d24/d59/d5d/dce/d10d 0 2024-01-17T23:48:50.258 INFO:tasks.workunit.client.0.smithi067.stdout:0/950: dread d3/d5/d1a/d1c/d4e/d6b/fc7 [0,4194304] 0 2024-01-17T23:48:50.292 INFO:tasks.workunit.client.0.smithi067.stdout:0/951: dwrite d3/d5/d122/dc5/ff8 [0,4194304] 0 2024-01-17T23:48:50.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/874: rename d4/d4b/fce to d4/d25/d39/d46/da8/db0/f10c 0 2024-01-17T23:48:51.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/875: unlink d4/d25/d39/d79/dde/le8 0 2024-01-17T23:48:51.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/876: chown d4/d4b/d7f/f106 15470985 1 2024-01-17T23:48:51.501 INFO:tasks.workunit.client.0.smithi067.stdout:3/897: creat d0/f116 x:0 0 0 2024-01-17T23:48:51.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/877: fdatasync d4/ffc 0 2024-01-17T23:48:51.502 INFO:tasks.workunit.client.0.smithi067.stdout:5/823: rename d10/d24/d25/d5c/d107/d4a/d4b/c90 to d10/d24/d59/d8c/dae/dda/c10e 0 2024-01-17T23:48:51.502 INFO:tasks.workunit.client.0.smithi067.stdout:5/824: dread - d10/d24/f10a zero size 2024-01-17T23:48:51.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/898: dwrite d0/d34/de3/f103 [0,4194304] 0 2024-01-17T23:48:51.660 INFO:tasks.workunit.client.0.smithi067.stdout:1/868: write d0/d69/f71 [1765394,59807] 0 2024-01-17T23:48:52.278 INFO:tasks.workunit.client.0.smithi067.stdout:5/825: unlink d10/d24/d25/d5c/d107/f7c 0 2024-01-17T23:48:52.307 INFO:tasks.workunit.client.0.smithi067.stdout:5/826: dwrite d10/d24/d59/fd1 [0,4194304] 0 2024-01-17T23:48:52.307 INFO:tasks.workunit.client.0.smithi067.stdout:5/827: stat d10/d24/d25/d5c 0 2024-01-17T23:48:52.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/828: dwrite d10/d24/db4/fbf [0,4194304] 0 2024-01-17T23:48:52.338 INFO:tasks.workunit.client.0.smithi067.stdout:5/829: dread d10/d24/d25/d5c/d107/d4a/d63/ff2 [0,4194304] 0 2024-01-17T23:48:52.785 INFO:tasks.workunit.client.0.smithi067.stdout:3/899: creat d0/d34/d35/d65/d6f/f117 x:0 0 0 2024-01-17T23:48:53.394 INFO:tasks.workunit.client.0.smithi067.stdout:2/880: dwrite d5/d1f/d2a/d54/f1a [4194304,4194304] 0 2024-01-17T23:48:53.735 INFO:tasks.workunit.client.0.smithi067.stdout:6/910: link d6/d9/l22 d6/l12e 0 2024-01-17T23:48:53.767 INFO:tasks.workunit.client.0.smithi067.stdout:5/830: truncate d10/d24/d25/f2a 2849942 0 2024-01-17T23:48:53.767 INFO:tasks.workunit.client.0.smithi067.stdout:3/900: symlink d0/de1/dd5/l118 0 2024-01-17T23:48:53.817 INFO:tasks.workunit.client.0.smithi067.stdout:1/869: dread d0/d7/d13/d3d/d48/da4/fcd [0,4194304] 0 2024-01-17T23:48:53.817 INFO:tasks.workunit.client.0.smithi067.stdout:1/870: write d0/d7/d13/d77/f113 [854505,44853] 0 2024-01-17T23:48:53.817 INFO:tasks.workunit.client.0.smithi067.stdout:1/871: getdents d0/d62 0 2024-01-17T23:48:53.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/872: dwrite d0/d7/d13/d77/fcb [0,4194304] 0 2024-01-17T23:48:53.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/881: dread d5/d1f/d2a/d54/d8/d4c/d84/da9/fcd [0,4194304] 0 2024-01-17T23:48:54.028 INFO:tasks.workunit.client.0.smithi067.stdout:6/911: rmdir d6/d9/d65/dde/df5 0 2024-01-17T23:48:54.197 INFO:tasks.workunit.client.0.smithi067.stdout:5/831: symlink d10/d24/d25/d5c/d107/l10f 0 2024-01-17T23:48:54.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/901: rename d0/d34/d35/d57/fdd to d0/de1/d75/dd0/dd8/f119 0 2024-01-17T23:48:54.465 INFO:tasks.workunit.client.0.smithi067.stdout:3/902: dread d0/d17/fa8 [0,4194304] 0 2024-01-17T23:48:54.873 INFO:tasks.workunit.client.0.smithi067.stdout:1/873: mkdir d0/d7/d13/d77/d95/d116 0 2024-01-17T23:48:54.934 INFO:tasks.workunit.client.0.smithi067.stdout:8/936: write d6/d26/f36 [163175,1190] 0 2024-01-17T23:48:55.062 INFO:tasks.workunit.client.0.smithi067.stdout:6/912: dread - d6/d9/d84/fbc zero size 2024-01-17T23:48:55.272 INFO:tasks.workunit.client.0.smithi067.stdout:5/832: creat d10/d24/d25/d5c/d107/d4a/d50/f110 x:0 0 0 2024-01-17T23:48:55.272 INFO:tasks.workunit.client.0.smithi067.stdout:5/833: readlink d10/d24/d25/le9 0 2024-01-17T23:48:55.570 INFO:tasks.workunit.client.0.smithi067.stdout:1/874: truncate d0/d7/f55 16121 0 2024-01-17T23:48:55.570 INFO:tasks.workunit.client.0.smithi067.stdout:3/903: unlink d0/d17/dc8/l68 0 2024-01-17T23:48:55.583 INFO:tasks.workunit.client.0.smithi067.stdout:3/904: dread d0/d17/fa8 [0,4194304] 0 2024-01-17T23:48:56.099 INFO:tasks.workunit.client.0.smithi067.stdout:0/952: dwrite d3/d6/dd/fb8 [0,4194304] 0 2024-01-17T23:48:56.099 INFO:tasks.workunit.client.0.smithi067.stdout:0/953: chown d3/d5/d1a/d1c/d4e/lda 430 1 2024-01-17T23:48:56.581 INFO:tasks.workunit.client.0.smithi067.stdout:2/882: creat d5/f134 x:0 0 0 2024-01-17T23:48:56.585 INFO:tasks.workunit.client.0.smithi067.stdout:4/861: sync 2024-01-17T23:48:56.704 INFO:tasks.workunit.client.0.smithi067.stdout:7/878: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/f3a [0,4194304] 0 2024-01-17T23:48:56.704 INFO:tasks.workunit.client.0.smithi067.stdout:7/879: truncate d4/d4b/d63/db7/fd2 535327 0 2024-01-17T23:48:56.869 INFO:tasks.workunit.client.0.smithi067.stdout:1/875: rename d0/d74/feb to d0/d74/f117 0 2024-01-17T23:48:57.081 INFO:tasks.workunit.client.0.smithi067.stdout:6/913: rmdir d6/d9/d30/d4c/d8d 39 2024-01-17T23:48:57.394 INFO:tasks.workunit.client.0.smithi067.stdout:0/954: creat d3/d5/d12c/f15c x:0 0 0 2024-01-17T23:48:57.434 INFO:tasks.workunit.client.0.smithi067.stdout:0/955: dwrite d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d108/d14e/f100 [0,4194304] 0 2024-01-17T23:48:57.434 INFO:tasks.workunit.client.0.smithi067.stdout:0/956: chown d3/d64/d82/de8/c112 48160 1 2024-01-17T23:48:57.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/858: sync 2024-01-17T23:48:57.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/883: symlink d5/d1f/d2a/d54/d8/d32/d9c/l135 0 2024-01-17T23:48:57.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/884: fdatasync d5/d1f/d2a/d54/d8/d32/d33/f130 0 2024-01-17T23:48:57.845 INFO:tasks.workunit.client.0.smithi067.stdout:4/862: creat d3/d4e/dee/d20/d52/f11d x:0 0 0 2024-01-17T23:48:57.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/880: dread d4/d25/d39/d46/d78/d93/fcd [0,4194304] 0 2024-01-17T23:48:57.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/881: readlink d4/d25/d39/d46/l77 0 2024-01-17T23:48:57.975 INFO:tasks.workunit.client.0.smithi067.stdout:7/882: dread f1 [0,4194304] 0 2024-01-17T23:48:57.975 INFO:tasks.workunit.client.0.smithi067.stdout:7/883: fsync d4/d4b/d63/fd1 0 2024-01-17T23:48:58.244 INFO:tasks.workunit.client.0.smithi067.stdout:1/876: rename d0/d7/d13/d2e/f6d to d0/d7/d13/d3d/dd0/f118 0 2024-01-17T23:48:58.267 INFO:tasks.workunit.client.0.smithi067.stdout:3/905: link d0/d37/dbb/fe4 d0/d34/d35/f11a 0 2024-01-17T23:48:58.267 INFO:tasks.workunit.client.0.smithi067.stdout:3/906: readlink d0/d34/d35/d65/d6f/l95 0 2024-01-17T23:48:58.279 INFO:tasks.workunit.client.0.smithi067.stdout:3/907: dread d0/d12/d1b/f2d [0,4194304] 0 2024-01-17T23:48:58.280 INFO:tasks.workunit.client.0.smithi067.stdout:3/908: write d0/d34/d35/d57/f114 [213322,85438] 0 2024-01-17T23:48:58.473 INFO:tasks.workunit.client.0.smithi067.stdout:6/914: link d6/d81/dc7/f109 d6/d9/d30/f12f 0 2024-01-17T23:48:59.028 INFO:tasks.workunit.client.0.smithi067.stdout:0/957: mkdir d3/d6/dd/d107/d143/d15d 0 2024-01-17T23:48:59.028 INFO:tasks.workunit.client.0.smithi067.stdout:0/958: dread - d3/d6/dd/d107/f12b zero size 2024-01-17T23:48:59.028 INFO:tasks.workunit.client.0.smithi067.stdout:0/959: chown d3/d64/lba 178708 1 2024-01-17T23:48:59.028 INFO:tasks.workunit.client.0.smithi067.stdout:0/960: chown d3/d6/dd/d43/f59 14875 1 2024-01-17T23:48:59.263 INFO:tasks.workunit.client.0.smithi067.stdout:2/885: dread d5/d1f/f3c [0,4194304] 0 2024-01-17T23:48:59.263 INFO:tasks.workunit.client.0.smithi067.stdout:2/886: chown d5/d1f/d2a/d55/c7e 630 1 2024-01-17T23:48:59.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/863: truncate d3/d4e/f63 2187563 0 2024-01-17T23:48:59.655 INFO:tasks.workunit.client.0.smithi067.stdout:7/884: link d4/d25/d39/d46/d78/d93/fa1 d4/d4b/d63/d95/dad/dcc/f10d 0 2024-01-17T23:48:59.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/859: rename d3/d6/d2a/d34/d42/f8e to d3/df0/f130 0 2024-01-17T23:48:59.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/860: fsync d3/d6/da4/d55/f7b 0 2024-01-17T23:48:59.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/861: dread - d3/d6/d10/f10c zero size 2024-01-17T23:49:00.081 INFO:tasks.workunit.client.0.smithi067.stdout:3/909: truncate d0/d17/dc8/dae/fe8 3736773 0 2024-01-17T23:49:00.082 INFO:tasks.workunit.client.0.smithi067.stdout:3/910: chown d0/d17/dc8/la5 2129 1 2024-01-17T23:49:00.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/915: symlink d6/d9/d3e/l130 0 2024-01-17T23:49:00.422 INFO:tasks.workunit.client.0.smithi067.stdout:0/961: mkdir d3/d6/d80/d15e 0 2024-01-17T23:49:00.434 INFO:tasks.workunit.client.0.smithi067.stdout:0/962: dread d3/d5/d1a/d1c/d4e/d7c/dd0/dbc/d10c/d10d/d108/d14e/f100 [0,4194304] 0 2024-01-17T23:49:00.547 INFO:tasks.workunit.client.0.smithi067.stdout:4/864: mknod d3/d4e/dee/d20/d3b/c11e 0 2024-01-17T23:49:00.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/834: write d10/d53/f83 [80415,110169] 0 2024-01-17T23:49:00.858 INFO:tasks.workunit.client.0.smithi067.stdout:7/885: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d41/ffa [0,4194304] 0 2024-01-17T23:49:00.875 INFO:tasks.workunit.client.0.smithi067.stdout:7/886: dread d4/d4b/d63/fd1 [0,4194304] 0 2024-01-17T23:49:00.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/887: dread d4/d25/d39/d46/d60/f102 [0,4194304] 0 2024-01-17T23:49:01.078 INFO:tasks.workunit.client.0.smithi067.stdout:2/887: rename d5/d1f/d2a/d54/d8/d32/d33/l48 to d5/d1f/d2a/d54/d8/d4c/dbf/de2/l136 0 2024-01-17T23:49:01.078 INFO:tasks.workunit.client.0.smithi067.stdout:2/888: dread - d5/d1f/d2a/de1/f11d zero size 2024-01-17T23:49:01.096 INFO:tasks.workunit.client.0.smithi067.stdout:2/889: dread d5/d1f/d2a/d54/d8/d32/d33/f6f [0,4194304] 0 2024-01-17T23:49:01.117 INFO:tasks.workunit.client.0.smithi067.stdout:2/890: dwrite d5/d1f/d2a/d55/fcf [0,4194304] 0 2024-01-17T23:49:01.263 INFO:tasks.workunit.client.0.smithi067.stdout:9/862: unlink d3/d6/da4/d55/da1/dbc/d10f/f110 0 2024-01-17T23:49:01.507 INFO:tasks.workunit.client.0.smithi067.stdout:1/877: rmdir d0/d7/d13/d77 39 2024-01-17T23:49:01.508 INFO:tasks.workunit.client.0.smithi067.stdout:1/878: dread - d0/d7/d13/d3d/d48/fbc zero size 2024-01-17T23:49:01.508 INFO:tasks.workunit.client.0.smithi067.stdout:1/879: truncate d0/d62/f107 821546 0 2024-01-17T23:49:01.740 INFO:tasks.workunit.client.0.smithi067.stdout:3/911: getdents d0/d17/dc8/dae/d107/dea 0 2024-01-17T23:49:01.880 INFO:tasks.workunit.client.0.smithi067.stdout:6/916: mknod d6/d9/d84/c131 0 2024-01-17T23:49:01.981 INFO:tasks.workunit.client.0.smithi067.stdout:0/963: mkdir d3/d4c/d13a/d15f 0 2024-01-17T23:49:02.300 INFO:tasks.workunit.client.0.smithi067.stdout:5/835: getdents d10/d24 0 2024-01-17T23:49:02.300 INFO:tasks.workunit.client.0.smithi067.stdout:5/836: fsync d10/d24/f81 0 2024-01-17T23:49:02.937 INFO:tasks.workunit.client.0.smithi067.stdout:2/891: symlink d5/d1f/d2a/d54/d8/d32/l137 0 2024-01-17T23:49:02.937 INFO:tasks.workunit.client.0.smithi067.stdout:2/892: chown d5/d1f/d2a/d54/d8/fc9 767306883 1 2024-01-17T23:49:02.956 INFO:tasks.workunit.client.0.smithi067.stdout:2/893: write d5/d1f/d2a/d54/d39/fdb [3052636,71114] 0 2024-01-17T23:49:03.306 INFO:tasks.workunit.client.0.smithi067.stdout:9/863: rename d3/d6/d10/f10c to d3/d25/d5d/f131 0 2024-01-17T23:49:03.307 INFO:tasks.workunit.client.0.smithi067.stdout:9/864: write d3/d25/d5d/d79/fb7 [1187048,123543] 0 2024-01-17T23:49:03.566 INFO:tasks.workunit.client.0.smithi067.stdout:1/880: creat d0/d7/d13/d3a/d75/f119 x:0 0 0 2024-01-17T23:49:03.858 INFO:tasks.workunit.client.0.smithi067.stdout:3/912: creat d0/de1/d82/da6/d102/f11b x:0 0 0 2024-01-17T23:49:04.111 INFO:tasks.workunit.client.0.smithi067.stdout:6/917: truncate d6/d9/d3e/f3f 3845533 0 2024-01-17T23:49:04.923 INFO:tasks.workunit.client.0.smithi067.stdout:5/837: unlink d10/d24/d25/d5c/d107/d4a/d63/d85/lf4 0 2024-01-17T23:49:05.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/881: rename d0/f110 to d0/d74/f11a 0 2024-01-17T23:49:05.509 INFO:tasks.workunit.client.0.smithi067.stdout:8/937: rmdir d6/d26/d3e 39 2024-01-17T23:49:05.792 INFO:tasks.workunit.client.0.smithi067.stdout:6/918: getdents d6/d9/d1c/d1e/d43 0 2024-01-17T23:49:05.809 INFO:tasks.workunit.client.0.smithi067.stdout:6/919: dread d6/d9/d1c/d1e/f7f [0,4194304] 0 2024-01-17T23:49:05.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/920: dwrite d6/d9/d30/f70 [0,4194304] 0 2024-01-17T23:49:05.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/921: fdatasync d6/d9/de1/f111 0 2024-01-17T23:49:05.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/922: dwrite d6/f17 [4194304,4194304] 0 2024-01-17T23:49:06.372 INFO:tasks.workunit.client.0.smithi067.stdout:5/838: mkdir d10/d24/d59/d5d/dce/d10d/d111 0 2024-01-17T23:49:07.406 INFO:tasks.workunit.client.0.smithi067.stdout:6/923: creat d6/d9/d30/dbd/d124/f132 x:0 0 0 2024-01-17T23:49:07.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/865: write d3/d8/d35/fb1 [2842113,105260] 0 2024-01-17T23:49:07.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/866: chown d3/d4e/dee/d38/dab 21107 1 2024-01-17T23:49:07.929 INFO:tasks.workunit.client.0.smithi067.stdout:1/882: rename d0/d7/d13/d3a/d3e/c8b to d0/d7/d13/d3d/d48/da4/c11b 0 2024-01-17T23:49:07.930 INFO:tasks.workunit.client.0.smithi067.stdout:1/883: creat d0/d7/d13/d3d/d48/f11c x:0 0 0 2024-01-17T23:49:07.974 INFO:tasks.workunit.client.0.smithi067.stdout:7/888: write d4/d16/f29 [1598209,23142] 0 2024-01-17T23:49:07.976 INFO:tasks.workunit.client.0.smithi067.stdout:1/884: dwrite d0/d7/d13/d77/f113 [0,4194304] 0 2024-01-17T23:49:07.976 INFO:tasks.workunit.client.0.smithi067.stdout:1/885: dread - d0/d7/d13/d3a/d75/f119 zero size 2024-01-17T23:49:07.976 INFO:tasks.workunit.client.0.smithi067.stdout:1/886: write d0/d7/d13/d3a/d75/da1/fa2 [890789,11065] 0 2024-01-17T23:49:08.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/887: dwrite d0/d7/d13/d3d/dd0/fe0 [0,4194304] 0 2024-01-17T23:49:08.460 INFO:tasks.workunit.client.0.smithi067.stdout:7/889: creat d4/d4b/d63/f10e x:0 0 0 2024-01-17T23:49:08.460 INFO:tasks.workunit.client.0.smithi067.stdout:7/890: chown d4/d25/cfe 23289596 1 2024-01-17T23:49:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:1/888: unlink d0/d7/d1c/f54 0 2024-01-17T23:49:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:1/889: stat d0/d7/d13/d77 0 2024-01-17T23:49:09.256 INFO:tasks.workunit.client.0.smithi067.stdout:1/890: unlink d0/d7/d13/d3d/d48/fd6 0 2024-01-17T23:49:09.600 INFO:tasks.workunit.client.0.smithi067.stdout:1/891: rename d0/d62/f89 to d0/d7/d13/d3d/d48/f11d 0 2024-01-17T23:49:09.635 INFO:tasks.workunit.client.0.smithi067.stdout:0/964: sync 2024-01-17T23:49:10.036 INFO:tasks.workunit.client.0.smithi067.stdout:0/965: mknod d3/d64/d82/c160 0 2024-01-17T23:49:10.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/913: write d0/d34/d35/d65/f106 [299863,36394] 0 2024-01-17T23:49:10.283 INFO:tasks.workunit.client.0.smithi067.stdout:9/865: sync 2024-01-17T23:49:10.315 INFO:tasks.workunit.client.0.smithi067.stdout:3/914: dwrite d0/d34/d35/d65/d6f/fb2 [0,4194304] 0 2024-01-17T23:49:10.742 INFO:tasks.workunit.client.0.smithi067.stdout:2/894: write d5/d1f/d2a/d73/d95/fb7 [1110598,123245] 0 2024-01-17T23:49:10.742 INFO:tasks.workunit.client.0.smithi067.stdout:2/895: truncate d5/d1f/d2a/d54/d39/d68/fc1 292018 0 2024-01-17T23:49:10.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/896: read d5/d1f/d2a/d8d/fc8 [373960,116816] 0 2024-01-17T23:49:11.286 INFO:tasks.workunit.client.0.smithi067.stdout:9/866: mknod d3/d6/d2a/da2/de2/dd0/c132 0 2024-01-17T23:49:11.286 INFO:tasks.workunit.client.0.smithi067.stdout:2/897: getdents d5/d1f/d2a/d54/d39 0 2024-01-17T23:49:11.286 INFO:tasks.workunit.client.0.smithi067.stdout:2/898: fsync d5/d1f/d2a/d54/d39/d68/fb4 0 2024-01-17T23:49:11.315 INFO:tasks.workunit.client.0.smithi067.stdout:2/899: dwrite d5/d1f/d2a/d54/d39/d68/fb4 [0,4194304] 0 2024-01-17T23:49:11.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/900: dwrite d5/d1f/d16/d61/fa0 [0,4194304] 0 2024-01-17T23:49:11.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/901: write d5/d1f/d2a/d54/d8/d32/f9b [1936251,100219] 0 2024-01-17T23:49:11.555 INFO:tasks.workunit.client.0.smithi067.stdout:9/867: mkdir d3/d25/d5d/d79/d105/d133 0 2024-01-17T23:49:11.555 INFO:tasks.workunit.client.0.smithi067.stdout:9/868: creat d3/d6/d11/d50/d84/da8/da9/f134 x:0 0 0 2024-01-17T23:49:12.451 INFO:tasks.workunit.client.0.smithi067.stdout:9/869: creat d3/d6/d2a/f135 x:0 0 0 2024-01-17T23:49:12.451 INFO:tasks.workunit.client.0.smithi067.stdout:8/938: write d6/d19/d22/d25/d53/dbd/f136 [758808,76294] 0 2024-01-17T23:49:12.480 INFO:tasks.workunit.client.0.smithi067.stdout:4/867: write d3/d4e/f85 [2285867,125756] 0 2024-01-17T23:49:12.502 INFO:tasks.workunit.client.0.smithi067.stdout:6/924: dwrite d6/d9/d1c/d1e/d43/def/d51/fd9 [0,4194304] 0 2024-01-17T23:49:12.502 INFO:tasks.workunit.client.0.smithi067.stdout:6/925: read d6/d18/d2e/f40 [1418556,82569] 0 2024-01-17T23:49:12.520 INFO:tasks.workunit.client.0.smithi067.stdout:6/926: dread d6/f100 [0,4194304] 0 2024-01-17T23:49:12.534 INFO:tasks.workunit.client.0.smithi067.stdout:6/927: dread d6/d9/d1c/d1e/d43/def/fb5 [0,4194304] 0 2024-01-17T23:49:12.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/839: creat d10/f112 x:0 0 0 2024-01-17T23:49:12.810 INFO:tasks.workunit.client.0.smithi067.stdout:1/892: dwrite d0/f27 [4194304,4194304] 0 2024-01-17T23:49:13.122 INFO:tasks.workunit.client.0.smithi067.stdout:9/870: symlink d3/d6/da4/d55/l136 0 2024-01-17T23:49:13.122 INFO:tasks.workunit.client.0.smithi067.stdout:8/939: creat d6/d19/dcf/d113/d130/d133/f138 x:0 0 0 2024-01-17T23:49:13.122 INFO:tasks.workunit.client.0.smithi067.stdout:9/871: truncate d3/d6/d2a/da2/de2/dd0/fc3 1132349 0 2024-01-17T23:49:13.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/872: write d3/d6/f9 [2661852,6812] 0 2024-01-17T23:49:13.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/873: write d3/d6/d2a/d34/d42/d9c/f114 [324589,82794] 0 2024-01-17T23:49:13.155 INFO:tasks.workunit.client.0.smithi067.stdout:8/940: dwrite d6/d93/f116 [0,4194304] 0 2024-01-17T23:49:13.198 INFO:tasks.workunit.client.0.smithi067.stdout:4/868: rmdir d3/d26/d34/d65 39 2024-01-17T23:49:13.251 INFO:tasks.workunit.client.0.smithi067.stdout:4/869: dwrite d3/d5/d93/d9e/fed [0,4194304] 0 2024-01-17T23:49:13.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/870: dread d3/d4e/fd6 [0,4194304] 0 2024-01-17T23:49:13.580 INFO:tasks.workunit.client.0.smithi067.stdout:6/928: mkdir d6/d9/d65/da4/d133 0 2024-01-17T23:49:13.598 INFO:tasks.workunit.client.0.smithi067.stdout:6/929: dread d6/f88 [0,4194304] 0 2024-01-17T23:49:13.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/930: dwrite d6/d9/d30/d4c/d8d/f107 [0,4194304] 0 2024-01-17T23:49:13.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/931: readlink d6/d9/ddf/l117 0 2024-01-17T23:49:13.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/932: readlink d6/d9/d30/d4c/l80 0 2024-01-17T23:49:13.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/915: rename d0/d12/f20 to d0/d17/f11c 0 2024-01-17T23:49:13.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/916: dread - d0/de1/d75/dcb/fee zero size 2024-01-17T23:49:13.685 INFO:tasks.workunit.client.0.smithi067.stdout:3/917: dread d0/d34/d35/d65/d6f/fa2 [0,4194304] 0 2024-01-17T23:49:13.931 INFO:tasks.workunit.client.0.smithi067.stdout:5/840: creat d10/d24/d25/d5c/d107/d4a/d50/d5a/f113 x:0 0 0 2024-01-17T23:49:13.931 INFO:tasks.workunit.client.0.smithi067.stdout:5/841: read - d10/d24/d25/d5c/d107/d4a/d50/f110 zero size 2024-01-17T23:49:13.931 INFO:tasks.workunit.client.0.smithi067.stdout:1/893: truncate d0/d62/f9c 1447357 0 2024-01-17T23:49:14.082 INFO:tasks.workunit.client.0.smithi067.stdout:9/874: symlink d3/d6/d2a/d34/d42/l137 0 2024-01-17T23:49:14.082 INFO:tasks.workunit.client.0.smithi067.stdout:9/875: write d3/d6/da4/d55/fa3 [3845680,50052] 0 2024-01-17T23:49:14.082 INFO:tasks.workunit.client.0.smithi067.stdout:9/876: read d3/d6/d2a/d34/d42/d9c/fed [540400,29008] 0 2024-01-17T23:49:14.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/941: symlink d6/d19/db4/dde/l139 0 2024-01-17T23:49:14.292 INFO:tasks.workunit.client.0.smithi067.stdout:8/942: dread d6/d26/d3e/d87/f94 [0,4194304] 0 2024-01-17T23:49:14.292 INFO:tasks.workunit.client.0.smithi067.stdout:8/943: dread - d6/d26/d7c/dd0/f137 zero size 2024-01-17T23:49:14.301 INFO:tasks.workunit.client.0.smithi067.stdout:8/944: dread d6/d26/d3e/d87/f94 [0,4194304] 0 2024-01-17T23:49:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:4/871: mknod d3/d40/dc8/c11f 0 2024-01-17T23:49:15.037 INFO:tasks.workunit.client.0.smithi067.stdout:2/902: rename d5/d1f/d16/ca7 to d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/c138 0 2024-01-17T23:49:15.128 INFO:tasks.workunit.client.0.smithi067.stdout:3/918: creat d0/d17/d69/d6e/f11d x:0 0 0 2024-01-17T23:49:15.128 INFO:tasks.workunit.client.0.smithi067.stdout:3/919: dread - d0/d12/d1b/fcd zero size 2024-01-17T23:49:15.268 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:15.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:15.273 INFO:tasks.workunit.client.0.smithi067.stdout:5/842: stat d10/d24/db4/ldc 0 2024-01-17T23:49:15.578 INFO:tasks.workunit.client.0.smithi067.stdout:9/877: mknod d3/d25/d5d/d79/c138 0 2024-01-17T23:49:15.707 INFO:tasks.workunit.client.0.smithi067.stdout:8/945: creat d6/d26/d3e/d87/dd8/d11b/f13a x:0 0 0 2024-01-17T23:49:15.707 INFO:tasks.workunit.client.0.smithi067.stdout:8/946: dread - d6/d26/d7c/df8/dfb/f103 zero size 2024-01-17T23:49:15.707 INFO:tasks.workunit.client.0.smithi067.stdout:8/947: truncate d6/d26/d7c/df8/dfb/f103 172294 0 2024-01-17T23:49:15.745 INFO:tasks.workunit.client.0.smithi067.stdout:8/948: dwrite d6/d19/d22/d25/d53/d65/f78 [0,4194304] 0 2024-01-17T23:49:15.997 INFO:tasks.workunit.client.0.smithi067.stdout:6/933: link d6/d9/d30/d58/fa8 d6/d9/de1/f134 0 2024-01-17T23:49:16.074 INFO:tasks.workunit.client.0.smithi067.stdout:2/903: mkdir d5/d1f/d2a/d54/d7c/d139 0 2024-01-17T23:49:16.074 INFO:tasks.workunit.client.0.smithi067.stdout:2/904: fsync d5/f78 0 2024-01-17T23:49:16.074 INFO:tasks.workunit.client.0.smithi067.stdout:6/934: write d6/d18/f1d [1611468,115853] 0 2024-01-17T23:49:16.075 INFO:tasks.workunit.client.0.smithi067.stdout:3/920: mkdir d0/de1/d11e 0 2024-01-17T23:49:16.075 INFO:tasks.workunit.client.0.smithi067.stdout:3/921: readlink d0/d12/l7a 0 2024-01-17T23:49:16.075 INFO:tasks.workunit.client.0.smithi067.stdout:6/935: dread d6/d18/f1d [0,4194304] 0 2024-01-17T23:49:16.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/905: write d5/d86/fef [440169,100047] 0 2024-01-17T23:49:16.114 INFO:tasks.workunit.client.0.smithi067.stdout:7/891: sync 2024-01-17T23:49:16.115 INFO:tasks.workunit.client.0.smithi067.stdout:0/966: sync 2024-01-17T23:49:16.115 INFO:tasks.workunit.client.0.smithi067.stdout:7/892: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f10f x:0 0 0 2024-01-17T23:49:17.037 INFO:tasks.workunit.client.0.smithi067.stdout:1/894: creat d0/d7/d93/f11e x:0 0 0 2024-01-17T23:49:17.038 INFO:tasks.workunit.client.0.smithi067.stdout:1/895: write d0/d7/d13/d3a/d3e/ffb [617129,48702] 0 2024-01-17T23:49:17.169 INFO:tasks.workunit.client.0.smithi067.stdout:9/878: symlink d3/d6/da4/d55/d115/d11d/d12b/l139 0 2024-01-17T23:49:17.202 INFO:tasks.workunit.client.0.smithi067.stdout:9/879: dwrite d3/d6/d2e/fe5 [0,4194304] 0 2024-01-17T23:49:17.591 INFO:tasks.workunit.client.0.smithi067.stdout:4/872: unlink d3/d8/d35/c4f 0 2024-01-17T23:49:17.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/873: chown d3/d26/d34/d65 45700736 1 2024-01-17T23:49:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/922: getdents d0/d34/d35/d65/d6f/d70 0 2024-01-17T23:49:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/923: creat d0/d34/de3/f11f x:0 0 0 2024-01-17T23:49:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/924: fsync d0/d17/f5e 0 2024-01-17T23:49:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:3/925: fsync d0/d12/d98/ff2 0 2024-01-17T23:49:17.821 INFO:tasks.workunit.client.0.smithi067.stdout:3/926: dwrite d0/d34/de3/f103 [0,4194304] 0 2024-01-17T23:49:17.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/927: dwrite d0/f99 [0,4194304] 0 2024-01-17T23:49:17.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/928: fsync d0/d34/de3/f103 0 2024-01-17T23:49:17.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/929: fdatasync d0/f11 0 2024-01-17T23:49:17.858 INFO:tasks.workunit.client.0.smithi067.stdout:3/930: write d0/d34/d35/d57/ff1 [413379,23502] 0 2024-01-17T23:49:17.858 INFO:tasks.workunit.client.0.smithi067.stdout:3/931: readlink d0/d37/l112 0 2024-01-17T23:49:17.966 INFO:tasks.workunit.client.0.smithi067.stdout:6/936: creat d6/d9/d30/d4c/d8d/f135 x:0 0 0 2024-01-17T23:49:18.704 INFO:tasks.workunit.client.0.smithi067.stdout:7/893: mkdir d4/d25/d39/d46/d60/d110 0 2024-01-17T23:49:19.186 INFO:tasks.workunit.client.0.smithi067.stdout:8/949: getdents d6/d19/dcf 0 2024-01-17T23:49:19.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/874: dread d3/d4e/dee/da6/fb6 [0,4194304] 0 2024-01-17T23:49:19.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/875: write d3/d4e/dee/d20/f56 [1757142,37467] 0 2024-01-17T23:49:19.249 INFO:tasks.workunit.client.0.smithi067.stdout:4/876: dread d3/d5/f2e [0,4194304] 0 2024-01-17T23:49:19.872 INFO:tasks.workunit.client.0.smithi067.stdout:3/932: symlink d0/d13/l120 0 2024-01-17T23:49:19.892 INFO:tasks.workunit.client.0.smithi067.stdout:3/933: write d0/d12/d1b/f1d [3349551,35068] 0 2024-01-17T23:49:20.454 INFO:tasks.workunit.client.0.smithi067.stdout:6/937: unlink d6/d18/d2e/l35 0 2024-01-17T23:49:20.530 INFO:tasks.workunit.client.0.smithi067.stdout:7/894: dread d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fd7 [4194304,4194304] 0 2024-01-17T23:49:20.983 INFO:tasks.workunit.client.0.smithi067.stdout:5/843: sync 2024-01-17T23:49:21.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/880: rename d3/d6/da4/d55/da1/d12a to d3/d6/d2a/da2/de2/d13a 0 2024-01-17T23:49:21.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/881: read d3/d6/d2e/f99 [444417,58754] 0 2024-01-17T23:49:21.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/882: write d3/d6/d2a/f3f [4067543,99857] 0 2024-01-17T23:49:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:8/950: creat d6/d19/d22/d25/f13b x:0 0 0 2024-01-17T23:49:21.427 INFO:tasks.workunit.client.0.smithi067.stdout:8/951: dwrite d6/d19/d22/d25/d53/d65/f12b [0,4194304] 0 2024-01-17T23:49:21.812 INFO:tasks.workunit.client.0.smithi067.stdout:7/895: symlink d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/def/l111 0 2024-01-17T23:49:21.812 INFO:tasks.workunit.client.0.smithi067.stdout:0/967: write d3/f1b [2145112,34447] 0 2024-01-17T23:49:21.967 INFO:tasks.workunit.client.0.smithi067.stdout:2/906: sync 2024-01-17T23:49:21.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/907: dread d5/d1f/d2a/d54/d39/fdb [0,4194304] 0 2024-01-17T23:49:22.306 INFO:tasks.workunit.client.0.smithi067.stdout:9/883: unlink d3/d6/d2a/da2/dbd/fff 0 2024-01-17T23:49:22.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/896: dwrite d0/d7/f61 [0,4194304] 0 2024-01-17T23:49:22.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/897: read d0/f27 [2191351,90329] 0 2024-01-17T23:49:22.527 INFO:tasks.workunit.client.0.smithi067.stdout:8/952: rmdir d6/d26/d56/dbb/dfd/d5f 39 2024-01-17T23:49:22.756 INFO:tasks.workunit.client.0.smithi067.stdout:7/896: mkdir d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d112 0 2024-01-17T23:49:22.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/968: fsync d3/d5/d1a/f42 0 2024-01-17T23:49:22.835 INFO:tasks.workunit.client.0.smithi067.stdout:0/969: dwrite d3/d6/dd/d43/f59 [4194304,4194304] 0 2024-01-17T23:49:22.929 INFO:tasks.workunit.client.0.smithi067.stdout:2/908: unlink d5/d1f/d98/d9f/la6 0 2024-01-17T23:49:23.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/877: rename d3/d8/d35/f6e to d3/d4e/dee/d20/d3b/d7c/d92/f120 0 2024-01-17T23:49:23.566 INFO:tasks.workunit.client.0.smithi067.stdout:4/878: write d3/d4e/dee/d20/fb4 [5615201,99761] 0 2024-01-17T23:49:24.151 INFO:tasks.workunit.client.0.smithi067.stdout:8/953: mkdir d6/d19/db4/d13c 0 2024-01-17T23:49:24.324 INFO:tasks.workunit.client.0.smithi067.stdout:7/897: dread d4/d25/d39/d46/d78/d93/d94/dc4/f8d [0,4194304] 0 2024-01-17T23:49:24.700 INFO:tasks.workunit.client.0.smithi067.stdout:0/970: fsync d3/d5/d1a/d1c/f63 0 2024-01-17T23:49:24.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/844: rename d10/d24/d59/cbd to d10/d24/d25/d5c/d107/d4a/d4b/c114 0 2024-01-17T23:49:24.703 INFO:tasks.workunit.client.0.smithi067.stdout:0/971: dread d3/d5/d1a/d1c/d4e/d7c/f9e [0,4194304] 0 2024-01-17T23:49:24.720 INFO:tasks.workunit.client.0.smithi067.stdout:0/972: dread d3/d64/d82/ff7 [0,4194304] 0 2024-01-17T23:49:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:1/898: link d0/d7/d13/d3d/d48/da4/c101 d0/d7/d13/d77/d95/d116/c11f 0 2024-01-17T23:49:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/879: creat d3/d4e/dee/de6/f121 x:0 0 0 2024-01-17T23:49:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/880: dread - d3/d8/d35/f109 zero size 2024-01-17T23:49:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/881: fsync d3/d4e/fd6 0 2024-01-17T23:49:25.438 INFO:tasks.workunit.client.0.smithi067.stdout:7/898: mkdir d4/d25/d39/d46/da8/d113 0 2024-01-17T23:49:25.438 INFO:tasks.workunit.client.0.smithi067.stdout:2/909: rename d5/d1f/d2a/d54/d8/d32/l69 to d5/d1f/d2a/d54/d8/d4c/d84/l13a 0 2024-01-17T23:49:25.438 INFO:tasks.workunit.client.0.smithi067.stdout:2/910: fdatasync d5/d1f/d2a/d54/d8/d4c/f5f 0 2024-01-17T23:49:25.438 INFO:tasks.workunit.client.0.smithi067.stdout:2/911: truncate d5/d1f/d2a/d54/d8/d32/d33/f130 1018304 0 2024-01-17T23:49:25.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/912: dwrite d5/d1f/d2a/d54/d8/d32/d33/f130 [0,4194304] 0 2024-01-17T23:49:25.629 INFO:tasks.workunit.client.0.smithi067.stdout:0/973: symlink d3/d64/d82/d12e/l161 0 2024-01-17T23:49:25.661 INFO:tasks.workunit.client.0.smithi067.stdout:0/974: dwrite d3/d5/d122/dc5/f126 [0,4194304] 0 2024-01-17T23:49:25.837 INFO:tasks.workunit.client.0.smithi067.stdout:1/899: creat d0/d7/d13/d77/d95/d116/f120 x:0 0 0 2024-01-17T23:49:25.837 INFO:tasks.workunit.client.0.smithi067.stdout:4/882: mkdir d3/d40/dc8/d122 0 2024-01-17T23:49:26.201 INFO:tasks.workunit.client.0.smithi067.stdout:7/899: link d4/d25/d39/l68 d4/d25/d39/d46/d78/d93/l114 0 2024-01-17T23:49:26.203 INFO:tasks.workunit.client.0.smithi067.stdout:7/900: dread d4/d4b/d7f/f87 [0,4194304] 0 2024-01-17T23:49:26.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/901: dwrite d4/d25/d39/f35 [0,4194304] 0 2024-01-17T23:49:26.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/902: chown d4/d4b/f7a 5982 1 2024-01-17T23:49:26.597 INFO:tasks.workunit.client.0.smithi067.stdout:2/913: truncate d5/d1f/d2a/d55/fba 850432 0 2024-01-17T23:49:26.597 INFO:tasks.workunit.client.0.smithi067.stdout:0/975: chown d3/d5/d1a/d1c/c23 7725 1 2024-01-17T23:49:26.607 INFO:tasks.workunit.client.0.smithi067.stdout:4/883: read d3/d8/d35/db0/f102 [2542757,81379] 0 2024-01-17T23:49:26.607 INFO:tasks.workunit.client.0.smithi067.stdout:4/884: chown d3/d4e/dee/d20/fb5 1911171632 1 2024-01-17T23:49:26.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/900: rmdir d0/d7/d13/d3a/d75/da1/de8 39 2024-01-17T23:49:26.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/901: dwrite d0/d7/d13/d3d/d48/d4d/f105 [4194304,4194304] 0 2024-01-17T23:49:26.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/902: write d0/d69/f106 [121729,61876] 0 2024-01-17T23:49:26.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/903: dwrite d0/d7/d13/d3a/d75/ded/fb0 [0,4194304] 0 2024-01-17T23:49:26.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/904: readlink d0/d69/l70 0 2024-01-17T23:49:26.748 INFO:tasks.workunit.client.0.smithi067.stdout:1/905: dread d0/d7/d13/d3d/d48/d4d/fb8 [0,4194304] 0 2024-01-17T23:49:26.807 INFO:tasks.workunit.client.0.smithi067.stdout:7/903: rename d4/d25/d39/d8a/d92/deb/cee to d4/d25/d39/d8a/d92/deb/c115 0 2024-01-17T23:49:26.814 INFO:tasks.workunit.client.0.smithi067.stdout:7/904: dread d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fb5 [0,4194304] 0 2024-01-17T23:49:26.839 INFO:tasks.workunit.client.0.smithi067.stdout:7/905: dwrite d4/d25/d39/d8a/fe9 [0,4194304] 0 2024-01-17T23:49:26.839 INFO:tasks.workunit.client.0.smithi067.stdout:7/906: stat d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/ce5 0 2024-01-17T23:49:26.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/934: dwrite d0/d13/f3d [0,4194304] 0 2024-01-17T23:49:26.884 INFO:tasks.workunit.client.0.smithi067.stdout:3/935: dwrite d0/f3 [0,4194304] 0 2024-01-17T23:49:27.402 INFO:tasks.workunit.client.0.smithi067.stdout:2/914: truncate d5/d1f/d2a/d55/fcf 4043976 0 2024-01-17T23:49:27.505 INFO:tasks.workunit.client.0.smithi067.stdout:0/976: creat d3/d6/f162 x:0 0 0 2024-01-17T23:49:27.505 INFO:tasks.workunit.client.0.smithi067.stdout:0/977: chown d3/d5/d1a/d1c/d4e/lc3 590 1 2024-01-17T23:49:27.505 INFO:tasks.workunit.client.0.smithi067.stdout:0/978: fdatasync d3/d5/fe5 0 2024-01-17T23:49:28.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/906: truncate d0/d7/d13/d3a/d75/fbf 1073746 0 2024-01-17T23:49:28.544 INFO:tasks.workunit.client.0.smithi067.stdout:7/907: link d4/d4b/d7f/d82/cb2 d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/c116 0 2024-01-17T23:49:28.555 INFO:tasks.workunit.client.0.smithi067.stdout:7/908: read d4/d25/d39/d46/d60/f102 [815562,42247] 0 2024-01-17T23:49:28.987 INFO:tasks.workunit.client.0.smithi067.stdout:3/936: symlink d0/d34/d35/d65/d6f/l121 0 2024-01-17T23:49:29.247 INFO:tasks.workunit.client.0.smithi067.stdout:0/979: creat d3/d6/dd/d107/d143/d15d/f163 x:0 0 0 2024-01-17T23:49:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/885: dread - d3/d26/d34/d65/f86 zero size 2024-01-17T23:49:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/886: write d3/d4e/dee/d20/d101/f113 [82965,28993] 0 2024-01-17T23:49:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/887: chown d3/d4e/dee/f77 1 1 2024-01-17T23:49:29.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/888: stat d3/d26 0 2024-01-17T23:49:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:1/907: rename d0/d7/d7f/d82/l96 to d0/d7/d13/d77/l121 0 2024-01-17T23:49:29.550 INFO:tasks.workunit.client.0.smithi067.stdout:7/909: mknod d4/d4b/d7f/d82/c117 0 2024-01-17T23:49:29.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/937: getdents d0 0 2024-01-17T23:49:29.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/938: readlink d0/d17/d69/lf0 0 2024-01-17T23:49:29.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/980: chown d3/d5/d122/d7f/lfd 30 1 2024-01-17T23:49:29.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/981: stat d3/d5/d1a/d1c/d1d/d2e/f119 0 2024-01-17T23:49:29.900 INFO:tasks.workunit.client.0.smithi067.stdout:5/845: write d10/d24/d59/d5d/f51 [1609767,39928] 0 2024-01-17T23:49:30.053 INFO:tasks.workunit.client.0.smithi067.stdout:4/889: creat d3/d26/f123 x:0 0 0 2024-01-17T23:49:30.053 INFO:tasks.workunit.client.0.smithi067.stdout:1/908: creat d0/d7/d7f/d82/f122 x:0 0 0 2024-01-17T23:49:30.053 INFO:tasks.workunit.client.0.smithi067.stdout:4/890: fsync d3/d5/d93/f96 0 2024-01-17T23:49:30.242 INFO:tasks.workunit.client.0.smithi067.stdout:7/910: mkdir d4/d25/d39/d46/da8/d113/d118 0 2024-01-17T23:49:30.242 INFO:tasks.workunit.client.0.smithi067.stdout:7/911: chown d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/d8b/cec 288295 1 2024-01-17T23:49:30.287 INFO:tasks.workunit.client.0.smithi067.stdout:7/912: dwrite d4/d25/d39/f70 [0,4194304] 0 2024-01-17T23:49:30.335 INFO:tasks.workunit.client.0.smithi067.stdout:7/913: dwrite d4/d25/d39/d46/d78/d93/d94/fba [4194304,4194304] 0 2024-01-17T23:49:30.398 INFO:tasks.workunit.client.0.smithi067.stdout:3/939: mkdir d0/d17/dc8/dae/df6/d115/d122 0 2024-01-17T23:49:30.398 INFO:tasks.workunit.client.0.smithi067.stdout:3/940: creat d0/d37/dbb/f123 x:0 0 0 2024-01-17T23:49:30.398 INFO:tasks.workunit.client.0.smithi067.stdout:3/941: chown d0/f3 30158 1 2024-01-17T23:49:30.583 INFO:tasks.workunit.client.0.smithi067.stdout:5/846: symlink d10/d24/d25/l115 0 2024-01-17T23:49:30.779 INFO:tasks.workunit.client.0.smithi067.stdout:4/891: dwrite d3/d26/d34/d65/f111 [0,4194304] 0 2024-01-17T23:49:30.779 INFO:tasks.workunit.client.0.smithi067.stdout:4/892: chown d3/d8/l2b 118646351 1 2024-01-17T23:49:30.779 INFO:tasks.workunit.client.0.smithi067.stdout:4/893: write d3/d4e/dee/d20/d3b/d7c/d92/f99 [4787538,86648] 0 2024-01-17T23:49:30.845 INFO:tasks.workunit.client.0.smithi067.stdout:1/909: dwrite d0/d7/d13/d3a/d75/ded/fa0 [0,4194304] 0 2024-01-17T23:49:30.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/914: getdents d4/d25/d39/d46 0 2024-01-17T23:49:31.266 INFO:tasks.workunit.client.0.smithi067.stdout:0/982: rename d3/d5/d1a/fa4 to d3/d5/d1a/d1c/d4e/d6b/f164 0 2024-01-17T23:49:31.266 INFO:tasks.workunit.client.0.smithi067.stdout:0/983: fsync d3/d5/d12c/f15c 0 2024-01-17T23:49:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:5/847: symlink d10/d53/da4/l116 0 2024-01-17T23:49:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:5/848: write d10/d24/d59/fe6 [147252,62384] 0 2024-01-17T23:49:31.419 INFO:tasks.workunit.client.0.smithi067.stdout:5/849: write d10/d53/f62 [4413239,87179] 0 2024-01-17T23:49:31.451 INFO:tasks.workunit.client.0.smithi067.stdout:5/850: dwrite d10/f2c [0,4194304] 0 2024-01-17T23:49:31.452 INFO:tasks.workunit.client.0.smithi067.stdout:5/851: read - d10/d24/f10a zero size 2024-01-17T23:49:31.464 INFO:tasks.workunit.client.0.smithi067.stdout:5/852: write d10/f6e [1943083,17987] 0 2024-01-17T23:49:32.158 INFO:tasks.workunit.client.0.smithi067.stdout:4/894: readlink d3/d26/l27 0 2024-01-17T23:49:32.188 INFO:tasks.workunit.client.0.smithi067.stdout:4/895: dwrite d3/d5/d93/d9e/f9c [0,4194304] 0 2024-01-17T23:49:32.214 INFO:tasks.workunit.client.0.smithi067.stdout:4/896: dwrite d3/d8/d35/f10b [0,4194304] 0 2024-01-17T23:49:32.214 INFO:tasks.workunit.client.0.smithi067.stdout:4/897: stat d3/d4e/dee/dc7 0 2024-01-17T23:49:32.467 INFO:tasks.workunit.client.0.smithi067.stdout:1/910: symlink d0/d7/d13/d3d/l123 0 2024-01-17T23:49:32.641 INFO:tasks.workunit.client.0.smithi067.stdout:7/915: getdents d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb 0 2024-01-17T23:49:32.642 INFO:tasks.workunit.client.0.smithi067.stdout:7/916: dread - d4/d4b/fac zero size 2024-01-17T23:49:32.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/942: rename d0/d17/dc8/dae/d107/dea to d0/d17/dc8/d124 0 2024-01-17T23:49:32.787 INFO:tasks.workunit.client.0.smithi067.stdout:0/984: symlink d3/d5/d1a/d1c/d4e/d7c/dd0/l165 0 2024-01-17T23:49:33.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/853: creat d10/d24/d25/d5c/d107/d4a/d4b/f117 x:0 0 0 2024-01-17T23:49:33.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/854: chown d10/d24/d25/d5c/d107/d4a/d4b/lea 0 1 2024-01-17T23:49:33.099 INFO:tasks.workunit.client.0.smithi067.stdout:5/855: dwrite d10/d24/d25/d5c/d107/d4a/d63/f8b [0,4194304] 0 2024-01-17T23:49:33.147 INFO:tasks.workunit.client.0.smithi067.stdout:6/938: rmdir d6/d9/de1 39 2024-01-17T23:49:33.169 INFO:tasks.workunit.client.0.smithi067.stdout:8/954: sync 2024-01-17T23:49:33.169 INFO:tasks.workunit.client.0.smithi067.stdout:9/884: sync 2024-01-17T23:49:33.664 INFO:tasks.workunit.client.0.smithi067.stdout:4/898: creat d3/d4e/dee/d20/d3b/f124 x:0 0 0 2024-01-17T23:49:33.682 INFO:tasks.workunit.client.0.smithi067.stdout:4/899: dread d3/d26/d34/d3a/f5b [0,4194304] 0 2024-01-17T23:49:33.688 INFO:tasks.workunit.client.0.smithi067.stdout:4/900: dread d3/d4e/dee/d20/d3b/d7c/d92/f99 [4194304,4194304] 0 2024-01-17T23:49:33.716 INFO:tasks.workunit.client.0.smithi067.stdout:4/901: dwrite d3/d8/d35/f109 [0,4194304] 0 2024-01-17T23:49:33.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/911: mknod d0/d7/d13/d77/d95/d116/c124 0 2024-01-17T23:49:33.927 INFO:tasks.workunit.client.0.smithi067.stdout:7/917: chown d4/d4b/d63/fd1 978 1 2024-01-17T23:49:33.927 INFO:tasks.workunit.client.0.smithi067.stdout:7/918: truncate d4/d25/f2c 2034256 0 2024-01-17T23:49:35.691 INFO:tasks.workunit.client.0.smithi067.stdout:9/885: mkdir d3/d58/d13b 0 2024-01-17T23:49:35.691 INFO:tasks.workunit.client.0.smithi067.stdout:9/886: fdatasync d3/d6/f9f 0 2024-01-17T23:49:35.874 INFO:tasks.workunit.client.0.smithi067.stdout:8/955: link d6/d19/d22/d25/f5d d6/d26/d7c/f13d 0 2024-01-17T23:49:35.900 INFO:tasks.workunit.client.0.smithi067.stdout:8/956: dwrite d6/d19/d22/d25/d53/d65/fd4 [0,4194304] 0 2024-01-17T23:49:36.685 INFO:tasks.workunit.client.0.smithi067.stdout:4/902: symlink d3/d26/d34/d3a/d9f/l125 0 2024-01-17T23:49:36.689 INFO:tasks.workunit.client.0.smithi067.stdout:1/912: mkdir d0/d7/d13/d3d/d48/d125 0 2024-01-17T23:49:36.705 INFO:tasks.workunit.client.0.smithi067.stdout:4/903: dread d3/d5/d93/d9e/fed [0,4194304] 0 2024-01-17T23:49:37.350 INFO:tasks.workunit.client.0.smithi067.stdout:9/887: creat d3/d6/d11/d50/d84/da8/da9/df9/f13c x:0 0 0 2024-01-17T23:49:37.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/957: unlink d6/d26/d3e/d87/dd8/c128 0 2024-01-17T23:49:37.695 INFO:tasks.workunit.client.0.smithi067.stdout:8/958: read - d6/d26/d3e/d87/dd8/d11b/f13a zero size 2024-01-17T23:49:38.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/888: mknod d3/d6/d11/d50/d84/c13d 0 2024-01-17T23:49:38.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/889: readlink d3/d6/d47/d6d/lac 0 2024-01-17T23:49:38.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/913: getdents d0/d7/d93 0 2024-01-17T23:49:38.265 INFO:tasks.workunit.client.0.smithi067.stdout:1/914: dwrite d0/d7/d13/d3d/d48/d4d/fb8 [0,4194304] 0 2024-01-17T23:49:38.358 INFO:tasks.workunit.client.0.smithi067.stdout:9/890: mkdir d3/d6/d47/d10a/d123/d13e 0 2024-01-17T23:49:38.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/891: rmdir d3/d6/d2a/d34/d42/d9c 39 2024-01-17T23:49:38.816 INFO:tasks.workunit.client.0.smithi067.stdout:1/915: mkdir d0/d7/d13/d3d/d48/d126 0 2024-01-17T23:49:38.846 INFO:tasks.workunit.client.0.smithi067.stdout:2/915: mkdir d5/d13b 0 2024-01-17T23:49:38.862 INFO:tasks.workunit.client.0.smithi067.stdout:2/916: write d5/d1f/d2a/d54/d8/d32/ff8 [4027423,58331] 0 2024-01-17T23:49:38.894 INFO:tasks.workunit.client.0.smithi067.stdout:0/985: dwrite d3/d5/d1a/d1c/d1d/d2e/d5a/ff1 [0,4194304] 0 2024-01-17T23:49:38.909 INFO:tasks.workunit.client.0.smithi067.stdout:0/986: dread d3/d5/d122/f73 [0,4194304] 0 2024-01-17T23:49:38.910 INFO:tasks.workunit.client.0.smithi067.stdout:0/987: chown d3/d5/d122/dc5/cf3 445 1 2024-01-17T23:49:38.910 INFO:tasks.workunit.client.0.smithi067.stdout:0/988: stat d3/d6 0 2024-01-17T23:49:39.152 INFO:tasks.workunit.client.0.smithi067.stdout:1/916: truncate d0/d7/d13/d3d/dd0/ffa 4115828 0 2024-01-17T23:49:39.197 INFO:tasks.workunit.client.0.smithi067.stdout:2/917: dread d5/d1f/d2a/d8d/fec [0,4194304] 0 2024-01-17T23:49:39.485 INFO:tasks.workunit.client.0.smithi067.stdout:0/989: symlink d3/d5/d1a/d1c/d4e/d7c/l166 0 2024-01-17T23:49:39.485 INFO:tasks.workunit.client.0.smithi067.stdout:0/990: creat d3/d6/dd/d107/d143/d15d/f167 x:0 0 0 2024-01-17T23:49:39.699 INFO:tasks.workunit.client.0.smithi067.stdout:1/917: mknod d0/d7/d13/d3d/c127 0 2024-01-17T23:49:40.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/991: rmdir d3/d4c/d13a/d15f 0 2024-01-17T23:49:40.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/992: write d3/d5/d1a/d1c/d1d/d2e/f85 [271212,35452] 0 2024-01-17T23:49:40.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/993: write d3/d5/f45 [377753,32803] 0 2024-01-17T23:49:40.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/994: chown d3/cd5 47369566 1 2024-01-17T23:49:40.119 INFO:tasks.workunit.client.0.smithi067.stdout:0/995: dwrite d3/d6/dd/d43/f92 [0,4194304] 0 2024-01-17T23:49:40.132 INFO:tasks.workunit.client.0.smithi067.stdout:0/996: dread d3/f11 [0,4194304] 0 2024-01-17T23:49:40.454 INFO:tasks.workunit.client.0.smithi067.stdout:2/918: getdents d5/d86 0 2024-01-17T23:49:40.466 INFO:tasks.workunit.client.0.smithi067.stdout:2/919: dread d5/f78 [0,4194304] 0 2024-01-17T23:49:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:0/997: getdents d3/d5/d1a/d1c/d4d 0 2024-01-17T23:49:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:0/998: dread - d3/d64/d82/fbe zero size 2024-01-17T23:49:41.099 INFO:tasks.workunit.client.0.smithi067.stdout:0/999: rmdir d3/d5/d122/d9f/dee 39 2024-01-17T23:49:41.691 INFO:tasks.workunit.client.0.smithi067.stdout:3/943: sync 2024-01-17T23:49:41.691 INFO:tasks.workunit.client.0.smithi067.stdout:6/939: sync 2024-01-17T23:49:41.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/856: sync 2024-01-17T23:49:41.705 INFO:tasks.workunit.client.0.smithi067.stdout:8/959: dwrite d6/d26/d56/dd5/ffc [0,4194304] 0 2024-01-17T23:49:41.711 INFO:tasks.workunit.client.0.smithi067.stdout:3/944: read d0/d34/de3/f103 [330429,28288] 0 2024-01-17T23:49:41.720 INFO:tasks.workunit.client.0.smithi067.stdout:5/857: dwrite d10/d24/d25/d5c/d107/d4a/d63/f8b [4194304,4194304] 0 2024-01-17T23:49:41.720 INFO:tasks.workunit.client.0.smithi067.stdout:5/858: getdents d10/d24 0 2024-01-17T23:49:41.741 INFO:tasks.workunit.client.0.smithi067.stdout:5/859: write d10/d24/d25/d5c/d107/d4a/fa1 [3139040,7361] 0 2024-01-17T23:49:41.777 INFO:tasks.workunit.client.0.smithi067.stdout:5/860: dwrite d10/d24/d25/d5c/d107/d4a/fec [0,4194304] 0 2024-01-17T23:49:41.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/919: mknod d4/d25/d39/c119 0 2024-01-17T23:49:42.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/918: dwrite d0/d7/d13/d3a/d75/fbf [0,4194304] 0 2024-01-17T23:49:42.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/940: mkdir d6/d18/d2e/d136 0 2024-01-17T23:49:42.567 INFO:tasks.workunit.client.0.smithi067.stdout:6/941: dread d6/fa [0,4194304] 0 2024-01-17T23:49:42.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/960: mknod d6/d19/d22/c13e 0 2024-01-17T23:49:42.976 INFO:tasks.workunit.client.0.smithi067.stdout:8/961: dwrite d6/d26/d7c/fc4 [0,4194304] 0 2024-01-17T23:49:43.341 INFO:tasks.workunit.client.0.smithi067.stdout:9/892: rename d3/d6/da4/l1f to d3/d6/l13f 0 2024-01-17T23:49:43.341 INFO:tasks.workunit.client.0.smithi067.stdout:9/893: write d3/d25/d5d/d79/f119 [221208,106103] 0 2024-01-17T23:49:43.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/861: link d10/d24/l49 d10/d24/d25/d5c/d107/d4a/d63/l118 0 2024-01-17T23:49:43.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/862: dread - d10/d24/d25/d5c/d107/d4a/d50/d5a/f113 zero size 2024-01-17T23:49:43.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/863: fdatasync d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/fe8 0 2024-01-17T23:49:43.720 INFO:tasks.workunit.client.0.smithi067.stdout:7/920: creat d4/d25/d39/d46/da8/db0/f11a x:0 0 0 2024-01-17T23:49:44.109 INFO:tasks.workunit.client.0.smithi067.stdout:1/919: readlink d0/d7/d13/d3d/d48/da4/lf8 0 2024-01-17T23:49:44.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/904: sync 2024-01-17T23:49:44.655 INFO:tasks.workunit.client.0.smithi067.stdout:9/894: link d3/d6/fe d3/d6/d47/d88/dc2/d109/f140 0 2024-01-17T23:49:44.695 INFO:tasks.workunit.client.0.smithi067.stdout:9/895: dwrite d3/d58/fd3 [0,4194304] 0 2024-01-17T23:49:44.996 INFO:tasks.workunit.client.0.smithi067.stdout:5/864: symlink d10/d24/d25/d5c/d7e/l119 0 2024-01-17T23:49:44.996 INFO:tasks.workunit.client.0.smithi067.stdout:5/865: stat d10/l23 0 2024-01-17T23:49:45.444 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:45.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:49:45.511 INFO:tasks.workunit.client.0.smithi067.stdout:4/905: creat d3/d4e/dee/f126 x:0 0 0 2024-01-17T23:49:45.511 INFO:tasks.workunit.client.0.smithi067.stdout:4/906: dread - d3/d4e/dee/d20/f91 zero size 2024-01-17T23:49:45.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/907: dread d3/d40/f41 [0,4194304] 0 2024-01-17T23:49:45.862 INFO:tasks.workunit.client.0.smithi067.stdout:9/896: creat d3/d6/d47/d10a/d123/d13e/f141 x:0 0 0 2024-01-17T23:49:46.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/908: symlink d3/d4e/dee/d20/d3b/l127 0 2024-01-17T23:49:46.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/909: dread d3/d4e/fa3 [0,4194304] 0 2024-01-17T23:49:46.186 INFO:tasks.workunit.client.0.smithi067.stdout:4/910: dwrite d3/d5/fde [0,4194304] 0 2024-01-17T23:49:46.225 INFO:tasks.workunit.client.0.smithi067.stdout:9/897: mkdir d3/d6/d11/d50/d142 0 2024-01-17T23:49:46.708 INFO:tasks.workunit.client.0.smithi067.stdout:9/898: symlink d3/d6/da4/d55/da1/dbc/d10f/l143 0 2024-01-17T23:49:46.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/899: chown d3/da/c1c 11601235 1 2024-01-17T23:49:46.755 INFO:tasks.workunit.client.0.smithi067.stdout:9/900: dread d3/d6/d11/d50/f11e [0,4194304] 0 2024-01-17T23:49:46.850 INFO:tasks.workunit.client.0.smithi067.stdout:6/942: write d6/f8 [2887458,50881] 0 2024-01-17T23:49:46.881 INFO:tasks.workunit.client.0.smithi067.stdout:6/943: dwrite d6/d9/d30/d4c/f54 [4194304,4194304] 0 2024-01-17T23:49:47.193 INFO:tasks.workunit.client.0.smithi067.stdout:9/901: creat d3/d6/d11/d50/d84/f144 x:0 0 0 2024-01-17T23:49:47.364 INFO:tasks.workunit.client.0.smithi067.stdout:6/944: mkdir d6/d18/d137 0 2024-01-17T23:49:47.364 INFO:tasks.workunit.client.0.smithi067.stdout:6/945: dread - d6/d9/d30/d4c/d82/fae zero size 2024-01-17T23:49:47.598 INFO:tasks.workunit.client.0.smithi067.stdout:9/902: dread d3/d6/d47/d88/fcf [0,4194304] 0 2024-01-17T23:49:47.598 INFO:tasks.workunit.client.0.smithi067.stdout:9/903: readlink d3/d6/d11/l8f 0 2024-01-17T23:49:47.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/904: dwrite d3/d6/d47/d88/f11a [0,4194304] 0 2024-01-17T23:49:47.912 INFO:tasks.workunit.client.0.smithi067.stdout:6/946: symlink d6/d9/d1c/d1e/d43/def/dad/dfa/l138 0 2024-01-17T23:49:47.917 INFO:tasks.workunit.client.0.smithi067.stdout:6/947: dread d6/d9/d30/f46 [0,4194304] 0 2024-01-17T23:49:47.917 INFO:tasks.workunit.client.0.smithi067.stdout:6/948: fdatasync d6/f1f 0 2024-01-17T23:49:48.170 INFO:tasks.workunit.client.0.smithi067.stdout:2/920: rename d5/l1c to d5/d1f/d98/d9f/dbb/l13c 0 2024-01-17T23:49:48.170 INFO:tasks.workunit.client.0.smithi067.stdout:2/921: stat d5/d1f/d98/d9f/dbb/fdc 0 2024-01-17T23:49:48.177 INFO:tasks.workunit.client.0.smithi067.stdout:2/922: write d5/d1f/d2a/d54/ff3 [703154,107234] 0 2024-01-17T23:49:48.177 INFO:tasks.workunit.client.0.smithi067.stdout:2/923: readlink d5/d1f/d2a/d54/d8/d32/d33/l76 0 2024-01-17T23:49:48.183 INFO:tasks.workunit.client.0.smithi067.stdout:5/866: write d10/d24/d59/d5d/f4d [4857550,98794] 0 2024-01-17T23:49:48.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/867: read d10/d24/d25/d5c/d7e/d7f/fc0 [3306345,118183] 0 2024-01-17T23:49:48.693 INFO:tasks.workunit.client.0.smithi067.stdout:6/949: creat d6/d9/d65/f139 x:0 0 0 2024-01-17T23:49:48.697 INFO:tasks.workunit.client.0.smithi067.stdout:6/950: read d6/d9/f9c [744599,1161] 0 2024-01-17T23:49:48.715 INFO:tasks.workunit.client.0.smithi067.stdout:6/951: write d6/d9/d1c/d1e/f7f [1417910,91271] 0 2024-01-17T23:49:48.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/952: dwrite d6/d9/d1c/d1e/d43/d86/da5/fc6 [4194304,4194304] 0 2024-01-17T23:49:48.844 INFO:tasks.workunit.client.0.smithi067.stdout:3/945: rename d0/d34/d35/d65/d6f/fb2 to d0/d37/f125 0 2024-01-17T23:49:48.860 INFO:tasks.workunit.client.0.smithi067.stdout:3/946: dread d0/d17/f29 [0,4194304] 0 2024-01-17T23:49:49.444 INFO:tasks.workunit.client.0.smithi067.stdout:6/953: mknod d6/d18/d2e/d7c/c13a 0 2024-01-17T23:49:49.710 INFO:tasks.workunit.client.0.smithi067.stdout:8/962: rename d6/d26/d7c/c111 to d6/d26/c13f 0 2024-01-17T23:49:49.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/954: truncate d6/d9/d30/f7b 3306843 0 2024-01-17T23:49:49.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/955: chown d6/d9/d1c/f2f 0 1 2024-01-17T23:49:49.979 INFO:tasks.workunit.client.0.smithi067.stdout:1/920: rename d0/d7/d13/d3a/d75/ded/fcf to d0/d7/d13/d3a/d75/f128 0 2024-01-17T23:49:49.979 INFO:tasks.workunit.client.0.smithi067.stdout:1/921: write d0/d7/d13/f40 [4607137,15394] 0 2024-01-17T23:49:50.024 INFO:tasks.workunit.client.0.smithi067.stdout:1/922: dwrite d0/d7/d13/fd4 [0,4194304] 0 2024-01-17T23:49:50.039 INFO:tasks.workunit.client.0.smithi067.stdout:3/947: creat d0/de1/dd5/f126 x:0 0 0 2024-01-17T23:49:50.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/963: creat d6/d19/d22/f140 x:0 0 0 2024-01-17T23:49:50.114 INFO:tasks.workunit.client.0.smithi067.stdout:8/964: dread d6/d19/d22/d25/d53/dbd/f136 [0,4194304] 0 2024-01-17T23:49:50.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/921: sync 2024-01-17T23:49:50.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/922: write d4/d25/d39/d46/f99 [4434553,19679] 0 2024-01-17T23:49:50.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/923: creat d4/d25/d39/d8a/f11b x:0 0 0 2024-01-17T23:49:50.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/924: truncate d4/d4b/d63/f10e 594570 0 2024-01-17T23:49:51.068 INFO:tasks.workunit.client.0.smithi067.stdout:4/911: rename d3/d4e/dee/d20/c107 to d3/d40/dc8/c128 0 2024-01-17T23:49:51.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/965: truncate d6/d26/d56/dbb/ff5 1072012 0 2024-01-17T23:49:51.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/966: stat d6/db/f27 0 2024-01-17T23:49:51.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/967: dwrite d6/d19/d22/d25/d53/d65/f28 [0,4194304] 0 2024-01-17T23:49:51.582 INFO:tasks.workunit.client.0.smithi067.stdout:2/924: write d5/d1f/d2a/d54/d8/d32/f81 [713671,20379] 0 2024-01-17T23:49:51.853 INFO:tasks.workunit.client.0.smithi067.stdout:9/905: rename d3/d6/d2a/da2/l30 to d3/d6/d11/d5c/l145 0 2024-01-17T23:49:51.959 INFO:tasks.workunit.client.0.smithi067.stdout:4/912: mknod d3/d5/c129 0 2024-01-17T23:49:51.964 INFO:tasks.workunit.client.0.smithi067.stdout:4/913: read d3/d4e/dee/d20/fb5 [28387,124102] 0 2024-01-17T23:49:52.982 INFO:tasks.workunit.client.0.smithi067.stdout:8/968: creat d6/d26/d56/dbb/dee/f141 x:0 0 0 2024-01-17T23:49:53.048 INFO:tasks.workunit.client.0.smithi067.stdout:2/925: mknod d5/d1f/d2a/d54/dee/c13d 0 2024-01-17T23:49:53.052 INFO:tasks.workunit.client.0.smithi067.stdout:6/956: write d6/d9/d30/d58/fa2 [391867,44299] 0 2024-01-17T23:49:53.082 INFO:tasks.workunit.client.0.smithi067.stdout:6/957: dwrite d6/d9/d1c/d1e/d43/def/d51/fd9 [4194304,4194304] 0 2024-01-17T23:49:53.200 INFO:tasks.workunit.client.0.smithi067.stdout:5/868: rename d10/d24/db4/fbf to d10/d53/da4/dc6/f11a 0 2024-01-17T23:49:53.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/869: write d10/d24/db4/fde [685021,69362] 0 2024-01-17T23:49:53.213 INFO:tasks.workunit.client.0.smithi067.stdout:5/870: chown d10/d24/d25/d5c/d107/d4a/d63 318 1 2024-01-17T23:49:53.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/925: truncate d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb/f10a 1166353 0 2024-01-17T23:49:53.441 INFO:tasks.workunit.client.0.smithi067.stdout:9/906: creat d3/d6/d2a/da2/de2/f146 x:0 0 0 2024-01-17T23:49:54.222 INFO:tasks.workunit.client.0.smithi067.stdout:8/969: symlink d6/d19/d22/d25/d53/d54/l142 0 2024-01-17T23:49:54.309 INFO:tasks.workunit.client.0.smithi067.stdout:2/926: link d5/d1f/d35/l8b d5/d1f/d2a/d54/dee/d109/l13e 0 2024-01-17T23:49:54.401 INFO:tasks.workunit.client.0.smithi067.stdout:1/923: write d0/d7/d13/d2e/f78 [2579060,14520] 0 2024-01-17T23:49:54.477 INFO:tasks.workunit.client.0.smithi067.stdout:1/924: dwrite d0/d7/d13/d3a/f10c [0,4194304] 0 2024-01-17T23:49:54.730 INFO:tasks.workunit.client.0.smithi067.stdout:6/958: truncate d6/d18/f1d 635499 0 2024-01-17T23:49:54.736 INFO:tasks.workunit.client.0.smithi067.stdout:6/959: dread d6/d18/d2e/f77 [0,4194304] 0 2024-01-17T23:49:54.993 INFO:tasks.workunit.client.0.smithi067.stdout:3/948: rename d0/de1/d75/caf to d0/c127 0 2024-01-17T23:49:55.125 INFO:tasks.workunit.client.0.smithi067.stdout:5/871: symlink d10/d24/d25/dd5/l11b 0 2024-01-17T23:49:55.333 INFO:tasks.workunit.client.0.smithi067.stdout:9/907: mkdir d3/d6/da4/d55/d147 0 2024-01-17T23:49:56.083 INFO:tasks.workunit.client.0.smithi067.stdout:2/927: creat d5/d1f/d121/f13f x:0 0 0 2024-01-17T23:49:56.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/914: dwrite d3/d4e/f63 [0,4194304] 0 2024-01-17T23:49:56.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/915: chown d3/d5/d93/d9e/lad 14 1 2024-01-17T23:49:56.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/960: mknod d6/d18/d2e/d61/d9a/dd1/df3/c13b 0 2024-01-17T23:49:56.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/961: chown d6/d9/d30/f7b 0 1 2024-01-17T23:49:56.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/962: write d6/d9/d1c/d1e/d43/d78/fb7 [1820553,26223] 0 2024-01-17T23:49:56.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/963: read d6/d9/d1c/d1e/d43/def/f4e [164915,63191] 0 2024-01-17T23:49:56.923 INFO:tasks.workunit.client.0.smithi067.stdout:6/964: dwrite d6/d18/fec [0,4194304] 0 2024-01-17T23:49:56.923 INFO:tasks.workunit.client.0.smithi067.stdout:6/965: dread - d6/d18/fe9 zero size 2024-01-17T23:49:57.091 INFO:tasks.workunit.client.0.smithi067.stdout:3/949: creat d0/de1/d75/dd0/f128 x:0 0 0 2024-01-17T23:49:57.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/872: symlink d10/d53/l11c 0 2024-01-17T23:49:57.871 INFO:tasks.workunit.client.0.smithi067.stdout:1/925: mknod d0/d74/c129 0 2024-01-17T23:49:58.083 INFO:tasks.workunit.client.0.smithi067.stdout:4/916: symlink d3/d5/l12a 0 2024-01-17T23:49:58.684 INFO:tasks.workunit.client.0.smithi067.stdout:6/966: getdents d6/d9/d1c/d1e/d43/def/dad 0 2024-01-17T23:49:58.685 INFO:tasks.workunit.client.0.smithi067.stdout:6/967: stat d6/d9/d1c/d1e/dd4/fb2 0 2024-01-17T23:49:58.707 INFO:tasks.workunit.client.0.smithi067.stdout:6/968: write d6/d9/d30/d4c/d8d/f99 [922286,51741] 0 2024-01-17T23:49:58.733 INFO:tasks.workunit.client.0.smithi067.stdout:3/950: creat d0/d17/dc8/dae/df6/d115/f129 x:0 0 0 2024-01-17T23:49:58.733 INFO:tasks.workunit.client.0.smithi067.stdout:3/951: write d0/d34/de3/f103 [279650,12307] 0 2024-01-17T23:49:58.735 INFO:tasks.workunit.client.0.smithi067.stdout:5/873: unlink d10/d24/d25/f35 0 2024-01-17T23:49:58.920 INFO:tasks.workunit.client.0.smithi067.stdout:9/908: rmdir d3/df0 39 2024-01-17T23:49:58.920 INFO:tasks.workunit.client.0.smithi067.stdout:9/909: stat d3/d6/d2a/d34/d42/l5f 0 2024-01-17T23:49:59.074 INFO:tasks.workunit.client.0.smithi067.stdout:1/926: truncate d0/d7/d13/d3a/fa6 131779 0 2024-01-17T23:49:59.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/969: write d6/d18/f1d [1268476,42512] 0 2024-01-17T23:49:59.435 INFO:tasks.workunit.client.0.smithi067.stdout:6/970: write d6/fb [4084032,53879] 0 2024-01-17T23:49:59.435 INFO:tasks.workunit.client.0.smithi067.stdout:6/971: chown d6/d9/d65/lf4 667239252 1 2024-01-17T23:49:59.458 INFO:tasks.workunit.client.0.smithi067.stdout:6/972: dread d6/d9/d1c/d1e/dd4/fb2 [0,4194304] 0 2024-01-17T23:49:59.510 INFO:tasks.workunit.client.0.smithi067.stdout:7/926: write d4/d25/d39/d46/d78/d93/fcd [755418,21121] 0 2024-01-17T23:49:59.510 INFO:tasks.workunit.client.0.smithi067.stdout:7/927: fsync d4/d4b/d7f/ddd/f10b 0 2024-01-17T23:49:59.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/952: write d0/de1/d82/da6/dd3/f10d [5209667,37298] 0 2024-01-17T23:49:59.619 INFO:tasks.workunit.client.0.smithi067.stdout:3/953: dwrite d0/de1/d75/dcb/f111 [0,4194304] 0 2024-01-17T23:49:59.833 INFO:tasks.workunit.client.0.smithi067.stdout:9/910: rmdir d3/d6/d2a/da2/de2/dd0/da6 39 2024-01-17T23:49:59.862 INFO:tasks.workunit.client.0.smithi067.stdout:9/911: dwrite d3/d6/d2e/f116 [0,4194304] 0 2024-01-17T23:49:59.967 INFO:tasks.workunit.client.0.smithi067.stdout:1/927: mkdir d0/d7/d13/d77/dee/d12a 0 2024-01-17T23:50:00.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/917: rename d3/d4e/dee/d20/d3b/c4d to d3/d40/c12b 0 2024-01-17T23:50:00.178 INFO:tasks.workunit.client.0.smithi067.stdout:6/973: getdents d6/d9/d1c 0 2024-01-17T23:50:00.392 INFO:tasks.workunit.client.0.smithi067.stdout:7/928: creat d4/d25/d39/d46/d60/ddc/f11c x:0 0 0 2024-01-17T23:50:00.393 INFO:tasks.workunit.client.0.smithi067.stdout:7/929: creat d4/d25/d39/d79/dde/f11d x:0 0 0 2024-01-17T23:50:00.408 INFO:tasks.workunit.client.0.smithi067.stdout:7/930: read d4/d25/d39/d46/d60/f66 [865354,11758] 0 2024-01-17T23:50:00.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/954: creat d0/d17/d69/d6e/dcc/f12a x:0 0 0 2024-01-17T23:50:00.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/874: truncate d10/d24/d59/d5d/fa8 449052 0 2024-01-17T23:50:00.762 INFO:tasks.workunit.client.0.smithi067.stdout:8/970: sync 2024-01-17T23:50:00.979 INFO:tasks.workunit.client.0.smithi067.stdout:9/912: mknod d3/d6/da4/d55/da1/dbc/c148 0 2024-01-17T23:50:01.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/928: creat d0/d62/f12b x:0 0 0 2024-01-17T23:50:01.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/929: fsync d0/d7/d13/d77/d95/fa3 0 2024-01-17T23:50:01.163 INFO:tasks.workunit.client.0.smithi067.stdout:1/930: dread d0/d7/d13/fd4 [0,4194304] 0 2024-01-17T23:50:01.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/974: symlink d6/d9/d30/dbd/l13c 0 2024-01-17T23:50:01.331 INFO:tasks.workunit.client.0.smithi067.stdout:6/975: dread d6/d18/d2e/f40 [0,4194304] 0 2024-01-17T23:50:01.642 INFO:tasks.workunit.client.0.smithi067.stdout:7/931: chown d4/d4b/d63/d95/dad/dcc/fc1 1187991 1 2024-01-17T23:50:01.643 INFO:tasks.workunit.client.0.smithi067.stdout:7/932: chown d4/d16/dc3/c109 572 1 2024-01-17T23:50:01.645 INFO:tasks.workunit.client.0.smithi067.stdout:3/955: truncate d0/d34/d35/d57/fa0 815630 0 2024-01-17T23:50:01.645 INFO:tasks.workunit.client.0.smithi067.stdout:3/956: stat d0/d13/c10f 0 2024-01-17T23:50:01.645 INFO:tasks.workunit.client.0.smithi067.stdout:3/957: stat d0/d17/d69/d6e/dcc 0 2024-01-17T23:50:01.916 INFO:tasks.workunit.client.0.smithi067.stdout:2/928: sync 2024-01-17T23:50:01.917 INFO:tasks.workunit.client.0.smithi067.stdout:2/929: creat d5/d2f/f140 x:0 0 0 2024-01-17T23:50:02.010 INFO:tasks.workunit.client.0.smithi067.stdout:9/913: rename d3/d6/d2e/f63 to d3/d6/d2a/d34/f149 0 2024-01-17T23:50:02.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/931: readlink d0/d74/d31/l76 0 2024-01-17T23:50:02.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/932: chown d0/d74/d31/l85 20 1 2024-01-17T23:50:02.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/918: unlink d3/d26/d34/d3a/d53/l7a 0 2024-01-17T23:50:02.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/919: write d3/d40/f70 [6135062,119004] 0 2024-01-17T23:50:02.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/976: symlink d6/d9/d65/da4/d133/l13d 0 2024-01-17T23:50:02.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/977: stat d6/d9/d1c/d1e/d7e/f8c 0 2024-01-17T23:50:02.600 INFO:tasks.workunit.client.0.smithi067.stdout:7/933: symlink d4/d25/d39/d46/d78/d93/d94/dc4/d40/l11e 0 2024-01-17T23:50:02.805 INFO:tasks.workunit.client.0.smithi067.stdout:5/875: truncate d10/d24/d25/d5c/d107/f54 3917081 0 2024-01-17T23:50:04.005 INFO:tasks.workunit.client.0.smithi067.stdout:9/914: unlink d3/d6/d11/d50/f94 0 2024-01-17T23:50:04.005 INFO:tasks.workunit.client.0.smithi067.stdout:9/915: chown d3/d6/d2a/da2/l89 71003565 1 2024-01-17T23:50:04.019 INFO:tasks.workunit.client.0.smithi067.stdout:9/916: dread d3/d6/d2a/f71 [0,4194304] 0 2024-01-17T23:50:04.019 INFO:tasks.workunit.client.0.smithi067.stdout:9/917: readlink d3/d25/d5d/lcb 0 2024-01-17T23:50:04.167 INFO:tasks.workunit.client.0.smithi067.stdout:1/933: getdents d0 0 2024-01-17T23:50:04.295 INFO:tasks.workunit.client.0.smithi067.stdout:4/920: creat d3/d26/d34/f12c x:0 0 0 2024-01-17T23:50:04.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/978: mknod d6/d9/d3e/c13e 0 2024-01-17T23:50:04.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/979: fsync d6/d9/d65/da4/fe8 0 2024-01-17T23:50:04.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/980: readlink d6/d18/d2e/l60 0 2024-01-17T23:50:04.527 INFO:tasks.workunit.client.0.smithi067.stdout:5/876: creat d10/d24/d25/d5c/d107/d4a/d63/d85/f11d x:0 0 0 2024-01-17T23:50:04.527 INFO:tasks.workunit.client.0.smithi067.stdout:5/877: dread - d10/d24/d25/d5c/d7e/ff5 zero size 2024-01-17T23:50:04.665 INFO:tasks.workunit.client.0.smithi067.stdout:8/971: mknod d6/d26/d56/dbb/de1/c143 0 2024-01-17T23:50:04.684 INFO:tasks.workunit.client.0.smithi067.stdout:8/972: dread d6/d19/d22/d25/d53/fce [0,4194304] 0 2024-01-17T23:50:04.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/973: dwrite d6/d19/d22/d25/d53/dbd/f136 [0,4194304] 0 2024-01-17T23:50:04.919 INFO:tasks.workunit.client.0.smithi067.stdout:3/958: rename d0/de1/d82/da6 to d0/de1/d75/dcb/d12b 0 2024-01-17T23:50:05.174 INFO:tasks.workunit.client.0.smithi067.stdout:9/918: mkdir d3/d6/da4/d55/da1/dbc/d10f/d14a 0 2024-01-17T23:50:05.506 INFO:tasks.workunit.client.0.smithi067.stdout:4/921: mknod d3/d4e/dee/c12d 0 2024-01-17T23:50:05.506 INFO:tasks.workunit.client.0.smithi067.stdout:1/934: truncate d0/f27 1656923 0 2024-01-17T23:50:05.532 INFO:tasks.workunit.client.0.smithi067.stdout:4/922: dwrite d3/d26/d34/d3a/d9f/fea [0,4194304] 0 2024-01-17T23:50:05.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/923: creat d3/d4e/dee/d20/d3b/f12e x:0 0 0 2024-01-17T23:50:05.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/924: stat d3/d4e/dee/d20/d3b/c106 0 2024-01-17T23:50:05.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/981: getdents d6/d9/d1c/d1e/d43/def/d51 0 2024-01-17T23:50:05.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/982: write d6/d9/d65/f139 [340099,9225] 0 2024-01-17T23:50:05.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/983: fsync d6/d9/d30/d4c/d82/f95 0 2024-01-17T23:50:05.550 INFO:tasks.workunit.client.0.smithi067.stdout:6/984: write d6/f8 [973581,9606] 0 2024-01-17T23:50:05.550 INFO:tasks.workunit.client.0.smithi067.stdout:6/985: dread - d6/d9/d1c/f66 zero size 2024-01-17T23:50:05.550 INFO:tasks.workunit.client.0.smithi067.stdout:6/986: dread - d6/f10f zero size 2024-01-17T23:50:05.560 INFO:tasks.workunit.client.0.smithi067.stdout:4/925: dwrite d3/d8/d35/db0/f102 [0,4194304] 0 2024-01-17T23:50:05.880 INFO:tasks.workunit.client.0.smithi067.stdout:8/974: mkdir d6/d19/d144 0 2024-01-17T23:50:06.073 INFO:tasks.workunit.client.0.smithi067.stdout:9/919: mkdir d3/d25/d5d/d79/d14b 0 2024-01-17T23:50:06.073 INFO:tasks.workunit.client.0.smithi067.stdout:9/920: chown d3/d6/da4/d55/da1/dbc/d10f/d14a 234 1 2024-01-17T23:50:06.491 INFO:tasks.workunit.client.0.smithi067.stdout:1/935: dread d0/d74/f8c [0,4194304] 0 2024-01-17T23:50:06.902 INFO:tasks.workunit.client.0.smithi067.stdout:6/987: unlink d6/d18/f33 0 2024-01-17T23:50:06.902 INFO:tasks.workunit.client.0.smithi067.stdout:6/988: chown d6/f8 35000 1 2024-01-17T23:50:06.906 INFO:tasks.workunit.client.0.smithi067.stdout:4/926: dread d3/d26/d34/d65/f68 [0,4194304] 0 2024-01-17T23:50:06.906 INFO:tasks.workunit.client.0.smithi067.stdout:4/927: truncate d3/d26/d34/d3a/d9f/f112 654870 0 2024-01-17T23:50:06.906 INFO:tasks.workunit.client.0.smithi067.stdout:4/928: fsync d3/d26/d34/d3a/d9f/fea 0 2024-01-17T23:50:07.071 INFO:tasks.workunit.client.0.smithi067.stdout:5/878: link d10/d24/d59/c7a d10/d24/d59/d5d/dce/c11e 0 2024-01-17T23:50:07.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/975: dread d6/d19/fc8 [0,4194304] 0 2024-01-17T23:50:07.338 INFO:tasks.workunit.client.0.smithi067.stdout:8/976: read - d6/d26/d3e/d6c/fe8 zero size 2024-01-17T23:50:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:3/959: mknod d0/d17/d69/c12c 0 2024-01-17T23:50:07.618 INFO:tasks.workunit.client.0.smithi067.stdout:3/960: chown d0/de1/dd5/f126 4 1 2024-01-17T23:50:08.376 INFO:tasks.workunit.client.0.smithi067.stdout:5/879: dread d10/d24/d59/d8c/dae/fb0 [0,4194304] 0 2024-01-17T23:50:08.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/977: symlink d6/d26/d3e/d87/l145 0 2024-01-17T23:50:08.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/978: write d6/d26/d56/dbb/dee/f141 [215272,110397] 0 2024-01-17T23:50:08.726 INFO:tasks.workunit.client.0.smithi067.stdout:8/979: dread d6/d26/d56/dbb/dfd/f73 [0,4194304] 0 2024-01-17T23:50:08.740 INFO:tasks.workunit.client.0.smithi067.stdout:8/980: write d6/d26/fd1 [1826790,113793] 0 2024-01-17T23:50:08.934 INFO:tasks.workunit.client.0.smithi067.stdout:3/961: symlink d0/de1/d75/dcb/d12b/d102/l12d 0 2024-01-17T23:50:08.934 INFO:tasks.workunit.client.0.smithi067.stdout:3/962: chown d0/d17/dc8/dae/df6 61403 1 2024-01-17T23:50:09.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/929: rename d3/d4e/dee/d20/l84 to d3/d40/l12f 0 2024-01-17T23:50:09.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/930: fsync d3/fc1 0 2024-01-17T23:50:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:4/931: dread d3/d5/d93/d9e/f9c [0,4194304] 0 2024-01-17T23:50:09.515 INFO:tasks.workunit.client.0.smithi067.stdout:8/981: unlink d6/d19/d22/f72 0 2024-01-17T23:50:09.515 INFO:tasks.workunit.client.0.smithi067.stdout:8/982: creat d6/d26/d3e/d6c/f146 x:0 0 0 2024-01-17T23:50:09.675 INFO:tasks.workunit.client.0.smithi067.stdout:4/932: creat d3/d4e/dee/d20/f130 x:0 0 0 2024-01-17T23:50:09.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/880: symlink d10/d53/da4/l11f 0 2024-01-17T23:50:10.130 INFO:tasks.workunit.client.0.smithi067.stdout:8/983: creat d6/d19/db4/dde/f147 x:0 0 0 2024-01-17T23:50:10.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/930: sync 2024-01-17T23:50:10.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/931: creat d5/d2f/f141 x:0 0 0 2024-01-17T23:50:10.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/933: creat d3/d4e/dee/df8/dff/f131 x:0 0 0 2024-01-17T23:50:10.662 INFO:tasks.workunit.client.0.smithi067.stdout:5/881: dread d10/d53/fe3 [0,4194304] 0 2024-01-17T23:50:10.899 INFO:tasks.workunit.client.0.smithi067.stdout:8/984: mknod d6/d19/d22/d25/d53/d54/c148 0 2024-01-17T23:50:10.945 INFO:tasks.workunit.client.0.smithi067.stdout:6/989: mkdir d6/d9/d13f 0 2024-01-17T23:50:11.220 INFO:tasks.workunit.client.0.smithi067.stdout:2/932: rename d5/d1f/d2a/d55/c7e to d5/d1f/d2a/d54/dee/c142 0 2024-01-17T23:50:11.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/934: dwrite d4/d4b/d63/fd1 [4194304,4194304] 0 2024-01-17T23:50:11.463 INFO:tasks.workunit.client.0.smithi067.stdout:5/882: creat d10/d24/d59/d5d/dce/d10d/f120 x:0 0 0 2024-01-17T23:50:11.463 INFO:tasks.workunit.client.0.smithi067.stdout:5/883: fsync d10/d24/d25/d5c/d107/f54 0 2024-01-17T23:50:11.670 INFO:tasks.workunit.client.0.smithi067.stdout:8/985: truncate d6/d26/d56/dd5/ffc 2848074 0 2024-01-17T23:50:11.780 INFO:tasks.workunit.client.0.smithi067.stdout:6/990: rename d6/d9/d1c/d1e/d43/d86/da5/cd3 to d6/d9/d1c/d1e/d43/def/c140 0 2024-01-17T23:50:11.780 INFO:tasks.workunit.client.0.smithi067.stdout:6/991: chown d6/d9/d30/d4c/d8d/f107 1576 1 2024-01-17T23:50:11.780 INFO:tasks.workunit.client.0.smithi067.stdout:6/992: readlink d6/d9/d65/da4/d133/l13d 0 2024-01-17T23:50:11.780 INFO:tasks.workunit.client.0.smithi067.stdout:6/993: creat d6/d18/d2e/d61/d9a/dd1/f141 x:0 0 0 2024-01-17T23:50:12.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/935: mkdir d4/d4b/d11f 0 2024-01-17T23:50:12.036 INFO:tasks.workunit.client.0.smithi067.stdout:7/936: dwrite d4/d16/f3f [4194304,4194304] 0 2024-01-17T23:50:12.036 INFO:tasks.workunit.client.0.smithi067.stdout:7/937: fsync d4/d25/d39/d46/da8/db0/f11a 0 2024-01-17T23:50:12.308 INFO:tasks.workunit.client.0.smithi067.stdout:5/884: creat d10/d24/d59/d8c/dae/f121 x:0 0 0 2024-01-17T23:50:12.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/986: truncate d6/d19/d22/d25/f5d 50852 0 2024-01-17T23:50:12.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/987: chown d6/d26/d56/d89/l98 19 1 2024-01-17T23:50:12.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/988: chown d6/d26/d56/dbb/dfd/d5f/dc0 241 1 2024-01-17T23:50:12.980 INFO:tasks.workunit.client.0.smithi067.stdout:6/994: link d6/d18/d2e/d61/d9a/dd1/ffd d6/d81/dc7/f142 0 2024-01-17T23:50:12.980 INFO:tasks.workunit.client.0.smithi067.stdout:6/995: creat d6/d9/d1c/d1e/d43/d86/da5/f143 x:0 0 0 2024-01-17T23:50:12.981 INFO:tasks.workunit.client.0.smithi067.stdout:6/996: write d6/d9/d1c/f96 [2667177,44640] 0 2024-01-17T23:50:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/938: rename d4/d25/d39/d46/d78/d93/d94/dc4/d41/dea to d4/d25/d39/d8a/d92/d120 0 2024-01-17T23:50:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/939: stat d4/d25/d39/d8a 0 2024-01-17T23:50:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/940: write d4/d25/d39/d8a/f97 [4025021,83717] 0 2024-01-17T23:50:13.629 INFO:tasks.workunit.client.0.smithi067.stdout:5/885: unlink d10/f16 0 2024-01-17T23:50:13.868 INFO:tasks.workunit.client.0.smithi067.stdout:9/921: write d3/d6/d2e/fe5 [6719638,34396] 0 2024-01-17T23:50:13.984 INFO:tasks.workunit.client.0.smithi067.stdout:8/989: creat d6/d19/d22/d25/d53/d65/db6/f149 x:0 0 0 2024-01-17T23:50:14.197 INFO:tasks.workunit.client.0.smithi067.stdout:6/997: rmdir d6/d9/d1c/d1e/d43/def/dad 39 2024-01-17T23:50:14.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/936: rmdir d0 39 2024-01-17T23:50:14.373 INFO:tasks.workunit.client.0.smithi067.stdout:7/941: dread d4/d25/d39/d8a/d92/faa [0,4194304] 0 2024-01-17T23:50:14.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/886: creat d10/d24/d25/d5c/d107/d4a/f122 x:0 0 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/934: truncate d3/d26/d34/d3a/d9f/f112 321237 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/935: read d3/d4e/dee/da6/f116 [3869814,96572] 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:4/936: stat d3/d4e/dee/d20/d3b/ddf 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/990: creat d6/d26/f14a x:0 0 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/991: fdatasync d6/d19/d22/fba 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/998: symlink d6/d9/d65/da4/l144 0 2024-01-17T23:50:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/992: fdatasync d6/db/f55 0 2024-01-17T23:50:15.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:15.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:15.505 INFO:tasks.workunit.client.0.smithi067.stdout:7/942: rmdir d4/d25/d39/d46/d60/dc7 39 2024-01-17T23:50:15.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/887: mknod d10/d53/da4/dc6/c123 0 2024-01-17T23:50:15.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/888: dread d10/d24/d25/d5c/d107/d4a/d63/ff2 [0,4194304] 0 2024-01-17T23:50:15.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/889: truncate d10/d24/d59/d5d/dce/d10d/ffe 900453 0 2024-01-17T23:50:15.782 INFO:tasks.workunit.client.0.smithi067.stdout:5/890: dread d10/d24/d59/d8c/dae/fb0 [0,4194304] 0 2024-01-17T23:50:15.792 INFO:tasks.workunit.client.0.smithi067.stdout:3/963: dwrite d0/d12/d1b/d4d/fe5 [0,4194304] 0 2024-01-17T23:50:15.978 INFO:tasks.workunit.client.0.smithi067.stdout:4/937: rmdir d3/d40/dd7 0 2024-01-17T23:50:15.978 INFO:tasks.workunit.client.0.smithi067.stdout:4/938: creat d3/d4e/dee/df8/f132 x:0 0 0 2024-01-17T23:50:16.007 INFO:tasks.workunit.client.0.smithi067.stdout:6/999: mkdir d6/d9/ddf/d145 0 2024-01-17T23:50:16.150 INFO:tasks.workunit.client.0.smithi067.stdout:8/993: dread d6/d19/d22/d25/d53/f7e [0,4194304] 0 2024-01-17T23:50:16.330 INFO:tasks.workunit.client.0.smithi067.stdout:7/943: dread d4/d4b/d63/fcb [0,4194304] 0 2024-01-17T23:50:16.735 INFO:tasks.workunit.client.0.smithi067.stdout:3/964: unlink d0/c52 0 2024-01-17T23:50:17.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/939: rename d3/d26/d34/f118 to d3/d4e/dee/da6/f133 0 2024-01-17T23:50:17.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/940: creat d3/d4e/dee/d38/dab/f134 x:0 0 0 2024-01-17T23:50:18.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/944: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/f121 x:0 0 0 2024-01-17T23:50:18.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/945: write d4/d25/d39/d79/dde/fe1 [131415,26444] 0 2024-01-17T23:50:18.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/933: dwrite d5/d1f/d2a/d54/d8/d32/f42 [0,4194304] 0 2024-01-17T23:50:18.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/934: stat d5/d86/fef 0 2024-01-17T23:50:18.523 INFO:tasks.workunit.client.0.smithi067.stdout:3/965: mkdir d0/d34/d35/d65/d6f/d70/ddc/d12e 0 2024-01-17T23:50:18.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/994: rename d6/d19/d22/f2f to d6/d19/d22/d25/d53/d65/db6/f14b 0 2024-01-17T23:50:18.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/995: truncate d6/f1a 4906034 0 2024-01-17T23:50:18.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/996: read - d6/d19/d22/d25/f13b zero size 2024-01-17T23:50:18.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/935: mkdir d5/d86/d143 0 2024-01-17T23:50:18.964 INFO:tasks.workunit.client.0.smithi067.stdout:2/936: dread d5/f78 [0,4194304] 0 2024-01-17T23:50:18.965 INFO:tasks.workunit.client.0.smithi067.stdout:2/937: write d5/d1f/d2a/d54/d7c/f82 [1345996,87253] 0 2024-01-17T23:50:18.965 INFO:tasks.workunit.client.0.smithi067.stdout:2/938: write d5/d1f/f43 [261070,43603] 0 2024-01-17T23:50:18.983 INFO:tasks.workunit.client.0.smithi067.stdout:2/939: read d5/d1f/d2a/d54/d8/d4c/d84/f8c [3717097,9712] 0 2024-01-17T23:50:19.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/997: mknod d6/d26/d3e/d87/c14c 0 2024-01-17T23:50:19.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/946: creat d4/d4b/d63/d9c/f122 x:0 0 0 2024-01-17T23:50:19.696 INFO:tasks.workunit.client.0.smithi067.stdout:2/940: mknod d5/d1f/d35/c144 0 2024-01-17T23:50:19.965 INFO:tasks.workunit.client.0.smithi067.stdout:8/998: truncate d6/fe 187688 0 2024-01-17T23:50:19.965 INFO:tasks.workunit.client.0.smithi067.stdout:8/999: chown d6/d19/d22/d25/d53/d54/f77 91954 1 2024-01-17T23:50:20.139 INFO:tasks.workunit.client.0.smithi067.stdout:2/941: symlink d5/d1f/d2a/d54/d8/d4c/d84/da9/l145 0 2024-01-17T23:50:20.167 INFO:tasks.workunit.client.0.smithi067.stdout:2/942: dwrite d5/d1f/d2a/d54/d8/d32/d33/f130 [0,4194304] 0 2024-01-17T23:50:20.395 INFO:tasks.workunit.client.0.smithi067.stdout:2/943: symlink d5/d1f/d2a/d54/d8/d32/l146 0 2024-01-17T23:50:20.395 INFO:tasks.workunit.client.0.smithi067.stdout:2/944: creat d5/d1f/d121/f147 x:0 0 0 2024-01-17T23:50:20.395 INFO:tasks.workunit.client.0.smithi067.stdout:2/945: read d5/d1f/f3c [2000723,8396] 0 2024-01-17T23:50:20.406 INFO:tasks.workunit.client.0.smithi067.stdout:2/946: dread d5/d1f/f1e [0,4194304] 0 2024-01-17T23:50:20.415 INFO:tasks.workunit.client.0.smithi067.stdout:2/947: dread d5/d1f/d2a/d73/d95/fb7 [0,4194304] 0 2024-01-17T23:50:20.415 INFO:tasks.workunit.client.0.smithi067.stdout:2/948: fdatasync d5/d1f/d2a/d73/f83 0 2024-01-17T23:50:20.609 INFO:tasks.workunit.client.0.smithi067.stdout:7/947: mknod d4/d25/d39/c123 0 2024-01-17T23:50:20.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/949: symlink d5/d1f/d16/l148 0 2024-01-17T23:50:20.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/922: write d3/d6/d2a/f71 [1314171,60762] 0 2024-01-17T23:50:21.309 INFO:tasks.workunit.client.0.smithi067.stdout:7/948: creat d4/d4b/d63/d95/dad/dcc/f124 x:0 0 0 2024-01-17T23:50:21.544 INFO:tasks.workunit.client.0.smithi067.stdout:1/937: sync 2024-01-17T23:50:21.544 INFO:tasks.workunit.client.0.smithi067.stdout:1/938: write d0/d7/d13/d2e/fc0 [1045154,14] 0 2024-01-17T23:50:21.555 INFO:tasks.workunit.client.0.smithi067.stdout:1/939: dread d0/d7/d13/fd4 [0,4194304] 0 2024-01-17T23:50:21.604 INFO:tasks.workunit.client.0.smithi067.stdout:5/891: rmdir d10 39 2024-01-17T23:50:21.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/892: dwrite d10/d24/d59/f67 [0,4194304] 0 2024-01-17T23:50:21.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/893: stat d10/d24/d59/d8c/fb6 0 2024-01-17T23:50:21.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/923: creat d3/da/f14c x:0 0 0 2024-01-17T23:50:21.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/924: readlink d3/d6/d11/l29 0 2024-01-17T23:50:21.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/925: getdents d3/d6/da4/d55/da1/dbc/d10f/d14a 0 2024-01-17T23:50:21.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/926: write d3/d6/d2e/dc8/fdd [219096,48448] 0 2024-01-17T23:50:21.741 INFO:tasks.workunit.client.0.smithi067.stdout:9/927: stat d3/d6/d11/d50 0 2024-01-17T23:50:21.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/949: creat d4/d25/d39/d46/d60/f125 x:0 0 0 2024-01-17T23:50:21.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/950: stat d4/d25/d39/d46/d60/c88 0 2024-01-17T23:50:22.111 INFO:tasks.workunit.client.0.smithi067.stdout:2/950: rename d5/d1f/d2a/d54/d8/d32/d33/l76 to d5/d1f/d2a/d73/d95/l149 0 2024-01-17T23:50:22.111 INFO:tasks.workunit.client.0.smithi067.stdout:2/951: stat d5/d1f/d2a/d54/d8/d32/d33/f6f 0 2024-01-17T23:50:22.121 INFO:tasks.workunit.client.0.smithi067.stdout:2/952: dread d5/d1f/f1e [0,4194304] 0 2024-01-17T23:50:22.121 INFO:tasks.workunit.client.0.smithi067.stdout:2/953: fdatasync d5/d1f/d16/fe0 0 2024-01-17T23:50:22.188 INFO:tasks.workunit.client.0.smithi067.stdout:1/940: mkdir d0/d7/d13/d77/d95/d12c 0 2024-01-17T23:50:22.321 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:10.539 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.327 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:10.545 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/894: symlink d10/d24/d25/d5c/d107/d4a/d63/d85/l124 0 2024-01-17T23:50:22.397 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:10.616 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.447 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:10.759 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.452 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:10.764 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.454 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:10.766 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.457 INFO:tasks.workunit.client.0.smithi067.stdout:9/928: mkdir d3/d6/d2a/da2/dbd/d14d 0 2024-01-17T23:50:22.457 INFO:tasks.workunit.client.0.smithi067.stdout:9/929: chown d3/d25/d5d/d79/d14b 61253957 1 2024-01-17T23:50:22.459 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:10.771 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.476 INFO:tasks.workunit.client.0.smithi067.stdout:9/930: write d3/d6/d11/d5c/f6f [95412,38481] 0 2024-01-17T23:50:22.477 INFO:tasks.workunit.client.0.smithi067.stdout:9/931: fsync d3/d6/d11/f4f 0 2024-01-17T23:50:22.502 INFO:tasks.workunit.client.0.smithi067.stdout:9/932: dwrite d3/d6/d47/d88/dc2/d109/f140 [4194304,4194304] 0 2024-01-17T23:50:22.502 INFO:tasks.workunit.client.0.smithi067.stdout:9/933: creat d3/d6/d11/d5c/f14e x:0 0 0 2024-01-17T23:50:22.533 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:10.846 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.541 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:10.853 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:22.566 INFO:tasks.workunit.client.0.smithi067.stdout:7/951: creat d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/f126 x:0 0 0 2024-01-17T23:50:22.567 INFO:tasks.workunit.client.0.smithi067.stdout:7/952: read d4/d25/d39/f30 [1093184,119791] 0 2024-01-17T23:50:22.742 INFO:tasks.workunit.client.0.smithi067.stdout:2/954: creat d5/d1f/d2a/d54/d8/d4c/de3/d12e/d132/f14a x:0 0 0 2024-01-17T23:50:23.685 INFO:tasks.workunit.client.0.smithi067.stdout:5/895: creat d10/d24/d25/d5c/d7e/f125 x:0 0 0 2024-01-17T23:50:24.192 INFO:tasks.workunit.client.0.smithi067.stdout:9/934: mkdir d3/d6/d2a/d34/d14f 0 2024-01-17T23:50:24.348 INFO:tasks.workunit.client.0.smithi067.stdout:7/953: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/f127 x:0 0 0 2024-01-17T23:50:24.348 INFO:tasks.workunit.client.0.smithi067.stdout:7/954: chown d4/c67 0 1 2024-01-17T23:50:24.348 INFO:tasks.workunit.client.0.smithi067.stdout:7/955: read d4/d4b/d63/d95/dad/dcc/f10d [107395,128682] 0 2024-01-17T23:50:24.592 INFO:tasks.workunit.client.0.smithi067.stdout:2/955: mkdir d5/d1f/d2a/d8d/d14b 0 2024-01-17T23:50:24.592 INFO:tasks.workunit.client.0.smithi067.stdout:2/956: stat d5/d1f/d2a/d54/d8/d32/d33/fcc 0 2024-01-17T23:50:24.592 INFO:tasks.workunit.client.0.smithi067.stdout:2/957: stat d5/d86/fef 0 2024-01-17T23:50:24.836 INFO:tasks.workunit.client.0.smithi067.stdout:4/941: rmdir d3/d8 39 2024-01-17T23:50:24.836 INFO:tasks.workunit.client.0.smithi067.stdout:9/935: mknod d3/d6/d11/dd4/c150 0 2024-01-17T23:50:24.837 INFO:tasks.workunit.client.0.smithi067.stdout:4/942: truncate d3/d26/d34/d3a/d9f/fea 4968002 0 2024-01-17T23:50:24.837 INFO:tasks.workunit.client.0.smithi067.stdout:4/943: chown d3/d4e/dee/d20/d3b/ddf/f10e 7 1 2024-01-17T23:50:25.048 INFO:tasks.workunit.client.0.smithi067.stdout:7/956: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/f128 x:0 0 0 2024-01-17T23:50:25.080 INFO:tasks.workunit.client.0.smithi067.stdout:7/957: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/f127 [0,4194304] 0 2024-01-17T23:50:25.109 INFO:tasks.workunit.client.0.smithi067.stdout:7/958: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fbd [0,4194304] 0 2024-01-17T23:50:25.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/959: chown d4/d25/d39/d46/da8 50621705 1 2024-01-17T23:50:25.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/960: chown d4/f26 32583 1 2024-01-17T23:50:25.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/961: stat d4/d25 0 2024-01-17T23:50:25.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/958: creat d5/d1f/d2a/d54/d8/d4c/d84/da9/f14c x:0 0 0 2024-01-17T23:50:25.270 INFO:tasks.workunit.client.0.smithi067.stdout:5/896: truncate d10/d24/d59/d5d/f95 1069024 0 2024-01-17T23:50:25.407 INFO:tasks.workunit.client.0.smithi067.stdout:9/936: dread - d3/d6/d11/d50/fcd zero size 2024-01-17T23:50:25.801 INFO:tasks.workunit.client.0.smithi067.stdout:7/962: dread d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f8e [0,4194304] 0 2024-01-17T23:50:25.892 INFO:tasks.workunit.client.0.smithi067.stdout:2/959: getdents d5/d1f/d2a/d54/d8/d4c/dbf/de2 0 2024-01-17T23:50:25.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/960: creat d5/d2f/f14d x:0 0 0 2024-01-17T23:50:25.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/961: write d5/d1f/d2a/de1/f11d [656588,65041] 0 2024-01-17T23:50:25.921 INFO:tasks.workunit.client.0.smithi067.stdout:2/962: dwrite d5/d1f/d2a/d54/d7c/f82 [0,4194304] 0 2024-01-17T23:50:26.055 INFO:tasks.workunit.client.0.smithi067.stdout:5/897: mkdir d10/d24/d25/d5c/d7e/d126 0 2024-01-17T23:50:26.071 INFO:tasks.workunit.client.0.smithi067.stdout:5/898: dread d10/d24/d25/d5c/d107/d4a/d50/f89 [0,4194304] 0 2024-01-17T23:50:26.076 INFO:tasks.workunit.client.0.smithi067.stdout:9/937: symlink d3/d25/d5d/l151 0 2024-01-17T23:50:26.088 INFO:tasks.workunit.client.0.smithi067.stdout:9/938: dread d3/d6/da4/dba/fde [0,4194304] 0 2024-01-17T23:50:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:9/939: rmdir d3/d6/d47/d88/dc2 39 2024-01-17T23:50:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/963: rmdir d5/d1f/d2a/d54/d39/d68 39 2024-01-17T23:50:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:5/899: creat d10/d24/d25/d5c/d107/d4a/f127 x:0 0 0 2024-01-17T23:50:27.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/940: unlink d3/df0/f101 0 2024-01-17T23:50:27.307 INFO:tasks.workunit.client.0.smithi067.stdout:2/964: unlink d5/d2f/f8f 0 2024-01-17T23:50:27.323 INFO:tasks.workunit.client.0.smithi067.stdout:2/965: read d5/d1f/d2a/d54/d8/f3e [1969232,84827] 0 2024-01-17T23:50:27.354 INFO:tasks.workunit.client.0.smithi067.stdout:2/966: dwrite d5/d1f/d2a/d54/d8/d32/d33/f130 [0,4194304] 0 2024-01-17T23:50:27.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/967: dwrite d5/d1f/d2a/d54/d8/d4c/dbf/f127 [4194304,4194304] 0 2024-01-17T23:50:27.402 INFO:tasks.workunit.client.0.smithi067.stdout:2/968: write d5/d1f/d2a/d55/f99 [2411169,21263] 0 2024-01-17T23:50:27.402 INFO:tasks.workunit.client.0.smithi067.stdout:2/969: truncate d5/d1f/d121/f147 80428 0 2024-01-17T23:50:27.430 INFO:tasks.workunit.client.0.smithi067.stdout:3/966: rmdir d0/de1/d55 39 2024-01-17T23:50:27.437 INFO:tasks.workunit.client.0.smithi067.stdout:2/970: dwrite d5/d1f/d2a/d54/d39/fdb [0,4194304] 0 2024-01-17T23:50:27.437 INFO:tasks.workunit.client.0.smithi067.stdout:2/971: write d5/d1f/d2a/d54/d8/d4c/dbf/f114 [367143,29733] 0 2024-01-17T23:50:27.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/967: write d0/d17/f5f [728817,95241] 0 2024-01-17T23:50:27.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/968: dread - d0/d34/d35/f11a zero size 2024-01-17T23:50:27.699 INFO:tasks.workunit.client.0.smithi067.stdout:9/941: unlink d3/d25/d5d/lcb 0 2024-01-17T23:50:27.910 INFO:tasks.workunit.client.0.smithi067.stdout:5/900: rename d10/d24/c34 to d10/d24/d59/d8c/dae/c128 0 2024-01-17T23:50:27.910 INFO:tasks.workunit.client.0.smithi067.stdout:5/901: chown d10/d24/d25/dd5/c100 77827554 1 2024-01-17T23:50:28.255 INFO:tasks.workunit.client.0.smithi067.stdout:2/972: creat d5/d1f/d98/dfe/f14e x:0 0 0 2024-01-17T23:50:28.736 INFO:tasks.workunit.client.0.smithi067.stdout:3/969: dread d0/de1/fba [0,4194304] 0 2024-01-17T23:50:29.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/941: sync 2024-01-17T23:50:29.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/942: readlink d0/d7/d13/d77/lf5 0 2024-01-17T23:50:29.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/942: unlink d3/d6/d11/d5c/c100 0 2024-01-17T23:50:29.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/943: fdatasync d3/d6/da4/dba/fde 0 2024-01-17T23:50:29.623 INFO:tasks.workunit.client.0.smithi067.stdout:2/973: rename d5/d1f/d2a/d8d/fc8 to d5/d1f/d2a/d54/d8/d32/d33/f14f 0 2024-01-17T23:50:29.794 INFO:tasks.workunit.client.0.smithi067.stdout:3/970: chown d0/d34/d35/lb7 0 1 2024-01-17T23:50:29.942 INFO:tasks.workunit.client.0.smithi067.stdout:1/943: read d0/d7/d13/d3a/d75/ded/fb0 [968040,94660] 0 2024-01-17T23:50:30.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/944: mknod d3/d6/da4/d55/d115/d11d/d12b/c152 0 2024-01-17T23:50:30.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/945: write d3/d6/d2a/f135 [113848,88984] 0 2024-01-17T23:50:30.284 INFO:tasks.workunit.client.0.smithi067.stdout:2/974: creat d5/d1f/d2a/d54/d8/d4c/de3/d12e/d132/f150 x:0 0 0 2024-01-17T23:50:30.284 INFO:tasks.workunit.client.0.smithi067.stdout:2/975: write d5/d1f/d2a/d54/d8/d32/f81 [1485259,57865] 0 2024-01-17T23:50:30.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/971: creat d0/d37/f12f x:0 0 0 2024-01-17T23:50:30.544 INFO:tasks.workunit.client.0.smithi067.stdout:3/972: dread - d0/d17/dc8/dae/df6/fff zero size 2024-01-17T23:50:30.544 INFO:tasks.workunit.client.0.smithi067.stdout:1/944: mknod d0/d7/d13/d3d/dd0/c12d 0 2024-01-17T23:50:30.544 INFO:tasks.workunit.client.0.smithi067.stdout:1/945: chown d0/d74/d31/fbe 25175 1 2024-01-17T23:50:30.575 INFO:tasks.workunit.client.0.smithi067.stdout:9/946: dwrite d3/d6/d11/d5c/f6f [0,4194304] 0 2024-01-17T23:50:30.651 INFO:tasks.workunit.client.0.smithi067.stdout:2/976: link d5/d1f/l11c d5/d1f/d2a/d54/d8/d32/d9c/l151 0 2024-01-17T23:50:30.670 INFO:tasks.workunit.client.0.smithi067.stdout:2/977: write d5/d1f/d2a/d54/d8/db5/fd3 [1186394,41180] 0 2024-01-17T23:50:30.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/963: write d4/d4b/d63/f10e [493874,20216] 0 2024-01-17T23:50:31.024 INFO:tasks.workunit.client.0.smithi067.stdout:3/973: mknod d0/d13/c130 0 2024-01-17T23:50:31.024 INFO:tasks.workunit.client.0.smithi067.stdout:3/974: dread - d0/d17/d69/d6e/f11d zero size 2024-01-17T23:50:31.213 INFO:tasks.workunit.client.0.smithi067.stdout:9/947: symlink d3/d6/d11/d5c/l153 0 2024-01-17T23:50:31.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/978: creat d5/d1f/d2a/d54/d39/f152 x:0 0 0 2024-01-17T23:50:31.502 INFO:tasks.workunit.client.0.smithi067.stdout:2/979: write d5/d1f/d2a/d54/d8/f3e [4420997,62188] 0 2024-01-17T23:50:31.523 INFO:tasks.workunit.client.0.smithi067.stdout:2/980: dwrite d5/d2f/f140 [0,4194304] 0 2024-01-17T23:50:31.540 INFO:tasks.workunit.client.0.smithi067.stdout:2/981: dread d5/d1f/d2a/d54/d8/f34 [0,4194304] 0 2024-01-17T23:50:31.811 INFO:tasks.workunit.client.0.smithi067.stdout:7/964: rename d4/d25/d39/d46/d78/d93/ff4 to d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/f129 0 2024-01-17T23:50:31.811 INFO:tasks.workunit.client.0.smithi067.stdout:7/965: truncate d4/ff2 780131 0 2024-01-17T23:50:31.963 INFO:tasks.workunit.client.0.smithi067.stdout:3/975: getdents d0/d17/dc8/dae/d107 0 2024-01-17T23:50:32.090 INFO:tasks.workunit.client.0.smithi067.stdout:1/946: truncate d0/d74/f84 4302535 0 2024-01-17T23:50:32.107 INFO:tasks.workunit.client.0.smithi067.stdout:1/947: dread d0/d7/d13/fa9 [0,4194304] 0 2024-01-17T23:50:32.126 INFO:tasks.workunit.client.0.smithi067.stdout:1/948: dread d0/d7/d13/d77/f113 [0,4194304] 0 2024-01-17T23:50:32.636 INFO:tasks.workunit.client.0.smithi067.stdout:2/982: mknod d5/d1f/d2a/c153 0 2024-01-17T23:50:32.636 INFO:tasks.workunit.client.0.smithi067.stdout:2/983: readlink d5/d1f/d16/l18 0 2024-01-17T23:50:32.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/984: dwrite d5/f78 [0,4194304] 0 2024-01-17T23:50:32.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/985: dread - d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/f108 zero size 2024-01-17T23:50:32.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/986: chown d5/d1f/d2a/d54/d8/db5/fd3 25632259 1 2024-01-17T23:50:32.671 INFO:tasks.workunit.client.0.smithi067.stdout:2/987: dread d5/d1f/d2a/d54/d8/f45 [0,4194304] 0 2024-01-17T23:50:32.922 INFO:tasks.workunit.client.0.smithi067.stdout:3/976: symlink d0/d34/d35/d65/d6f/l131 0 2024-01-17T23:50:32.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/977: dread d0/de1/d75/dcb/d12b/dd3/f10d [4194304,4194304] 0 2024-01-17T23:50:32.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/978: chown d0/d17/l4e 14107 1 2024-01-17T23:50:32.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/979: stat d0/d13/f8a 0 2024-01-17T23:50:32.926 INFO:tasks.workunit.client.0.smithi067.stdout:3/980: fdatasync d0/d17/dc8/f66 0 2024-01-17T23:50:32.941 INFO:tasks.workunit.client.0.smithi067.stdout:3/981: dread d0/f5 [4194304,4194304] 0 2024-01-17T23:50:32.981 INFO:tasks.workunit.client.0.smithi067.stdout:3/982: dwrite d0/d12/f21 [4194304,4194304] 0 2024-01-17T23:50:33.095 INFO:tasks.workunit.client.0.smithi067.stdout:1/949: rename d0/d7/f4c to d0/d7/d13/d3d/dd0/f12e 0 2024-01-17T23:50:33.215 INFO:tasks.workunit.client.0.smithi067.stdout:4/944: mknod d3/d4e/dee/c135 0 2024-01-17T23:50:33.229 INFO:tasks.workunit.client.0.smithi067.stdout:4/945: dread d3/d4e/dee/da6/f116 [0,4194304] 0 2024-01-17T23:50:33.229 INFO:tasks.workunit.client.0.smithi067.stdout:4/946: write d3/d8/f1f [2546680,86376] 0 2024-01-17T23:50:33.229 INFO:tasks.workunit.client.0.smithi067.stdout:4/947: dread - d3/d4e/dee/d20/d3b/ddf/f10e zero size 2024-01-17T23:50:33.258 INFO:tasks.workunit.client.0.smithi067.stdout:4/948: dwrite d3/d26/fa9 [0,4194304] 0 2024-01-17T23:50:33.646 INFO:tasks.workunit.client.0.smithi067.stdout:2/988: mknod d5/d1f/d16/d61/c154 0 2024-01-17T23:50:33.790 INFO:tasks.workunit.client.0.smithi067.stdout:7/966: truncate d4/d25/d39/d46/d78/d93/d94/dc4/f4d 3467126 0 2024-01-17T23:50:34.064 INFO:tasks.workunit.client.0.smithi067.stdout:3/983: symlink d0/de1/d75/dcb/d12b/dd3/l132 0 2024-01-17T23:50:34.080 INFO:tasks.workunit.client.0.smithi067.stdout:3/984: dread d0/d17/f5f [0,4194304] 0 2024-01-17T23:50:34.080 INFO:tasks.workunit.client.0.smithi067.stdout:3/985: dread - d0/d34/d35/d65/d6f/f117 zero size 2024-01-17T23:50:34.236 INFO:tasks.workunit.client.0.smithi067.stdout:1/950: mknod d0/d62/c12f 0 2024-01-17T23:50:34.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/902: dwrite d10/d24/d25/f2a [0,4194304] 0 2024-01-17T23:50:34.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/903: dwrite d10/d24/d25/d5c/d107/db1/f106 [0,4194304] 0 2024-01-17T23:50:34.580 INFO:tasks.workunit.client.0.smithi067.stdout:4/949: rename d3/d4e/f85 to d3/d4e/dee/d20/d3b/ddf/f136 0 2024-01-17T23:50:35.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/967: symlink d4/d25/d39/d46/d78/d93/d94/l12a 0 2024-01-17T23:50:35.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/968: chown d4/c101 482876957 1 2024-01-17T23:50:35.089 INFO:tasks.workunit.client.0.smithi067.stdout:7/969: write d4/d4b/d63/fd1 [8233875,122542] 0 2024-01-17T23:50:35.089 INFO:tasks.workunit.client.0.smithi067.stdout:7/970: dread - d4/d25/d39/d46/da8/db0/f11a zero size 2024-01-17T23:50:35.111 INFO:tasks.workunit.client.0.smithi067.stdout:7/971: write d4/d16/f3f [7055725,110661] 0 2024-01-17T23:50:35.193 INFO:tasks.workunit.client.0.smithi067.stdout:3/986: symlink d0/d34/d35/d65/l133 0 2024-01-17T23:50:35.373 INFO:tasks.workunit.client.0.smithi067.stdout:1/951: dread d0/d7/d13/d3a/f59 [0,4194304] 0 2024-01-17T23:50:35.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/904: fdatasync d10/d24/d59/d5d/f9f 0 2024-01-17T23:50:35.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/905: fsync d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/f76 0 2024-01-17T23:50:35.647 INFO:tasks.workunit.client.0.smithi067.stdout:5/906: dwrite d10/d24/d25/f2e [4194304,4194304] 0 2024-01-17T23:50:35.842 INFO:tasks.workunit.client.0.smithi067.stdout:4/950: rmdir d3/d40/dc8/d122 0 2024-01-17T23:50:36.039 INFO:tasks.workunit.client.0.smithi067.stdout:7/972: symlink d4/d25/d39/d46/d78/d93/d94/dc4/d40/l12b 0 2024-01-17T23:50:36.039 INFO:tasks.workunit.client.0.smithi067.stdout:7/973: chown d4/ffc 11895 1 2024-01-17T23:50:36.776 INFO:tasks.workunit.client.0.smithi067.stdout:3/987: mkdir d0/d13/d1a/d134 0 2024-01-17T23:50:36.776 INFO:tasks.workunit.client.0.smithi067.stdout:3/988: chown d0/de1/d75/dcb/d12b 77 1 2024-01-17T23:50:36.886 INFO:tasks.workunit.client.0.smithi067.stdout:1/952: fdatasync d0/d7/d13/d3a/d75/ded/f79 0 2024-01-17T23:50:36.941 INFO:tasks.workunit.client.0.smithi067.stdout:1/953: dwrite d0/d7/d13/d2e/f46 [0,4194304] 0 2024-01-17T23:50:37.125 INFO:tasks.workunit.client.0.smithi067.stdout:5/907: read d10/f1c [52490,110778] 0 2024-01-17T23:50:37.201 INFO:tasks.workunit.client.0.smithi067.stdout:4/951: write d3/d4e/dee/d38/f7e [681433,100896] 0 2024-01-17T23:50:37.201 INFO:tasks.workunit.client.0.smithi067.stdout:4/952: chown d3/d26/d34/d65 0 1 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/974: rename d4/d25/c76 to d4/d25/d39/d46/d60/ddc/c12c 0 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/975: dread - d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/f121 zero size 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/976: chown d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/db3/da9/dbb/f10a 1005387823 1 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/977: dread - d4/d25/d39/d46/d78/d93/d94/dc4/d40/d84/fd4 zero size 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/978: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/d7d/f12d x:0 0 0 2024-01-17T23:50:37.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/979: readlink d4/d25/d39/d46/d78/d93/l114 0 2024-01-17T23:50:37.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/948: write d3/d6/d47/d88/f10b [1683640,100704] 0 2024-01-17T23:50:37.387 INFO:tasks.workunit.client.0.smithi067.stdout:1/954: symlink d0/d7/d13/d3d/dd0/l130 0 2024-01-17T23:50:37.512 INFO:tasks.workunit.client.0.smithi067.stdout:5/908: getdents d10/d24/d59/d5d 0 2024-01-17T23:50:37.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/909: dwrite d10/d24/d25/d5c/d7e/d7f/f98 [0,4194304] 0 2024-01-17T23:50:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:5/910: readlink d10/d53/da4/l11f 0 2024-01-17T23:50:37.554 INFO:tasks.workunit.client.0.smithi067.stdout:5/911: read d10/d24/d25/d5c/d7e/fd9 [3928736,93492] 0 2024-01-17T23:50:37.564 INFO:tasks.workunit.client.0.smithi067.stdout:5/912: dread d10/d24/d25/d5c/d107/d4a/d50/f89 [0,4194304] 0 2024-01-17T23:50:37.565 INFO:tasks.workunit.client.0.smithi067.stdout:5/913: chown d10/d24/f36 2718 1 2024-01-17T23:50:37.591 INFO:tasks.workunit.client.0.smithi067.stdout:5/914: dwrite d10/d24/d25/d5c/d107/d4a/fec [0,4194304] 0 2024-01-17T23:50:37.591 INFO:tasks.workunit.client.0.smithi067.stdout:5/915: chown d10/d53/da4/dc6 1186 1 2024-01-17T23:50:37.713 INFO:tasks.workunit.client.0.smithi067.stdout:4/953: creat d3/d4e/f137 x:0 0 0 2024-01-17T23:50:37.713 INFO:tasks.workunit.client.0.smithi067.stdout:4/954: write d3/d4e/dee/df8/f132 [568909,12554] 0 2024-01-17T23:50:37.737 INFO:tasks.workunit.client.0.smithi067.stdout:4/955: dwrite d3/d26/f123 [0,4194304] 0 2024-01-17T23:50:37.959 INFO:tasks.workunit.client.0.smithi067.stdout:3/989: rename d0/de1/d75/dcb/f111 to d0/d17/dc8/dae/df6/d115/f135 0 2024-01-17T23:50:38.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/949: dread d3/d6/d2a/da2/de2/dd0/fc3 [0,4194304] 0 2024-01-17T23:50:38.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/950: chown d3/d6/d11/d5c/f6f 560821 1 2024-01-17T23:50:38.297 INFO:tasks.workunit.client.0.smithi067.stdout:1/955: mkdir d0/d7/d13/d77/dee/d131 0 2024-01-17T23:50:38.298 INFO:tasks.workunit.client.0.smithi067.stdout:1/956: creat d0/d7/d13/d3d/dd0/f132 x:0 0 0 2024-01-17T23:50:38.889 INFO:tasks.workunit.client.0.smithi067.stdout:5/916: mknod d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/c129 0 2024-01-17T23:50:40.097 INFO:tasks.workunit.client.0.smithi067.stdout:3/990: creat d0/d17/d69/d6e/dd7/f136 x:0 0 0 2024-01-17T23:50:40.266 INFO:tasks.workunit.client.0.smithi067.stdout:9/951: truncate d3/d6/da4/f67 397160 0 2024-01-17T23:50:40.274 INFO:tasks.workunit.client.0.smithi067.stdout:9/952: dread d3/d6/d2a/f71 [4194304,4194304] 0 2024-01-17T23:50:40.393 INFO:tasks.workunit.client.0.smithi067.stdout:1/957: rmdir d0/d7/d13/d3a/d75/da1 39 2024-01-17T23:50:40.499 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:28.717 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.502 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:28.721 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.528 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:28.840 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.530 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:51:28.748 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.535 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:28.848 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.535 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:28.848 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.540 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:28.853 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/917: rename d10/d24/d25/d5c/d107/d4a/fec to d10/d24/d59/d5d/dce/f12a 0 2024-01-17T23:50:40.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/918: chown d10/fc7 50939689 1 2024-01-17T23:50:40.588 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:51:28.900 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.588 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:51:28.901 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:50:40.656 INFO:tasks.workunit.client.0.smithi067.stdout:7/980: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/f12e x:0 0 0 2024-01-17T23:50:40.656 INFO:tasks.workunit.client.0.smithi067.stdout:7/981: truncate d4/d4b/d63/f10e 1448890 0 2024-01-17T23:50:40.715 INFO:tasks.workunit.client.0.smithi067.stdout:3/991: creat d0/de1/d75/f137 x:0 0 0 2024-01-17T23:50:40.715 INFO:tasks.workunit.client.0.smithi067.stdout:3/992: write d0/d17/d69/d6e/dd7/f136 [373393,20727] 0 2024-01-17T23:50:40.715 INFO:tasks.workunit.client.0.smithi067.stdout:3/993: read - d0/d34/d35/d65/d6f/f117 zero size 2024-01-17T23:50:40.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/989: write d5/d1f/d2a/d54/d39/ff0 [563871,91932] 0 2024-01-17T23:50:40.826 INFO:tasks.workunit.client.0.smithi067.stdout:9/953: dread - d3/d6/d11/d50/d84/f144 zero size 2024-01-17T23:50:40.849 INFO:tasks.workunit.client.0.smithi067.stdout:9/954: dwrite d3/d6/d11/d50/d84/fa0 [0,4194304] 0 2024-01-17T23:50:40.879 INFO:tasks.workunit.client.0.smithi067.stdout:1/958: dread d0/d7/d13/d3d/d48/da4/fcd [0,4194304] 0 2024-01-17T23:50:40.890 INFO:tasks.workunit.client.0.smithi067.stdout:1/959: dread d0/d7/d13/fa9 [0,4194304] 0 2024-01-17T23:50:40.945 INFO:tasks.workunit.client.0.smithi067.stdout:5/919: mknod d10/d24/d25/c12b 0 2024-01-17T23:50:40.945 INFO:tasks.workunit.client.0.smithi067.stdout:5/920: dread - d10/d24/d25/d5c/fcb zero size 2024-01-17T23:50:40.995 INFO:tasks.workunit.client.0.smithi067.stdout:7/982: mknod d4/d4b/d7f/c12f 0 2024-01-17T23:50:41.252 INFO:tasks.workunit.client.0.smithi067.stdout:3/994: rename d0/d13/d1a/fb5 to d0/d13/d8e/f138 0 2024-01-17T23:50:41.252 INFO:tasks.workunit.client.0.smithi067.stdout:3/995: write d0/d34/ff3 [1011471,32863] 0 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/990: symlink d5/d1f/d2a/d55/l155 0 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/991: dread - d5/d1f/d2a/d54/d8/d4c/dbf/de2/df6/f108 zero size 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:9/955: link d3/d6/d2e/f116 d3/d6/d2a/da2/de2/dd0/f154 0 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/960: symlink d0/d7/d93/l133 0 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/961: chown d0/d74/c129 3 1 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/962: write d0/f114 [867771,94689] 0 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/963: dread - d0/d7/d13/d3d/f100 zero size 2024-01-17T23:50:41.254 INFO:tasks.workunit.client.0.smithi067.stdout:1/964: readlink d0/l1f 0 2024-01-17T23:50:41.280 INFO:tasks.workunit.client.0.smithi067.stdout:2/992: dwrite d5/d1f/d2a/d54/d8/d4c/d84/da9/f14c [0,4194304] 0 2024-01-17T23:50:41.511 INFO:tasks.workunit.client.0.smithi067.stdout:7/983: link d4/d16/f3f d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/f130 0 2024-01-17T23:50:41.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/956: link d3/d6/d11/dd4/c150 d3/d6/d10/c155 0 2024-01-17T23:50:41.909 INFO:tasks.workunit.client.0.smithi067.stdout:9/957: dwrite d3/d6/d11/f4f [0,4194304] 0 2024-01-17T23:50:42.048 INFO:tasks.workunit.client.0.smithi067.stdout:1/965: creat d0/d7/d13/d3a/d75/dc3/f134 x:0 0 0 2024-01-17T23:50:42.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/984: dwrite d4/d25/d39/d46/d78/d93/d94/dc4/f14 [0,4194304] 0 2024-01-17T23:50:42.834 INFO:tasks.workunit.client.0.smithi067.stdout:7/985: write d4/d4b/d7f/d82/f9b [915307,110119] 0 2024-01-17T23:50:42.852 INFO:tasks.workunit.client.0.smithi067.stdout:7/986: read d4/d25/d39/d46/d78/d93/fa4 [3555926,103245] 0 2024-01-17T23:50:43.017 INFO:tasks.workunit.client.0.smithi067.stdout:9/958: rmdir d3/d6/da4/d55 39 2024-01-17T23:50:43.211 INFO:tasks.workunit.client.0.smithi067.stdout:1/966: rename d0/d7/d13/d3d/d48/fd8 to d0/d7/d13/d3d/dd0/f135 0 2024-01-17T23:50:43.578 INFO:tasks.workunit.client.0.smithi067.stdout:7/987: symlink d4/d4b/d7f/l131 0 2024-01-17T23:50:43.665 INFO:tasks.workunit.client.0.smithi067.stdout:9/959: mkdir d3/d6/d10/dfe/d156 0 2024-01-17T23:50:43.670 INFO:tasks.workunit.client.0.smithi067.stdout:9/960: dread d3/d6/d11/d5c/ffc [0,4194304] 0 2024-01-17T23:50:43.985 INFO:tasks.workunit.client.0.smithi067.stdout:1/967: unlink d0/d7/d13/d3d/d48/cb4 0 2024-01-17T23:50:43.985 INFO:tasks.workunit.client.0.smithi067.stdout:1/968: readlink d0/d69/le3 0 2024-01-17T23:50:44.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/961: creat d3/d6/da4/d55/d115/d11d/d12b/f157 x:0 0 0 2024-01-17T23:50:44.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/962: chown d3/d6/da4 364792 1 2024-01-17T23:50:44.631 INFO:tasks.workunit.client.0.smithi067.stdout:1/969: getdents d0/d7/d13/d3d/d48/da4 0 2024-01-17T23:50:44.631 INFO:tasks.workunit.client.0.smithi067.stdout:1/970: readlink d0/d69/l70 0 2024-01-17T23:50:44.632 INFO:tasks.workunit.client.0.smithi067.stdout:1/971: chown d0/d7/d13/d3d/d48/da4/fcd 3435516 1 2024-01-17T23:50:44.840 INFO:tasks.workunit.client.0.smithi067.stdout:9/963: rmdir d3/d6/d10/dfe 39 2024-01-17T23:50:45.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:45.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:50:46.066 INFO:tasks.workunit.client.0.smithi067.stdout:4/956: sync 2024-01-17T23:50:46.095 INFO:tasks.workunit.client.0.smithi067.stdout:5/921: symlink d10/d24/d59/l12c 0 2024-01-17T23:50:46.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/996: dwrite d0/d13/f19 [0,4194304] 0 2024-01-17T23:50:46.326 INFO:tasks.workunit.client.0.smithi067.stdout:3/997: write d0/d12/fd1 [710566,112974] 0 2024-01-17T23:50:46.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/998: dread d0/d17/dc8/d124/ffc [0,4194304] 0 2024-01-17T23:50:46.891 INFO:tasks.workunit.client.0.smithi067.stdout:4/957: mkdir d3/d26/d34/d138 0 2024-01-17T23:50:47.005 INFO:tasks.workunit.client.0.smithi067.stdout:5/922: creat d10/d24/d59/d8c/dba/df3/f12d x:0 0 0 2024-01-17T23:50:47.122 INFO:tasks.workunit.client.0.smithi067.stdout:2/993: sync 2024-01-17T23:50:47.586 INFO:tasks.workunit.client.0.smithi067.stdout:4/958: dread - d3/d8/d35/d36/fcb zero size 2024-01-17T23:50:47.703 INFO:tasks.workunit.client.0.smithi067.stdout:5/923: creat d10/d24/d25/d5c/d107/f12e x:0 0 0 2024-01-17T23:50:48.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/959: rename d3/d8/d35/f10b to d3/d4e/dee/df8/f139 0 2024-01-17T23:50:48.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/924: getdents d10/d24/d25 0 2024-01-17T23:50:48.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/960: creat d3/d40/dc8/f13a x:0 0 0 2024-01-17T23:50:48.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/972: rmdir d0/ddc 39 2024-01-17T23:50:49.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/961: getdents d3/d26/d34 0 2024-01-17T23:50:49.239 INFO:tasks.workunit.client.0.smithi067.stdout:7/988: creat d4/d25/d39/f132 x:0 0 0 2024-01-17T23:50:49.565 INFO:tasks.workunit.client.0.smithi067.stdout:2/994: write d5/d1f/d2a/d55/fba [1669326,125358] 0 2024-01-17T23:50:49.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/973: write d0/d7/d13/d3a/d3e/f5e [4006867,33256] 0 2024-01-17T23:50:49.983 INFO:tasks.workunit.client.0.smithi067.stdout:4/962: symlink d3/l13b 0 2024-01-17T23:50:50.037 INFO:tasks.workunit.client.0.smithi067.stdout:3/999: dwrite d0/de1/d55/f72 [0,4194304] 0 2024-01-17T23:50:50.040 INFO:tasks.workunit.client.0.smithi067.stdout:4/963: dwrite d3/d8/d35/d36/fcb [0,4194304] 0 2024-01-17T23:50:50.094 INFO:tasks.workunit.client.0.smithi067.stdout:7/989: symlink d4/d16/dc3/l133 0 2024-01-17T23:50:50.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/974: rename d0/cc to d0/d7/d93/c136 0 2024-01-17T23:50:50.467 INFO:tasks.workunit.client.0.smithi067.stdout:5/925: dwrite fd [0,4194304] 0 2024-01-17T23:50:50.904 INFO:tasks.workunit.client.0.smithi067.stdout:4/964: link d3/d4e/dee/ld8 d3/d4e/dee/d20/l13c 0 2024-01-17T23:50:51.066 INFO:tasks.workunit.client.0.smithi067.stdout:7/990: unlink d4/d25/d39/d8a/f11b 0 2024-01-17T23:50:51.066 INFO:tasks.workunit.client.0.smithi067.stdout:7/991: fsync d4/d4b/d7f/d82/f9b 0 2024-01-17T23:50:51.066 INFO:tasks.workunit.client.0.smithi067.stdout:7/992: dread - d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/f12e zero size 2024-01-17T23:50:51.066 INFO:tasks.workunit.client.0.smithi067.stdout:7/993: dread - d4/d25/d39/d46/d60/ddc/f11c zero size 2024-01-17T23:50:51.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/995: fsync d5/d1f/d2a/d54/d39/d68/fc1 0 2024-01-17T23:50:51.300 INFO:tasks.workunit.client.0.smithi067.stdout:9/964: sync 2024-01-17T23:50:51.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/965: fdatasync d3/d58/fee 0 2024-01-17T23:50:51.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/966: write d3/d6/d2a/d34/d42/d9c/f114 [834226,35028] 0 2024-01-17T23:50:51.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/967: truncate d3/d58/fee 212203 0 2024-01-17T23:50:51.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/926: symlink d10/d24/d59/d5d/l12f 0 2024-01-17T23:50:51.369 INFO:tasks.workunit.client.0.smithi067.stdout:5/927: write d10/d53/fd0 [321183,22364] 0 2024-01-17T23:50:51.486 INFO:tasks.workunit.client.0.smithi067.stdout:4/965: creat d3/d4e/dee/d20/d3b/d7c/d92/dc5/f13d x:0 0 0 2024-01-17T23:50:51.621 INFO:tasks.workunit.client.0.smithi067.stdout:7/994: rename d4/d16/dc3/fd8 to d4/d25/d39/d79/dde/f134 0 2024-01-17T23:50:51.963 INFO:tasks.workunit.client.0.smithi067.stdout:1/975: mknod d0/d74/c137 0 2024-01-17T23:50:51.964 INFO:tasks.workunit.client.0.smithi067.stdout:1/976: write d0/d62/f12b [14264,63952] 0 2024-01-17T23:50:51.980 INFO:tasks.workunit.client.0.smithi067.stdout:1/977: dread d0/d7/d13/d77/d95/ff7 [0,4194304] 0 2024-01-17T23:50:52.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/968: symlink d3/d6/da4/dba/l158 0 2024-01-17T23:50:52.178 INFO:tasks.workunit.client.0.smithi067.stdout:9/969: dread d3/d6/d2a/f3f [0,4194304] 0 2024-01-17T23:50:52.178 INFO:tasks.workunit.client.0.smithi067.stdout:9/970: truncate d3/d6/d2a/fc6 2398638 0 2024-01-17T23:50:52.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/928: mknod d10/d24/d59/d5d/dce/c130 0 2024-01-17T23:50:52.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/929: write f9 [4718516,68890] 0 2024-01-17T23:50:52.656 INFO:tasks.workunit.client.0.smithi067.stdout:5/930: read d10/d24/d25/d5c/d107/d4a/fd7 [678228,117579] 0 2024-01-17T23:50:52.843 INFO:tasks.workunit.client.0.smithi067.stdout:4/966: creat d3/d8/d35/f13e x:0 0 0 2024-01-17T23:50:52.972 INFO:tasks.workunit.client.0.smithi067.stdout:7/995: link d4/d4b/d63/f10e d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/f135 0 2024-01-17T23:50:53.280 INFO:tasks.workunit.client.0.smithi067.stdout:1/978: rename d0/d62/lce to d0/d7/d13/d3d/d48/d126/l138 0 2024-01-17T23:50:53.280 INFO:tasks.workunit.client.0.smithi067.stdout:1/979: chown d0/f5 25 1 2024-01-17T23:50:53.309 INFO:tasks.workunit.client.0.smithi067.stdout:1/980: dwrite d0/d7/d13/f5b [0,4194304] 0 2024-01-17T23:50:53.802 INFO:tasks.workunit.client.0.smithi067.stdout:5/931: mknod d10/d24/d59/d5d/dce/d10d/c131 0 2024-01-17T23:50:53.872 INFO:tasks.workunit.client.0.smithi067.stdout:4/967: mknod d3/d5/d93/c13f 0 2024-01-17T23:50:53.873 INFO:tasks.workunit.client.0.smithi067.stdout:4/968: fsync d3/db8/f114 0 2024-01-17T23:50:53.910 INFO:tasks.workunit.client.0.smithi067.stdout:4/969: dwrite d3/d8/f1f [0,4194304] 0 2024-01-17T23:50:54.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/996: rename d4/d4b/d7f/f87 to d4/d25/d39/d46/d78/d93/d94/dc4/d41/da2/f136 0 2024-01-17T23:50:54.342 INFO:tasks.workunit.client.0.smithi067.stdout:7/997: creat d4/d25/d39/d46/d78/d93/d94/dc4/d41/dca/f137 x:0 0 0 2024-01-17T23:50:54.628 INFO:tasks.workunit.client.0.smithi067.stdout:1/981: dread d0/d69/f106 [0,4194304] 0 2024-01-17T23:50:54.667 INFO:tasks.workunit.client.0.smithi067.stdout:2/996: dwrite d5/d1f/d2a/d54/d8/d4c/fc2 [0,4194304] 0 2024-01-17T23:50:55.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/970: truncate d3/d4e/dee/f54 1520422 0 2024-01-17T23:50:56.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/971: dwrite d3/d6/da4/dba/fe6 [0,4194304] 0 2024-01-17T23:50:56.606 INFO:tasks.workunit.client.0.smithi067.stdout:5/932: mknod d10/d24/d25/d5c/d107/db1/c132 0 2024-01-17T23:50:56.784 INFO:tasks.workunit.client.0.smithi067.stdout:4/971: symlink d3/d4e/dee/df8/l140 0 2024-01-17T23:50:56.785 INFO:tasks.workunit.client.0.smithi067.stdout:4/972: dread - d3/f10d zero size 2024-01-17T23:50:56.785 INFO:tasks.workunit.client.0.smithi067.stdout:4/973: chown d3/d26/d34/d3a/d53/fb3 32899395 1 2024-01-17T23:50:56.815 INFO:tasks.workunit.client.0.smithi067.stdout:1/982: truncate d0/d7/d13/d3a/d3e/fe9 130074 0 2024-01-17T23:50:56.911 INFO:tasks.workunit.client.0.smithi067.stdout:9/972: rmdir d3/d6/d2a/da2 39 2024-01-17T23:50:56.911 INFO:tasks.workunit.client.0.smithi067.stdout:9/973: write d3/d6/d2e/dc8/fdb [300485,3026] 0 2024-01-17T23:50:57.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/933: creat d10/d24/d59/d5d/dce/d10d/f133 x:0 0 0 2024-01-17T23:50:57.209 INFO:tasks.workunit.client.0.smithi067.stdout:4/974: symlink d3/d40/dc8/l141 0 2024-01-17T23:50:57.209 INFO:tasks.workunit.client.0.smithi067.stdout:4/975: write d3/d5/d93/f96 [405416,30669] 0 2024-01-17T23:50:57.383 INFO:tasks.workunit.client.0.smithi067.stdout:1/983: symlink d0/d7/d13/d3d/d48/d4d/l139 0 2024-01-17T23:50:57.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/974: mknod d3/d6/d2a/da2/dbd/d14d/c159 0 2024-01-17T23:50:57.908 INFO:tasks.workunit.client.0.smithi067.stdout:4/976: symlink d3/d4e/dee/d38/l142 0 2024-01-17T23:50:57.909 INFO:tasks.workunit.client.0.smithi067.stdout:4/977: dread - d3/d40/f73 zero size 2024-01-17T23:50:57.920 INFO:tasks.workunit.client.0.smithi067.stdout:4/978: dread d3/d8/d35/db0/fbd [0,4194304] 0 2024-01-17T23:50:57.980 INFO:tasks.workunit.client.0.smithi067.stdout:1/984: truncate d0/d7/f66 3234906 0 2024-01-17T23:50:58.254 INFO:tasks.workunit.client.0.smithi067.stdout:4/979: read d3/d4e/dee/d20/d3b/d7c/d92/f120 [3464911,50004] 0 2024-01-17T23:50:58.254 INFO:tasks.workunit.client.0.smithi067.stdout:4/980: fsync d3/d4e/dee/d38/f7e 0 2024-01-17T23:50:58.254 INFO:tasks.workunit.client.0.smithi067.stdout:4/981: write d3/d26/d34/d3a/fa0 [1120085,36687] 0 2024-01-17T23:50:58.273 INFO:tasks.workunit.client.0.smithi067.stdout:4/982: dread d3/d26/d34/d65/f111 [0,4194304] 0 2024-01-17T23:50:58.403 INFO:tasks.workunit.client.0.smithi067.stdout:1/985: mkdir d0/d7/d13/d3d/d48/d126/d13a 0 2024-01-17T23:50:58.503 INFO:tasks.workunit.client.0.smithi067.stdout:9/975: getdents d3/d58 0 2024-01-17T23:50:58.503 INFO:tasks.workunit.client.0.smithi067.stdout:9/976: creat d3/d6/da4/dba/f15a x:0 0 0 2024-01-17T23:50:58.598 INFO:tasks.workunit.client.0.smithi067.stdout:4/983: symlink d3/d4e/dee/d20/d3b/d7c/d92/l143 0 2024-01-17T23:50:58.900 INFO:tasks.workunit.client.0.smithi067.stdout:1/986: mkdir d0/d7/d13/d77/d95/d104/d13b 0 2024-01-17T23:50:59.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/977: mknod d3/d6/da4/d55/da1/dbc/d10f/d14a/c15b 0 2024-01-17T23:50:59.668 INFO:tasks.workunit.client.0.smithi067.stdout:9/978: unlink d3/d6/d2a/d34/d42/f4d 0 2024-01-17T23:51:00.079 INFO:tasks.workunit.client.0.smithi067.stdout:4/984: link d3/d4e/dee/d20/ce5 d3/d26/d34/d3a/c144 0 2024-01-17T23:51:00.206 INFO:tasks.workunit.client.0.smithi067.stdout:1/987: mknod d0/d7/d13/d3a/d3e/c13c 0 2024-01-17T23:51:00.209 INFO:tasks.workunit.client.0.smithi067.stdout:1/988: dread d0/ff1 [0,4194304] 0 2024-01-17T23:51:00.350 INFO:tasks.workunit.client.0.smithi067.stdout:9/979: truncate d3/d25/d5d/fc0 1302865 0 2024-01-17T23:51:00.361 INFO:tasks.workunit.client.0.smithi067.stdout:9/980: dread d3/d6/d2a/d34/d42/f6b [0,4194304] 0 2024-01-17T23:51:00.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/989: symlink d0/d7/d13/d2e/l13d 0 2024-01-17T23:51:00.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/990: read - d0/d7/d13/d77/d95/fa3 zero size 2024-01-17T23:51:01.132 INFO:tasks.workunit.client.0.smithi067.stdout:9/981: getdents d3/d6/d2e 0 2024-01-17T23:51:01.175 INFO:tasks.workunit.client.0.smithi067.stdout:9/982: dwrite d3/d6/d11/d50/fcd [0,4194304] 0 2024-01-17T23:51:01.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/991: mkdir d0/d7/d13/d77/d95/d104/d13e 0 2024-01-17T23:51:01.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/992: write d0/d7/d13/d3d/f100 [434826,54182] 0 2024-01-17T23:51:01.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/993: truncate d0/d7/d13/d3d/dd0/f132 864503 0 2024-01-17T23:51:01.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/994: chown d0/d7/f29 2 1 2024-01-17T23:51:01.464 INFO:tasks.workunit.client.0.smithi067.stdout:1/995: dwrite d0/d7/d7f/f91 [0,4194304] 0 2024-01-17T23:51:01.496 INFO:tasks.workunit.client.0.smithi067.stdout:1/996: dwrite d0/d7/d13/d77/f109 [0,4194304] 0 2024-01-17T23:51:01.671 INFO:tasks.workunit.client.0.smithi067.stdout:7/998: creat d4/d25/d39/f138 x:0 0 0 2024-01-17T23:51:02.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/997: mkdir d0/d7/d13/d3d/d48/d126/d13a/d13f 0 2024-01-17T23:51:02.307 INFO:tasks.workunit.client.0.smithi067.stdout:1/998: write d0/d7/d13/d3d/f100 [264925,15350] 0 2024-01-17T23:51:02.308 INFO:tasks.workunit.client.0.smithi067.stdout:1/999: chown d0/d7/d7f/d82/c6c 3794543 1 2024-01-17T23:51:02.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/999: unlink d4/d25/d39/d46/d78/d93/d94/dc4/d40/l12b 0 2024-01-17T23:51:02.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/985: rename d3/d8/d35/la1 to d3/d26/d34/d3a/d9f/l145 0 2024-01-17T23:51:02.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/986: truncate d3/d4e/dee/da6/fb9 4573828 0 2024-01-17T23:51:02.777 INFO:tasks.workunit.client.0.smithi067.stdout:4/987: creat d3/d4e/dee/d20/d52/f146 x:0 0 0 2024-01-17T23:51:02.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/988: dread d3/d26/d34/d3a/f47 [0,4194304] 0 2024-01-17T23:51:03.128 INFO:tasks.workunit.client.0.smithi067.stdout:4/989: mkdir d3/db8/d147 0 2024-01-17T23:51:03.226 INFO:tasks.workunit.client.0.smithi067.stdout:4/990: symlink d3/d4e/dee/d20/d52/l148 0 2024-01-17T23:51:03.226 INFO:tasks.workunit.client.0.smithi067.stdout:4/991: write d3/d4e/dee/d38/dab/ffb [982390,61915] 0 2024-01-17T23:51:03.227 INFO:tasks.workunit.client.0.smithi067.stdout:4/992: read - d3/d40/f73 zero size 2024-01-17T23:51:03.743 INFO:tasks.workunit.client.0.smithi067.stdout:9/983: write d3/d6/d11/d50/f11e [1263769,86929] 0 2024-01-17T23:51:03.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/997: sync 2024-01-17T23:51:03.745 INFO:tasks.workunit.client.0.smithi067.stdout:5/934: sync 2024-01-17T23:51:03.745 INFO:tasks.workunit.client.0.smithi067.stdout:5/935: truncate d10/d24/d25/d5c/d107/f12e 182270 0 2024-01-17T23:51:03.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/998: write d5/d1f/d2a/d54/d8/d32/d33/f14f [1386279,102695] 0 2024-01-17T23:51:04.063 INFO:tasks.workunit.client.0.smithi067.stdout:4/993: link d3/d4e/dee/df8/f108 d3/d26/d34/d3a/f149 0 2024-01-17T23:51:04.070 INFO:tasks.workunit.client.0.smithi067.stdout:5/936: dread d10/d24/d25/d5c/d107/f5b [0,4194304] 0 2024-01-17T23:51:04.085 INFO:tasks.workunit.client.0.smithi067.stdout:5/937: read d10/d24/d25/d5c/d107/d4a/d50/fab [2624332,2064] 0 2024-01-17T23:51:04.128 INFO:tasks.workunit.client.0.smithi067.stdout:2/999: mknod d5/d1f/d2a/d54/d8/d32/d33/c156 0 2024-01-17T23:51:04.826 INFO:tasks.workunit.client.0.smithi067.stdout:5/938: creat d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/dff/f134 x:0 0 0 2024-01-17T23:51:04.826 INFO:tasks.workunit.client.0.smithi067.stdout:5/939: chown d10/d24/d25/d5c/d107/d4a 0 1 2024-01-17T23:51:04.859 INFO:tasks.workunit.client.0.smithi067.stdout:5/940: dread d10/f1c [0,4194304] 0 2024-01-17T23:51:04.867 INFO:tasks.workunit.client.0.smithi067.stdout:9/984: dwrite d3/d6/d2a/da2/de2/dd0/fc3 [0,4194304] 0 2024-01-17T23:51:05.172 INFO:tasks.workunit.client.0.smithi067.stdout:4/994: rmdir d3/d4e/dee/dc7 39 2024-01-17T23:51:05.265 INFO:tasks.workunit.client.0.smithi067.stdout:5/941: getdents d10/d24/d59/d8c 0 2024-01-17T23:51:05.299 INFO:tasks.workunit.client.0.smithi067.stdout:5/942: dwrite d10/d24/d25/d5c/fcb [0,4194304] 0 2024-01-17T23:51:06.773 INFO:tasks.workunit.client.0.smithi067.stdout:4/995: creat d3/d8/f14a x:0 0 0 2024-01-17T23:51:07.044 INFO:tasks.workunit.client.0.smithi067.stdout:5/943: truncate d10/d24/d59/d8c/dae/fb0 3619708 0 2024-01-17T23:51:07.045 INFO:tasks.workunit.client.0.smithi067.stdout:5/944: truncate d10/d24/d59/d5d/dce/d10d/ff8 5151081 0 2024-01-17T23:51:07.045 INFO:tasks.workunit.client.0.smithi067.stdout:5/945: readlink d10/d24/db4/ldc 0 2024-01-17T23:51:07.045 INFO:tasks.workunit.client.0.smithi067.stdout:5/946: fdatasync d10/d24/d59/d5d/fa8 0 2024-01-17T23:51:07.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/996: creat d3/f14b x:0 0 0 2024-01-17T23:51:07.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/985: sync 2024-01-17T23:51:07.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/986: truncate d3/d6/d2a/d34/f12e 564193 0 2024-01-17T23:51:07.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/987: creat d3/d6/d2a/f15c x:0 0 0 2024-01-17T23:51:07.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/988: creat d3/d6/d2a/da2/dbd/f15d x:0 0 0 2024-01-17T23:51:07.604 INFO:tasks.workunit.client.0.smithi067.stdout:4/997: dread d3/d8/fa4 [4194304,4194304] 0 2024-01-17T23:51:07.604 INFO:tasks.workunit.client.0.smithi067.stdout:4/998: chown d3/d5/l32 13879 1 2024-01-17T23:51:07.942 INFO:tasks.workunit.client.0.smithi067.stdout:5/947: sync 2024-01-17T23:51:07.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/989: rename d3/d25/d5d/f131 to d3/d6/d10/dfe/f15e 0 2024-01-17T23:51:07.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/990: creat d3/d6/d47/d10a/d123/d13e/f15f x:0 0 0 2024-01-17T23:51:07.969 INFO:tasks.workunit.client.0.smithi067.stdout:5/948: dwrite d10/d24/d59/fb3 [0,4194304] 0 2024-01-17T23:51:08.079 INFO:tasks.workunit.client.0.smithi067.stdout:4/999: mkdir d3/d26/d34/d3a/d14c 0 2024-01-17T23:51:08.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/991: dwrite d3/d6/d47/d88/f10e [0,4194304] 0 2024-01-17T23:51:08.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/992: dread - d3/d6/d11/d5c/f14e zero size 2024-01-17T23:51:08.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/993: dwrite d3/d6/da4/d55/f7b [0,4194304] 0 2024-01-17T23:51:08.402 INFO:tasks.workunit.client.0.smithi067.stdout:5/949: symlink d10/d24/d59/d8c/dae/l135 0 2024-01-17T23:51:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/994: mknod d3/da/dd5/c160 0 2024-01-17T23:51:08.711 INFO:tasks.workunit.client.0.smithi067.stdout:5/950: mknod d10/d24/d25/d5c/d107/d4a/c136 0 2024-01-17T23:51:08.885 INFO:tasks.workunit.client.0.smithi067.stdout:9/995: creat d3/d6/d2e/d102/f161 x:0 0 0 2024-01-17T23:51:08.885 INFO:tasks.workunit.client.0.smithi067.stdout:9/996: truncate d3/d6/d2a/da2/dbd/f15d 745848 0 2024-01-17T23:51:08.885 INFO:tasks.workunit.client.0.smithi067.stdout:9/997: dread - d3/d6/d11/d5c/f14e zero size 2024-01-17T23:51:09.027 INFO:tasks.workunit.client.0.smithi067.stdout:5/951: mkdir d10/d53/da4/dc6/d137 0 2024-01-17T23:51:09.060 INFO:tasks.workunit.client.0.smithi067.stdout:5/952: dwrite d10/d24/d59/d8c/fb6 [0,4194304] 0 2024-01-17T23:51:09.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/953: dread d10/d24/d25/d5c/d107/d4a/d63/ff2 [0,4194304] 0 2024-01-17T23:51:09.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/954: dread d10/d24/d25/d5c/d107/d4a/d50/f89 [0,4194304] 0 2024-01-17T23:51:09.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/998: creat d3/d58/f162 x:0 0 0 2024-01-17T23:51:09.132 INFO:tasks.workunit.client.0.smithi067.stdout:9/999: dread d3/d6/da4/d55/f7b [0,4194304] 0 2024-01-17T23:51:09.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/955: read d10/d24/d25/d5c/d107/fb9 [71694,70978] 0 2024-01-17T23:51:09.753 INFO:tasks.workunit.client.0.smithi067.stdout:5/956: creat d10/d24/d59/d5d/f138 x:0 0 0 2024-01-17T23:51:10.126 INFO:tasks.workunit.client.0.smithi067.stdout:5/957: unlink d10/d24/d25/d5c/d107/d4a/d4b/c104 0 2024-01-17T23:51:10.378 INFO:tasks.workunit.client.0.smithi067.stdout:5/958: unlink d10/d24/d59/d8c/dba/ld8 0 2024-01-17T23:51:10.477 INFO:tasks.workunit.client.0.smithi067.stdout:5/959: creat d10/d24/d25/d5c/d7e/d126/f139 x:0 0 0 2024-01-17T23:51:10.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/960: unlink d10/d24/d59/l12c 0 2024-01-17T23:51:10.658 INFO:tasks.workunit.client.0.smithi067.stdout:5/961: stat d10/d24/d59/d8c/fb6 0 2024-01-17T23:51:10.704 INFO:tasks.workunit.client.0.smithi067.stdout:5/962: rmdir d10/d24/d59/d8c 39 2024-01-17T23:51:10.757 INFO:tasks.workunit.client.0.smithi067.stdout:5/963: creat d10/d24/d25/f13a x:0 0 0 2024-01-17T23:51:10.782 INFO:tasks.workunit.client.0.smithi067.stdout:5/964: dwrite d10/d24/d25/d5c/d107/d4a/d50/fab [4194304,4194304] 0 2024-01-17T23:51:10.782 INFO:tasks.workunit.client.0.smithi067.stdout:5/965: chown d10/d24/d25/d5c/d7e/d7f/f98 254061 1 2024-01-17T23:51:10.782 INFO:tasks.workunit.client.0.smithi067.stdout:5/966: stat d10/d24/d25/d5c/d107/d4a/fa1 0 2024-01-17T23:51:10.838 INFO:tasks.workunit.client.0.smithi067.stdout:5/967: creat d10/d24/d25/d5c/d7e/d7f/f13b x:0 0 0 2024-01-17T23:51:10.838 INFO:tasks.workunit.client.0.smithi067.stdout:5/968: readlink d10/d24/d59/d5d/lbb 0 2024-01-17T23:51:11.115 INFO:tasks.workunit.client.0.smithi067.stdout:5/969: write d10/d24/d59/d5d/fc5 [1593436,15294] 0 2024-01-17T23:51:11.203 INFO:tasks.workunit.client.0.smithi067.stdout:5/970: mkdir d10/d24/d25/dd5/d13c 0 2024-01-17T23:51:11.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/971: link d10/d24/d25/d5c/d107/d4a/d4b/l75 d10/d24/l13d 0 2024-01-17T23:51:11.300 INFO:tasks.workunit.client.0.smithi067.stdout:5/972: dread d10/d53/fe3 [0,4194304] 0 2024-01-17T23:51:11.621 INFO:tasks.workunit.client.0.smithi067.stdout:5/973: sync 2024-01-17T23:51:11.670 INFO:tasks.workunit.client.0.smithi067.stdout:5/974: dread d10/d24/d59/d8c/dae/fb0 [0,4194304] 0 2024-01-17T23:51:11.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/975: mknod d10/d24/d59/d5d/c13e 0 2024-01-17T23:51:11.707 INFO:tasks.workunit.client.0.smithi067.stdout:5/976: dread d10/d24/d25/d5c/fcd [0,4194304] 0 2024-01-17T23:51:11.773 INFO:tasks.workunit.client.0.smithi067.stdout:5/977: creat d10/d24/db4/f13f x:0 0 0 2024-01-17T23:51:11.773 INFO:tasks.workunit.client.0.smithi067.stdout:5/978: chown d10/d24/d25/dd5/l11b 8390 1 2024-01-17T23:51:11.825 INFO:tasks.workunit.client.0.smithi067.stdout:5/979: unlink d10/d24/d25/d5c/d107/d4a/d63/d85/f11d 0 2024-01-17T23:51:11.843 INFO:tasks.workunit.client.0.smithi067.stdout:5/980: dread d10/d24/d59/d8c/fb6 [0,4194304] 0 2024-01-17T23:51:11.843 INFO:tasks.workunit.client.0.smithi067.stdout:5/981: write d10/d24/d25/d5c/d107/d4a/d50/fab [8685735,26640] 0 2024-01-17T23:51:11.843 INFO:tasks.workunit.client.0.smithi067.stdout:5/982: read - d10/d24/d25/d5c/d107/d4a/d4b/da9/d102/dff/f134 zero size 2024-01-17T23:51:11.843 INFO:tasks.workunit.client.0.smithi067.stdout:5/983: creat d10/d24/d25/d5c/d7e/f140 x:0 0 0 2024-01-17T23:51:11.929 INFO:tasks.workunit.client.0.smithi067.stdout:5/984: symlink d10/d24/d25/dd5/d13c/l141 0 2024-01-17T23:51:11.929 INFO:tasks.workunit.client.0.smithi067.stdout:5/985: write d10/d24/d25/d5c/fcd [426903,100332] 0 2024-01-17T23:51:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:5/986: creat d10/d24/d25/d5c/d107/d4a/d4b/f142 x:0 0 0 2024-01-17T23:51:12.011 INFO:tasks.workunit.client.0.smithi067.stdout:5/987: dwrite d10/d24/d25/d5c/d107/d4a/f57 [4194304,4194304] 0 2024-01-17T23:51:12.180 INFO:tasks.workunit.client.0.smithi067.stdout:5/988: getdents d10/d24/db4 0 2024-01-17T23:51:12.320 INFO:tasks.workunit.client.0.smithi067.stdout:5/989: write d10/d24/d59/d5d/f95 [1253429,43800] 0 2024-01-17T23:51:12.320 INFO:tasks.workunit.client.0.smithi067.stdout:5/990: write d10/d24/d59/d5d/dce/d10d/ffb [139548,74747] 0 2024-01-17T23:51:12.351 INFO:tasks.workunit.client.0.smithi067.stdout:5/991: dwrite d10/d24/d59/d5d/dce/f12a [0,4194304] 0 2024-01-17T23:51:12.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/992: rename d10/d24/d25/d5c/d107/d4a/fd7 to d10/d53/da4/f143 0 2024-01-17T23:51:12.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/993: chown d10/f112 171 1 2024-01-17T23:51:12.687 INFO:tasks.workunit.client.0.smithi067.stdout:5/994: rename d10/d24/d25/d5c/d107/d4a/d50/c64 to d10/d24/d25/c144 0 2024-01-17T23:51:12.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/995: mknod d10/d24/d25/d5c/d107/d4a/c145 0 2024-01-17T23:51:12.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/996: fsync d10/d24/d59/d8c/fb6 0 2024-01-17T23:51:12.786 INFO:tasks.workunit.client.0.smithi067.stdout:5/997: dread d10/f88 [0,4194304] 0 2024-01-17T23:51:12.786 INFO:tasks.workunit.client.0.smithi067.stdout:5/998: fdatasync d10/d53/fd0 0 2024-01-17T23:51:12.786 INFO:tasks.workunit.client.0.smithi067.stdout:5/999: creat d10/d24/d59/d8c/dba/df3/f146 x:0 0 0 2024-01-17T23:51:12.865 INFO:tasks.workunit.client.0.smithi067.stderr:+ rm -rf -- ./tmp.Xi9umTeGb6 2024-01-17T23:51:15.706 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:15.710 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:45.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:51:45.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:16.013 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:16.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:46.096 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:52:46.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:16.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:16.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:46.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:53:46.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:08.097 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:54:56.315 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.102 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:54:56.321 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.135 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:54:56.448 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.135 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:54:56.448 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.151 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:54:56.463 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.157 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:54:56.470 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.202 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:54:56.420 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.316 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:54:56.629 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:08.329 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:54:56.642 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:54:16.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:16.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:46.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:54:46.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:16.813 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:16.817 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:46.889 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:55:46.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:17.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:17.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:47.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:47.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:56:53.513 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:57:41.732 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.520 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:57:41.738 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.606 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:57:41.825 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.635 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:57:41.948 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.645 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:57:41.958 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.646 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:57:41.959 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.695 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:57:42.008 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.761 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:57:42.074 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:56:53.831 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:57:42.144 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:17.224 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:17.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:18.149 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:58:06.367 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.154 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:58:06.372 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.186 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:58:06.404 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.188 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:58:06.501 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.188 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:58:06.501 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.197 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:58:06.510 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.202 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:58:06.515 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.287 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:58:06.599 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:18.289 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:58:06.602 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:57:47.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:57:47.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:17.585 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:17.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:44.045 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:59:32.264 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.052 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:59:32.270 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.097 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:00:59:32.316 27348== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.172 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:59:32.485 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.178 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:59:32.491 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.187 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:59:32.500 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.195 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:59:32.508 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.251 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:00:59:32.564 27836== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:44.256 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:00:59:32.569 27837== Warning: unimplemented fcntl command: 1036 2024-01-17T23:58:47.656 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:58:47.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:17.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:17.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:47.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-17T23:59:47.912 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:02.765 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-18T00:00:02.764+0000 7f563900d640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32308) UID: 0 2024-01-18T00:00:02.765 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-18T00:00:02.764+0000 7f7614782640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32308) UID: 0 2024-01-18T00:00:02.766 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-18T00:00:02.764+0000 7fdfc0c07640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32308) UID: 0 2024-01-18T00:00:02.766 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-18T00:00:02.764+0000 7f8a59f5f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32308) UID: 0 2024-01-18T00:00:02.766 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-18T00:00:02.764+0000 7fed77133640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 32308) UID: 0 2024-01-18T00:00:02.773 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.768+0000 a369640 -1 Fail to open '/proc/32308/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.774 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-01-18T00:00:02.768+0000 b9ce640 -1 Fail to open '/proc/32308/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.774 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.768+0000 a369640 -1 received signal: Hangup from (PID: 32308) UID: 0 2024-01-18T00:00:02.774 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.768+0000 a369640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:02.775 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-01-18T00:00:02.768+0000 b9ce640 -1 Fail to open '/proc/32308/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.775 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-01-18T00:00:02.768+0000 b9ce640 -1 received signal: Hangup from (PID: 32308) UID: 0 2024-01-18T00:00:02.776 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.768+0000 a369640 -1 Fail to open '/proc/32308/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.777 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.768+0000 a369640 -1 received signal: Hangup from (PID: 32308) UID: 0 2024-01-18T00:00:02.777 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-01-18T00:00:02.768+0000 b9ce640 -1 received signal: Hangup from (PID: 32308) UID: 0 2024-01-18T00:00:02.777 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.772+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:02.785 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-18T00:00:02.776+0000 b9ce640 -1 Fail to open '/proc/32308/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.785 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-18T00:00:02.784+0000 7f7614782640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.786 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-18T00:00:02.784+0000 7fdfc0c07640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.786 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-01-18T00:00:02.784+0000 7f563900d640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.786 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-18T00:00:02.784+0000 7fed77133640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.787 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-18T00:00:02.780+0000 b9ce640 -1 received signal: Hangup from (PID: 32308) UID: 0 2024-01-18T00:00:02.787 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-18T00:00:02.784+0000 7f8a59f5f640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.788 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 Fail to read '/proc/32309/cmdline' error = (3) No such process 2024-01-18T00:00:02.788 INFO:tasks.ceph.mds.b.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.788 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 Fail to read '/proc/32309/cmdline' error = (3) No such process 2024-01-18T00:00:02.788 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.788 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:02.789 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 Fail to read '/proc/32309/cmdline' error = (3) No such process 2024-01-18T00:00:02.789 INFO:tasks.ceph.mds.d.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.789 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 Fail to read '/proc/32309/cmdline' error = (3) No such process 2024-01-18T00:00:02.789 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:02.790 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:00:02.788+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2024-01-18T00:00:02.790 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 Fail to open '/proc/32309/cmdline' error = (2) No such file or directory 2024-01-18T00:00:02.790 INFO:tasks.ceph.mds.f.smithi137.stderr:2024-01-18T00:00:02.788+0000 b9ce640 -1 received signal: Hangup from (PID: 32309) UID: 0 2024-01-18T00:00:13.218 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-18T00:00:13.218+0000 7ff8b0e00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34809) UID: 0 2024-01-18T00:00:13.219 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-18T00:00:13.218+0000 7f45de800640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34809) UID: 0 2024-01-18T00:00:13.219 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-18T00:00:13.218+0000 7f12a5400640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34809) UID: 0 2024-01-18T00:00:13.220 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-18T00:00:13.218+0000 7f4f2d200640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34809) UID: 0 2024-01-18T00:00:13.220 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-18T00:00:13.218+0000 7f8ef0e00640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 34809) UID: 0 2024-01-18T00:00:13.229 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 Fail to open '/proc/34809/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.229 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 Fail to open '/proc/34809/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.229 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 received signal: Hangup from (PID: 34809) UID: 0 2024-01-18T00:00:13.230 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 Fail to open '/proc/34809/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.230 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 received signal: Hangup from (PID: 34809) UID: 0 2024-01-18T00:00:13.230 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:00:13.222+0000 b9ce640 -1 received signal: Hangup from (PID: 34809) UID: 0 2024-01-18T00:00:13.251 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-18T00:00:13.250+0000 7f4f2d200640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.251 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-18T00:00:13.250+0000 7f45de800640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.251 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-18T00:00:13.250+0000 7f12a5400640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.252 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-01-18T00:00:13.250+0000 7ff8b0e00640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.252 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-18T00:00:13.250+0000 7f8ef0e00640 -1 Fail to open '/proc/34814/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.252 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-18T00:00:13.250+0000 7f8ef0e00640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.252 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 Fail to open '/proc/34814/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.253 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.253 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 Fail to read '/proc/34814/cmdline' error = (3) No such process 2024-01-18T00:00:13.253 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 Fail to read '/proc/34814/cmdline' error = (3) No such process 2024-01-18T00:00:13.253 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.254 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:00:13.250+0000 b9ce640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.256 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.246+0000 a369640 -1 Fail to open '/proc/34809/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.258 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.250+0000 a369640 -1 received signal: Hangup from (PID: 34809) UID: 0 2024-01-18T00:00:13.258 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.250+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-01-18T00:00:13.259 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.258+0000 a369640 -1 Fail to open '/proc/34814/cmdline' error = (2) No such file or directory 2024-01-18T00:00:13.259 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.258+0000 a369640 -1 received signal: Hangup from (PID: 34814) UID: 0 2024-01-18T00:00:13.260 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:00:13.258+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2024-01-18T00:00:18.003 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:18.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-18T00:00:18.021 INFO:teuthology.orchestra.run.smithi137.stderr:error: state file /var/lib/logrotate/status is already locked 2024-01-18T00:00:18.022 INFO:teuthology.orchestra.run.smithi137.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-01-18T00:00:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:error: state file /var/lib/logrotate/status is already locked 2024-01-18T00:00:18.023 INFO:teuthology.orchestra.run.smithi067.stderr:logrotate does not support parallel execution on the same set of logfiles. 2024-01-18T00:00:18.024 DEBUG:teuthology.orchestra.run:got remote process result: 3 2024-01-18T00:00:18.025 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:00:57.084 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:01:45.301 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.087 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:01:45.305 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.121 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:01:45.434 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.121 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:01:45.434 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.126 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:01:45.439 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.127 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:01:45.440 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.153 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:01:45.371 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.225 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:01:45.538 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:00:57.255 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:01:45.568 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.024 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:12.242 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.027 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:12.245 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.060 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:12.373 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.062 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:12.375 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.068 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:12.381 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.070 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:12.383 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.128 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:12.347 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.205 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:12.517 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:04:24.212 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:12.525 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.744 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:55.962 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.749 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:55.967 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.786 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:05:56.004 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.882 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:56.195 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.889 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:56.202 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.890 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:56.203 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.907 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:56.219 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.945 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:05:56.258 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:05:07.961 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:05:56.273 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.192 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:16.409 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.195 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:16.413 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.250 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:16.468 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.306 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:16.618 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.313 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:16.625 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.317 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:16.629 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.318 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:16.630 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.409 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:16.721 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:28.417 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:16.730 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.689 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:38.907 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.692 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:38.911 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.718 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:39.030 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.719 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:39.031 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.723 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:39.035 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.726 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:08:38.944 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.726 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:39.038 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.771 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:08:39.083 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:07:50.779 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:08:39.092 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:08:40.978 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-18T00:08:40.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-18T00:11:18.160 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:12:06.377 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.163 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:12:06.381 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.193 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:12:06.505 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.196 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:12:06.508 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.201 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:12:06.513 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.203 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:12:06.515 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.259 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:12:06.478 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.333 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:12:06.645 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:11:18.343 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:12:06.654 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.259 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:14:17.476 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.259 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:14:17.478 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.322 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:14:17.540 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.380 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:14:17.692 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.382 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:14:17.693 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.385 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:14:17.696 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.386 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:14:17.698 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.486 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:14:17.797 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:13:29.512 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:14:17.824 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.531 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:15:33.749 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.536 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:15:33.754 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.566 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:15:33.878 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.573 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:15:33.885 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.575 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:15:33.887 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.583 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:15:33.895 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.587 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:15:33.805 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.682 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:15:33.993 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:14:45.731 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:15:34.043 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.728 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:16:37.946 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.729 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:16:37.947 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.766 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:16:37.985 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.861 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:16:38.173 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.865 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:16:38.176 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.866 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:16:38.178 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.870 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:16:38.182 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.902 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:16:38.214 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:15:49.961 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:16:38.272 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.393 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:18:59.611 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.397 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:18:59.616 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.438 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:18:59.747 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.439 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:18:59.749 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.442 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:18:59.754 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.445 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:18:59.757 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.473 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:18:59.692 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.555 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:18:59.867 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:18:11.576 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:18:59.888 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:38.997 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:27.215 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.002 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:27.220 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.024 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:27.336 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.033 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:27.345 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.037 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:27.348 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.042 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:27.354 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.102 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:27.321 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.181 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:27.492 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:39.208 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:27.519 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.750 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:38.969 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.755 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:38.973 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.779 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:22:38.998 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.895 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:39.206 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.897 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:39.209 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.898 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:39.210 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.900 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:39.211 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.920 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:22:39.231 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:21:50.924 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:22:39.236 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.216 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:24:59.434 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.218 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:24:59.437 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.270 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:24:59.488 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.334 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:24:59.646 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.337 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:24:59.649 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.353 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:24:59.665 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.357 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:24:59.668 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.404 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:24:59.716 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:24:11.469 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:24:59.781 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.803 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:25:53.021 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.805 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:25:53.024 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.838 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:25:53.149 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.838 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:25:53.150 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.843 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:25:53.155 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.845 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:25:53.157 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.847 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:25:53.066 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.899 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:25:53.211 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:25:04.932 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:25:53.243 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.183 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:29:19.401 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.188 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:29:19.407 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.212 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:29:19.523 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.212 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:29:19.524 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.217 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:29:19.529 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.220 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:29:19.532 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.292 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:29:19.511 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.333 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:29:19.645 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:28:31.351 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:29:19.663 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.298 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:31:00.516 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.305 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:31:00.523 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.392 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:31:00.611 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.438 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:31:00.750 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.439 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:31:00.751 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.451 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:31:00.763 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.465 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:31:00.776 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.510 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:31:00.821 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:30:12.545 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:31:00.857 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.694 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:32:45.912 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.698 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:32:45.917 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.729 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:32:46.040 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.729 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:32:46.041 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.733 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:32:46.045 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.734 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:32:46.046 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.761 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:32:45.980 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.807 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:32:46.119 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:31:57.807 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:32:46.119 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.715 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:33:20.933 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.720 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:33:20.939 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.749 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:33:20.967 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.833 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:33:21.144 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.834 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:33:21.145 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.836 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:33:21.148 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.836 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:33:21.148 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.871 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:33:21.183 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:32:32.873 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:33:21.185 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.764 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:36:12.982 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.768 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:36:12.987 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.794 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:36:13.106 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.798 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:36:13.109 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.798 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:36:13.110 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.803 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:36:13.115 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.856 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:36:13.075 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.913 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:36:13.225 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:35:24.927 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:36:13.239 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.741 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:21.959 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.743 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:21.962 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.831 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:22.050 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.839 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:22.150 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.842 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:22.153 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.866 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:22.177 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.868 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:22.179 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.935 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:22.246 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:33.987 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:22.298 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.032 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:39.251 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.036 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:39.255 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.065 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:39:39.283 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.066 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:39.377 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.066 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:39.378 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.071 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:39.382 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.072 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:39.383 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.098 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:39:39.409 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:38:51.109 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:39:39.420 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.218 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:41:42.435 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.219 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:41:42.437 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.265 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:41:42.484 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.339 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:41:42.650 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.342 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:41:42.653 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.343 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:41:42.654 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.347 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:41:42.658 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.447 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:41:42.757 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:40:54.453 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:41:42.764 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.869 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:43:05.087 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.871 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:43:05.090 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.893 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:43:05.204 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.895 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:43:05.206 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.900 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:43:05.211 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.904 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:43:05.215 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.924 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:43:05.143 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:16.977 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:43:05.288 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:42:17.008 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:43:05.319 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:44.973 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:46:33.191 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:44.976 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:46:33.195 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.011 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:46:33.322 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.012 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:46:33.322 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.017 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:46:33.328 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.031 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:46:33.342 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.072 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:46:33.291 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.167 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:46:33.478 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:45:45.271 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:46:33.582 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.223 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:47:43.442 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.224 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:47:43.443 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.266 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:47:43.485 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.342 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:47:43.652 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.347 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:47:43.657 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.348 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:47:43.659 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.350 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:47:43.661 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.413 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:47:43.724 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:46:55.421 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:47:43.731 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:48:27.675 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-01-18T00:48:27.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-18T00:48:28.573 DEBUG:teuthology.parallel:result is None 2024-01-18T00:48:28.573 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-18T00:48:29.061 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-18T00:48:29.062 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-18T00:48:29.073 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-18T00:48:29.073 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-18T00:48:29.073 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-18T00:48:29.082 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-01-18T00:48:29.082 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-18T00:48:29.132 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:48:29.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.313+0000 7fc43b200640 1 Processor -- start 2024-01-18T00:48:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 -- start start 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc434072300 0x7fc434072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc434157bc0 0x7fc434157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43415b9c0 con 0x7fc4341517a0 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc434158510 con 0x7fc434157bc0 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc43b200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43415ae40 con 0x7fc434072300 2024-01-18T00:48:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc439200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc434157bc0 0x7fc434157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc439200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc434157bc0 0x7fc434157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56976/0 (socket says 172.21.15.67:56976) 2024-01-18T00:48:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc439200640 1 -- 172.21.15.67:0/2110724881 learned_addr learned my addr 172.21.15.67:0/2110724881 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.317+0000 7fc433400640 1 --2- 172.21.15.67:0/2110724881 >> v2:172.21.15.137:3300/0 conn(0x7fc434072300 0x7fc434072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.321+0000 7fc439200640 1 -- 172.21.15.67:0/2110724881 >> v2:172.21.15.137:3300/0 conn(0x7fc434072300 msgr2=0x7fc434072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.321+0000 7fc439200640 1 --2- 172.21.15.67:0/2110724881 >> v2:172.21.15.137:3300/0 conn(0x7fc434072300 0x7fc434072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.321+0000 7fc439200640 1 -- 172.21.15.67:0/2110724881 >> v1:172.21.15.137:6789/0 conn(0x7fc4341517a0 legacy=0x7fc43406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.321+0000 7fc439200640 1 -- 172.21.15.67:0/2110724881 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43415b120 con 0x7fc434157bc0 2024-01-18T00:48:29.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.325+0000 7fc439200640 1 --2- 172.21.15.67:0/2110724881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc434157fd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc43406ca60 tx=0x7fc42c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3a7beb0a69bfd server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc432a00640 1 -- 172.21.15.67:0/2110724881 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0a5820 con 0x7fc434157bc0 2024-01-18T00:48:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc432a00640 1 -- 172.21.15.67:0/2110724881 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c0a5980 con 0x7fc434157bc0 2024-01-18T00:48:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc432a00640 1 -- 172.21.15.67:0/2110724881 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0a5d10 con 0x7fc434157bc0 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- 172.21.15.67:0/2110724881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 msgr2=0x7fc434157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 --2- 172.21.15.67:0/2110724881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc434157fd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc43406ca60 tx=0x7fc42c01c960 comp rx=0 tx=0).stop 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- 172.21.15.67:0/2110724881 shutdown_connections 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 --2- 172.21.15.67:0/2110724881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc434157fd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 --2- 172.21.15.67:0/2110724881 >> v2:172.21.15.137:3300/0 conn(0x7fc434072300 0x7fc434072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- 172.21.15.67:0/2110724881 >> 172.21.15.67:0/2110724881 conn(0x7fc4340cb070 msgr2=0x7fc4340cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:29.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- 172.21.15.67:0/2110724881 shutdown_connections 2024-01-18T00:48:29.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- 172.21.15.67:0/2110724881 wait complete. 2024-01-18T00:48:29.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 Processor -- start 2024-01-18T00:48:29.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.329+0000 7fc43b200640 1 -- start start 2024-01-18T00:48:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434072300 0x7fc434149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4341517a0 0x7fc4341f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341f3780 con 0x7fc434157bc0 2024-01-18T00:48:29.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43414b990 con 0x7fc434072300 2024-01-18T00:48:29.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc43b200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4341f39f0 con 0x7fc4341517a0 2024-01-18T00:48:29.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc439200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc439200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56990/0 (socket says 172.21.15.67:56990) 2024-01-18T00:48:29.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc439200640 1 -- 172.21.15.67:0/3186524096 learned_addr learned my addr 172.21.15.67:0/3186524096 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:29.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc433e00640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434072300 0x7fc434149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.333+0000 7fc433400640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4341517a0 0x7fc4341f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 -- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4341517a0 msgr2=0x7fc4341f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4341517a0 0x7fc4341f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 -- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434072300 msgr2=0x7fc434149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434072300 0x7fc434149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 -- 172.21.15.67:0/3186524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009b30 con 0x7fc434157bc0 2024-01-18T00:48:29.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.337+0000 7fc439200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0af040 tx=0x7fc42c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:29.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.341+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0b8670 con 0x7fc434157bc0 2024-01-18T00:48:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.341+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c0b87d0 con 0x7fc434157bc0 2024-01-18T00:48:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.341+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0b8b80 con 0x7fc434157bc0 2024-01-18T00:48:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.341+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43414f870 con 0x7fc434157bc0 2024-01-18T00:48:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.341+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc434150e10 con 0x7fc434157bc0 2024-01-18T00:48:29.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.345+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc434151000 con 0x7fc434157bc0 2024-01-18T00:48:29.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.365+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fc42c0b8ce0 con 0x7fc434157bc0 2024-01-18T00:48:29.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.365+0000 7fc42be00640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 0x7fc40c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.365+0000 7fc433e00640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 0x7fc40c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:29.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.365+0000 7fc433e00640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 0x7fc40c068d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098e0 tx=0x7fc424009060 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:29.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.613+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc42c0f0b10 con 0x7fc434157bc0 2024-01-18T00:48:29.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.613+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fc42c0ece50 con 0x7fc434157bc0 2024-01-18T00:48:29.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.773+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4340746a0 con 0x7fc434157bc0 2024-01-18T00:48:29.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.817+0000 7fc42be00640 1 -- 172.21.15.67:0/3186524096 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7fc42c0f0470 con 0x7fc434157bc0 2024-01-18T00:48:29.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:29.820 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:48:29.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 msgr2=0x7fc40c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 0x7fc40c068d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098e0 tx=0x7fc424009060 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 msgr2=0x7fc43414dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0af040 tx=0x7fc42c019700 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 shutdown_connections 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fc40c0668c0 0x7fc40c068d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc434157bc0 0x7fc43414dad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fc4341517a0 0x7fc4341f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 --2- 172.21.15.67:0/3186524096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434072300 0x7fc434149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 >> 172.21.15.67:0/3186524096 conn(0x7fc4340cb070 msgr2=0x7fc4340711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 shutdown_connections 2024-01-18T00:48:29.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.821+0000 7fc43b200640 1 -- 172.21.15.67:0/3186524096 wait complete. 2024-01-18T00:48:29.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-17T22:59:42.180289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-17T23:00:15.126108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-17T23:00:16.891955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-17T23:00:22.346907+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-18T00:48:29.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-18T00:48:29.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 Processor -- start 2024-01-18T00:48:29.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 -- start start 2024-01-18T00:48:29.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f770c153880 0x7f770c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f770c15ccb0 0x7f770c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:29.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c15a6c0 con 0x7f770c0c8780 2024-01-18T00:48:29.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c1596c0 con 0x7f770c153880 2024-01-18T00:48:29.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:29.989+0000 7f7714000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0ca520 con 0x7f770c15ccb0 2024-01-18T00:48:30.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.017+0000 7f7711600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f770c153880 0x7f770c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.017+0000 7f7710c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f770c0c8780 0x7f770c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:36470/0 (socket says 172.21.15.67:36470) 2024-01-18T00:48:30.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.017+0000 7f7710c00640 1 -- 172.21.15.67:0/4017909663 learned_addr learned my addr 172.21.15.67:0/4017909663 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:30.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.021+0000 7f7711600640 1 -- 172.21.15.67:0/4017909663 >> v2:172.21.15.137:3300/0 conn(0x7f770c15ccb0 msgr2=0x7f770c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:30.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.021+0000 7f7711600640 1 --2- 172.21.15.67:0/4017909663 >> v2:172.21.15.137:3300/0 conn(0x7f770c15ccb0 0x7f770c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.021+0000 7f7711600640 1 -- 172.21.15.67:0/4017909663 >> v1:172.21.15.67:6789/0 conn(0x7f770c0c8780 legacy=0x7f770c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.021+0000 7f7711600640 1 -- 172.21.15.67:0/4017909663 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c15d4f0 con 0x7f770c153880 2024-01-18T00:48:30.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.025+0000 7f7711600640 1 --2- 172.21.15.67:0/4017909663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c153880 0x7f770c15a180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f770c15a850 tx=0x7f76fc01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65dad7ea6dff28f server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.029+0000 7f770be00640 1 -- 172.21.15.67:0/4017909663 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0a8930 con 0x7f770c153880 2024-01-18T00:48:30.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.029+0000 7f770be00640 1 -- 172.21.15.67:0/4017909663 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0a8a90 con 0x7f770c153880 2024-01-18T00:48:30.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.029+0000 7f770be00640 1 -- 172.21.15.67:0/4017909663 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0a8e20 con 0x7f770c153880 2024-01-18T00:48:30.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.029+0000 7f7714000640 1 -- 172.21.15.67:0/4017909663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c153880 msgr2=0x7f770c15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.029+0000 7f7714000640 1 --2- 172.21.15.67:0/4017909663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c153880 0x7f770c15a180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f770c15a850 tx=0x7f76fc01ec30 comp rx=0 tx=0).stop 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- 172.21.15.67:0/4017909663 shutdown_connections 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 --2- 172.21.15.67:0/4017909663 >> v2:172.21.15.137:3300/0 conn(0x7f770c15ccb0 0x7f770c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 --2- 172.21.15.67:0/4017909663 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c153880 0x7f770c15a180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- 172.21.15.67:0/4017909663 >> 172.21.15.67:0/4017909663 conn(0x7f770c070390 msgr2=0x7f770c06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- 172.21.15.67:0/4017909663 shutdown_connections 2024-01-18T00:48:30.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- 172.21.15.67:0/4017909663 wait complete. 2024-01-18T00:48:30.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 Processor -- start 2024-01-18T00:48:30.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- start start 2024-01-18T00:48:30.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f770c153880 0x7f770c0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f770c15ccb0 0x7f770c1ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1ef4c0 con 0x7f770c0c8780 2024-01-18T00:48:30.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0b2210 con 0x7f770c153880 2024-01-18T00:48:30.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7714000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f2bb0 con 0x7f770c15ccb0 2024-01-18T00:48:30.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.033+0000 7f7711600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57006/0 (socket says 172.21.15.67:57006) 2024-01-18T00:48:30.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 -- 172.21.15.67:0/4140392379 learned_addr learned my addr 172.21.15.67:0/4140392379 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 -- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f770c15ccb0 msgr2=0x7f770c1ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f770c15ccb0 0x7f770c1ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 -- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f770c153880 msgr2=0x7f770c0cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f770c153880 0x7f770c0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.037+0000 7f7711600640 1 -- 172.21.15.67:0/4140392379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc009420 con 0x7f770c0c8780 2024-01-18T00:48:30.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.041+0000 7f7711600640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76fc01b840 tx=0x7f76fc01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0a88d0 con 0x7f770c0c8780 2024-01-18T00:48:30.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0b9410 con 0x7f770c0c8780 2024-01-18T00:48:30.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c1f2e90 con 0x7f770c0c8780 2024-01-18T00:48:30.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b97c0 con 0x7f770c0c8780 2024-01-18T00:48:30.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c1f3450 con 0x7f770c0c8780 2024-01-18T00:48:30.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.045+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0746a0 con 0x7f770c0c8780 2024-01-18T00:48:30.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.069+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f76fc0b7040 con 0x7f770c0c8780 2024-01-18T00:48:30.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.069+0000 7f7709600640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 0x7f76e4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.069+0000 7f7710c00640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 0x7f76e4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.069+0000 7f7710c00640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 0x7f76e4068d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f70 tx=0x7f76f4007a90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.317+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76fc0ae340 con 0x7f770c0c8780 2024-01-18T00:48:30.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.317+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f76fc0eff40 con 0x7f770c0c8780 2024-01-18T00:48:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.481+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f770c1570e0 con 0x7f770c0c8780 2024-01-18T00:48:30.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.485+0000 7f7709600640 1 -- 172.21.15.67:0/4140392379 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76fc0b5020 con 0x7f770c0c8780 2024-01-18T00:48:30.488 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-01-18T00:48:30.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 msgr2=0x7f76e4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 0x7f76e4068d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f70 tx=0x7f76f4007a90 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 msgr2=0x7f770c151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76fc01b840 tx=0x7f76fc01b9d0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 shutdown_connections 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f76e4066890 0x7f76e4068d50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f770c15ccb0 0x7f770c1ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f770c153880 0x7f770c0cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 --2- 172.21.15.67:0/4140392379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f770c0c8780 0x7f770c151a90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 >> 172.21.15.67:0/4140392379 conn(0x7f770c070390 msgr2=0x7f770c1581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 shutdown_connections 2024-01-18T00:48:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.489+0000 7f7714000640 1 -- 172.21.15.67:0/4140392379 wait complete. 2024-01-18T00:48:30.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-18T00:48:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.653+0000 7f6107800640 1 Processor -- start 2024-01-18T00:48:30.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.653+0000 7f6107800640 1 -- start start 2024-01-18T00:48:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.653+0000 7f6107800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f610015d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.657+0000 7f6107800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610015cc10 con 0x7f61001536c0 2024-01-18T00:48:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.657+0000 7f6107800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61000ca990 con 0x7f610015d8c0 2024-01-18T00:48:30.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.657+0000 7f6107800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610015cf60 con 0x7f6100159620 2024-01-18T00:48:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.657+0000 7f6105800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f610015d8c0 0x7f6100070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:40206/0 (socket says 172.21.15.67:40206) 2024-01-18T00:48:30.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.657+0000 7f6105800640 1 -- 172.21.15.67:0/165869301 learned_addr learned my addr 172.21.15.67:0/165869301 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.661+0000 7f60ffe00640 1 --2- 172.21.15.67:0/165869301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f610015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.661+0000 7f60ff400640 1 -- 172.21.15.67:0/165869301 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230568125 0 0) 0x7f61000ca990 con 0x7f610015d8c0 2024-01-18T00:48:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.661+0000 7f60ff400640 1 -- 172.21.15.67:0/165869301 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e0003530 con 0x7f610015d8c0 2024-01-18T00:48:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.669+0000 7f60ffe00640 1 -- 172.21.15.67:0/165869301 >> v1:172.21.15.137:6789/0 conn(0x7f610015d8c0 legacy=0x7f6100070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.669+0000 7f60ffe00640 1 -- 172.21.15.67:0/165869301 >> v1:172.21.15.67:6789/0 conn(0x7f61001536c0 legacy=0x7f61000ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.669+0000 7f60ffe00640 1 -- 172.21.15.67:0/165869301 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000c86f0 con 0x7f6100159620 2024-01-18T00:48:30.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.673+0000 7f60ffe00640 1 --2- 172.21.15.67:0/165869301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f610015d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097f0 tx=0x7f60e801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1241b87ee868a617 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f60ff400640 1 -- 172.21.15.67:0/165869301 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80ab650 con 0x7f6100159620 2024-01-18T00:48:30.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f60ff400640 1 -- 172.21.15.67:0/165869301 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e80ab7b0 con 0x7f6100159620 2024-01-18T00:48:30.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f60ff400640 1 -- 172.21.15.67:0/165869301 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80abb40 con 0x7f6100159620 2024-01-18T00:48:30.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 -- 172.21.15.67:0/165869301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 msgr2=0x7f610015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 --2- 172.21.15.67:0/165869301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f610015d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097f0 tx=0x7f60e801c450 comp rx=0 tx=0).stop 2024-01-18T00:48:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 -- 172.21.15.67:0/165869301 shutdown_connections 2024-01-18T00:48:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 --2- 172.21.15.67:0/165869301 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f610015d380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 -- 172.21.15.67:0/165869301 >> 172.21.15.67:0/165869301 conn(0x7f6100070390 msgr2=0x7f610006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 -- 172.21.15.67:0/165869301 shutdown_connections 2024-01-18T00:48:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.693+0000 7f6107800640 1 -- 172.21.15.67:0/165869301 wait complete. 2024-01-18T00:48:30.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 Processor -- start 2024-01-18T00:48:30.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 -- start start 2024-01-18T00:48:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f61000b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f610015d8c0 0x7f61000cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000cb290 con 0x7f61001536c0 2024-01-18T00:48:30.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100147a50 con 0x7f610015d8c0 2024-01-18T00:48:30.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6107800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6100147790 con 0x7f6100159620 2024-01-18T00:48:30.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6104e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6104e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36074/0 (socket says 172.21.15.67:36074) 2024-01-18T00:48:30.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6104e00640 1 -- 172.21.15.67:0/3916842782 learned_addr learned my addr 172.21.15.67:0/3916842782 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:30.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.697+0000 7f6105800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f610015d8c0 0x7f61000cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f60ffe00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f61000b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f6104e00640 1 -- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 msgr2=0x7f61000b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f6104e00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f61000b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f6104e00640 1 -- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f610015d8c0 msgr2=0x7f61000cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f6104e00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f610015d8c0 0x7f61000cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.701+0000 7f6104e00640 1 -- 172.21.15.67:0/3916842782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009420 con 0x7f61001536c0 2024-01-18T00:48:30.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.705+0000 7f6104e00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c4c0 tx=0x7f60f0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0005480 con 0x7f61001536c0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0003600 con 0x7f61001536c0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0003990 con 0x7f61001536c0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61000cafb0 con 0x7f61001536c0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6100148db0 con 0x7f61001536c0 2024-01-18T00:48:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.709+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6100148930 con 0x7f61001536c0 2024-01-18T00:48:30.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.729+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f60f001b3b0 con 0x7f61001536c0 2024-01-18T00:48:30.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.729+0000 7f60fcc00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 0x7f60d8068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:30.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.729+0000 7f60ffe00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 0x7f60d8068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:30.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.729+0000 7f60ffe00640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 0x7f60d8068d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f60e80af000 tx=0x7f60e80a7000 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:30.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.733+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60f0013e70 con 0x7f61001536c0 2024-01-18T00:48:30.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:30.981+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f60f0050c40 con 0x7f61001536c0 2024-01-18T00:48:31.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.141+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6100148930 con 0x7f61001536c0 2024-01-18T00:48:31.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.145+0000 7f60fcc00640 1 -- 172.21.15.67:0/3916842782 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6100148930 con 0x7f61001536c0 2024-01-18T00:48:31.148 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 msgr2=0x7f60d8068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 0x7f60d8068d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f60e80af000 tx=0x7f60e80a7000 comp rx=0 tx=0).stop 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 msgr2=0x7f61000cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60f000c4c0 tx=0x7f60f0001e80 comp rx=0 tx=0).stop 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 shutdown_connections 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f60d8066890 0x7f60d8068d50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f610015d8c0 0x7f61000cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6100159620 0x7f61000b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 --2- 172.21.15.67:0/3916842782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61001536c0 0x7f61000cc800 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 >> 172.21.15.67:0/3916842782 conn(0x7f6100070390 msgr2=0x7f61001518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:31.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 shutdown_connections 2024-01-18T00:48:31.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.149+0000 7f6107800640 1 -- 172.21.15.67:0/3916842782 wait complete. 2024-01-18T00:48:31.171 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-18T00:48:31.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 Processor -- start 2024-01-18T00:48:31.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 -- start start 2024-01-18T00:48:31.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27981506b0 0x7f27980c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2798156300 0x7f279806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980bffb0 con 0x7f27980c0c60 2024-01-18T00:48:31.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2798150a90 con 0x7f27981506b0 2024-01-18T00:48:31.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f279f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980b1130 con 0x7f2798156300 2024-01-18T00:48:31.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f2797e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27981506b0 0x7f27980c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f2797e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27981506b0 0x7f27980c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36076/0 (socket says 172.21.15.67:36076) 2024-01-18T00:48:31.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f2797e00640 1 -- 172.21.15.67:0/1565003147 learned_addr learned my addr 172.21.15.67:0/1565003147 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:31.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.317+0000 7f2797400640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2798156300 0x7f279806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.321+0000 7f2797e00640 1 -- 172.21.15.67:0/1565003147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2798156300 msgr2=0x7f279806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:31.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.321+0000 7f2797e00640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2798156300 0x7f279806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.321+0000 7f2797e00640 1 -- 172.21.15.67:0/1565003147 >> v1:172.21.15.137:6789/0 conn(0x7f27980c0c60 legacy=0x7f27980c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.321+0000 7f2797e00640 1 -- 172.21.15.67:0/1565003147 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27981567b0 con 0x7f27981506b0 2024-01-18T00:48:31.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.325+0000 7f2797e00640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27981506b0 0x7f27980c0720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f278800bb10 tx=0x7f278801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9767a20ecbe4ec2f server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:31.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f2796a00640 1 -- 172.21.15.67:0/1565003147 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880a7bb0 con 0x7f27981506b0 2024-01-18T00:48:31.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f2796a00640 1 -- 172.21.15.67:0/1565003147 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27880a7d10 con 0x7f27981506b0 2024-01-18T00:48:31.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f2796a00640 1 -- 172.21.15.67:0/1565003147 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880af660 con 0x7f27981506b0 2024-01-18T00:48:31.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 -- 172.21.15.67:0/1565003147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27981506b0 msgr2=0x7f27980c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27981506b0 0x7f27980c0720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f278800bb10 tx=0x7f278801ebe0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 -- 172.21.15.67:0/1565003147 shutdown_connections 2024-01-18T00:48:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2798156300 0x7f279806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 --2- 172.21.15.67:0/1565003147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27981506b0 0x7f27980c0720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 -- 172.21.15.67:0/1565003147 >> 172.21.15.67:0/1565003147 conn(0x7f27980c7a90 msgr2=0x7f27980c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 -- 172.21.15.67:0/1565003147 shutdown_connections 2024-01-18T00:48:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 -- 172.21.15.67:0/1565003147 wait complete. 2024-01-18T00:48:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.329+0000 7f279f200640 1 Processor -- start 2024-01-18T00:48:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 -- start start 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27981506b0 0x7f2798143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798156300 0x7f279814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27981f6470 con 0x7f27980c0c60 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798159160 con 0x7f2798156300 2024-01-18T00:48:31.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279815a7a0 con 0x7f27981506b0 2024-01-18T00:48:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f2797e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f2797e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36082/0 (socket says 172.21.15.67:36082) 2024-01-18T00:48:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f2797e00640 1 -- 172.21.15.67:0/3372063134 learned_addr learned my addr 172.21.15.67:0/3372063134 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f2797400640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27981506b0 0x7f2798143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.333+0000 7f279d200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798156300 0x7f279814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.337+0000 7f2797e00640 1 -- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27981506b0 msgr2=0x7f2798143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.337+0000 7f2797e00640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27981506b0 0x7f2798143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.337+0000 7f2797e00640 1 -- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798156300 msgr2=0x7f279814f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.337+0000 7f2797e00640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798156300 0x7f279814f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.337+0000 7f2797e00640 1 -- 172.21.15.67:0/3372063134 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278800b770 con 0x7f27980c0c60 2024-01-18T00:48:31.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.341+0000 7f2797e00640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f278801d290 tx=0x7f278801b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880afd90 con 0x7f27980c0c60 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27880b8420 con 0x7f27980c0c60 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880b87d0 con 0x7f27980c0c60 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279814f980 con 0x7f27980c0c60 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27981597c0 con 0x7f27980c0c60 2024-01-18T00:48:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.345+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27980746a0 con 0x7f27980c0c60 2024-01-18T00:48:31.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.365+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f27880b6070 con 0x7f27980c0c60 2024-01-18T00:48:31.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.365+0000 7f278fe00640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 0x7f2770068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.369+0000 7f2797400640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 0x7f2770068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.369+0000 7f2797400640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 0x7f2770068d50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f279814de70 tx=0x7f2780009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.617+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27880ef350 con 0x7f27980c0c60 2024-01-18T00:48:31.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.617+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f27880eb690 con 0x7f27980c0c60 2024-01-18T00:48:31.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.785+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27980c0840 con 0x7f27980c0c60 2024-01-18T00:48:31.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f278fe00640 1 -- 172.21.15.67:0/3372063134 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27880b40a0 con 0x7f27980c0c60 2024-01-18T00:48:31.793 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 msgr2=0x7f2770068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 0x7f2770068d50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f279814de70 tx=0x7f2780009190 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 msgr2=0x7f279815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f278801d290 tx=0x7f278801b980 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 shutdown_connections 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2770066890 0x7f2770068d50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798156300 0x7f279814f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27981506b0 0x7f2798143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 --2- 172.21.15.67:0/3372063134 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27980c0c60 0x7f279815a260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 >> 172.21.15.67:0/3372063134 conn(0x7f27980c7a90 msgr2=0x7f27980722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:31.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 shutdown_connections 2024-01-18T00:48:31.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.793+0000 7f279f200640 1 -- 172.21.15.67:0/3372063134 wait complete. 2024-01-18T00:48:31.817 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-18T00:48:31.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.965+0000 7f11a2400640 1 Processor -- start 2024-01-18T00:48:31.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.965+0000 7f11a2400640 1 -- start start 2024-01-18T00:48:31.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f11a2400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f119c159030 0x7f119c159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f11a2400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c151890 con 0x7f119c15a3a0 2024-01-18T00:48:31.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f11a2400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c158ba0 con 0x7f119c157360 2024-01-18T00:48:31.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f11a2400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c15a780 con 0x7f119c159030 2024-01-18T00:48:31.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f119be00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f119c159030 0x7f119c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f119aa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f119c157360 0x7f119c0cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:40222/0 (socket says 172.21.15.67:40222) 2024-01-18T00:48:31.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f119aa00640 1 -- 172.21.15.67:0/2831399503 learned_addr learned my addr 172.21.15.67:0/2831399503 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:31.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.969+0000 7f119b400640 1 --1- 172.21.15.67:0/2831399503 >> v1:172.21.15.67:6789/0 conn(0x7f119c15a3a0 0x7f119c0c2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35174/0 (socket says 172.21.15.67:35174) 2024-01-18T00:48:31.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.973+0000 7f119be00640 1 -- 172.21.15.67:0/2831399503 >> v1:172.21.15.137:6789/0 conn(0x7f119c157360 legacy=0x7f119c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.973+0000 7f119be00640 1 -- 172.21.15.67:0/2831399503 >> v1:172.21.15.67:6789/0 conn(0x7f119c15a3a0 legacy=0x7f119c0c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.973+0000 7f119be00640 1 -- 172.21.15.67:0/2831399503 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c158850 con 0x7f119c159030 2024-01-18T00:48:31.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.977+0000 7f119be00640 1 --2- 172.21.15.67:0/2831399503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c159030 0x7f119c159440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1194009d90 tx=0x7f119401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb403155d9d3573 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:31.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f119a000640 1 -- 172.21.15.67:0/2831399503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940af600 con 0x7f119c159030 2024-01-18T00:48:31.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f119a000640 1 -- 172.21.15.67:0/2831399503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11940ab050 con 0x7f119c159030 2024-01-18T00:48:31.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f119a000640 1 -- 172.21.15.67:0/2831399503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11940af980 con 0x7f119c159030 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 -- 172.21.15.67:0/2831399503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c159030 msgr2=0x7f119c159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 --2- 172.21.15.67:0/2831399503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c159030 0x7f119c159440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1194009d90 tx=0x7f119401f130 comp rx=0 tx=0).stop 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 -- 172.21.15.67:0/2831399503 shutdown_connections 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 --2- 172.21.15.67:0/2831399503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c159030 0x7f119c159440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 -- 172.21.15.67:0/2831399503 >> 172.21.15.67:0/2831399503 conn(0x7f119c061100 msgr2=0x7f119c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 -- 172.21.15.67:0/2831399503 shutdown_connections 2024-01-18T00:48:31.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.981+0000 7f11a2400640 1 -- 172.21.15.67:0/2831399503 wait complete. 2024-01-18T00:48:31.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 Processor -- start 2024-01-18T00:48:31.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 -- start start 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f119c159030 0x7f119c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f119c15a3a0 0x7f119c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c153410 con 0x7f119c157360 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c152800 con 0x7f119c159030 2024-01-18T00:48:31.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f11a2400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c152ae0 con 0x7f119c15a3a0 2024-01-18T00:48:31.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f119b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f119b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36098/0 (socket says 172.21.15.67:36098) 2024-01-18T00:48:31.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.985+0000 7f119b400640 1 -- 172.21.15.67:0/415624027 learned_addr learned my addr 172.21.15.67:0/415624027 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:31.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119be00640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f119c15a3a0 0x7f119c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119aa00640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f119c159030 0x7f119c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:31.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119b400640 1 -- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f119c15a3a0 msgr2=0x7f119c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119b400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f119c15a3a0 0x7f119c153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119b400640 1 -- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f119c159030 msgr2=0x7f119c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:31.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119b400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f119c159030 0x7f119c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:31.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.989+0000 7f119b400640 1 -- 172.21.15.67:0/415624027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194009a70 con 0x7f119c157360 2024-01-18T00:48:31.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.993+0000 7f119b400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c390 tx=0x7f118c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:31.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0074e0 con 0x7f119c157360 2024-01-18T00:48:31.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c152dc0 con 0x7f119c157360 2024-01-18T00:48:31.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c15b310 con 0x7f119c157360 2024-01-18T00:48:31.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c0746a0 con 0x7f119c157360 2024-01-18T00:48:31.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c007640 con 0x7f119c157360 2024-01-18T00:48:31.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:31.997+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c004a10 con 0x7f119c157360 2024-01-18T00:48:32.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.253+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f118c004b70 con 0x7f119c157360 2024-01-18T00:48:32.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.253+0000 7f1193400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 0x7f1174068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.257+0000 7f119aa00640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 0x7f1174068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.257+0000 7f119aa00640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 0x7f1174068d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f119c0cab20 tx=0x7f1184007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:32.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.265+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f118c0550d0 con 0x7f119c157360 2024-01-18T00:48:32.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.265+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f118c051410 con 0x7f119c157360 2024-01-18T00:48:32.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.429+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f119c0b0360 con 0x7f119c157360 2024-01-18T00:48:32.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.433+0000 7f1193400640 1 -- 172.21.15.67:0/415624027 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f118c054a30 con 0x7f119c157360 2024-01-18T00:48:32.436 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-01-18T00:48:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 msgr2=0x7f1174068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 0x7f1174068d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f119c0cab20 tx=0x7f1184007e90 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 msgr2=0x7f119c0b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f118c00c390 tx=0x7f118c00c850 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 shutdown_connections 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1174066840 0x7f1174068d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f119c15a3a0 0x7f119c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f119c159030 0x7f119c0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 --2- 172.21.15.67:0/415624027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f119c157360 0x7f119c0b1f90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 >> 172.21.15.67:0/415624027 conn(0x7f119c061100 msgr2=0x7f119c157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 shutdown_connections 2024-01-18T00:48:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.437+0000 7f11a2400640 1 -- 172.21.15.67:0/415624027 wait complete. 2024-01-18T00:48:32.458 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-18T00:48:32.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.597+0000 7f174b000640 1 Processor -- start 2024-01-18T00:48:32.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f174b000640 1 -- start start 2024-01-18T00:48:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f174b000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17440c95d0 0x7f17440ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f174b000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440c3840 con 0x7f1744153b10 2024-01-18T00:48:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f174b000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440c3b20 con 0x7f174415a560 2024-01-18T00:48:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f174b000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1744159870 con 0x7f17440c95d0 2024-01-18T00:48:32.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f1749000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17440c95d0 0x7f17440ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f1749000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f17440c95d0 0x7f17440ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36100/0 (socket says 172.21.15.67:36100) 2024-01-18T00:48:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.601+0000 7f1749000640 1 -- 172.21.15.67:0/4164555869 learned_addr learned my addr 172.21.15.67:0/4164555869 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.605+0000 7f1749000640 1 -- 172.21.15.67:0/4164555869 >> v1:172.21.15.137:6789/0 conn(0x7f174415a560 legacy=0x7f17440c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.605+0000 7f1749000640 1 -- 172.21.15.67:0/4164555869 >> v1:172.21.15.67:6789/0 conn(0x7f1744153b10 legacy=0x7f17440c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.605+0000 7f1749000640 1 -- 172.21.15.67:0/4164555869 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744159a80 con 0x7f17440c95d0 2024-01-18T00:48:32.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.609+0000 7f1749000640 1 --2- 172.21.15.67:0/4164555869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17440c95d0 0x7f17440ccfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f173c009e50 tx=0x7f173c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aca85cca1045a75 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:32.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f1742a00640 1 -- 172.21.15.67:0/4164555869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c0af400 con 0x7f17440c95d0 2024-01-18T00:48:32.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f1742a00640 1 -- 172.21.15.67:0/4164555869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c0ab050 con 0x7f17440c95d0 2024-01-18T00:48:32.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f1742a00640 1 -- 172.21.15.67:0/4164555869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c0af780 con 0x7f17440c95d0 2024-01-18T00:48:32.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f174b000640 1 -- 172.21.15.67:0/4164555869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17440c95d0 msgr2=0x7f17440ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f174b000640 1 --2- 172.21.15.67:0/4164555869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17440c95d0 0x7f17440ccfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f173c009e50 tx=0x7f173c01f1f0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f174b000640 1 -- 172.21.15.67:0/4164555869 shutdown_connections 2024-01-18T00:48:32.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f174b000640 1 --2- 172.21.15.67:0/4164555869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f17440c95d0 0x7f17440ccfc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.613+0000 7f174b000640 1 -- 172.21.15.67:0/4164555869 >> 172.21.15.67:0/4164555869 conn(0x7f1744061100 msgr2=0x7f1744061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:32.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- 172.21.15.67:0/4164555869 shutdown_connections 2024-01-18T00:48:32.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- 172.21.15.67:0/4164555869 wait complete. 2024-01-18T00:48:32.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 Processor -- start 2024-01-18T00:48:32.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- start start 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17440c95d0 0x7f17441545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f174415a560 0x7f1744149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174414b610 con 0x7f1744153b10 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f2b80 con 0x7f17440c95d0 2024-01-18T00:48:32.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f174b000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17441f28a0 con 0x7f174415a560 2024-01-18T00:48:32.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.617+0000 7f1743400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36116/0 (socket says 172.21.15.67:36116) 2024-01-18T00:48:32.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 -- 172.21.15.67:0/274228782 learned_addr learned my addr 172.21.15.67:0/274228782 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:32.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743e00640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17440c95d0 0x7f17441545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1749000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f174415a560 0x7f1744149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 -- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f174415a560 msgr2=0x7f1744149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f174415a560 0x7f1744149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 -- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17440c95d0 msgr2=0x7f17441545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17440c95d0 0x7f17441545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.621+0000 7f1743400640 1 -- 172.21.15.67:0/274228782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009b30 con 0x7f1744153b10 2024-01-18T00:48:32.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.629+0000 7f1743400640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c450 tx=0x7f172c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:32.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c0052d0 con 0x7f1744153b10 2024-01-18T00:48:32.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c005430 con 0x7f1744153b10 2024-01-18T00:48:32.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c007260 con 0x7f1744153b10 2024-01-18T00:48:32.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174414ba30 con 0x7f1744153b10 2024-01-18T00:48:32.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174414bcd0 con 0x7f1744153b10 2024-01-18T00:48:32.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.633+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17440746a0 con 0x7f1744153b10 2024-01-18T00:48:32.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.653+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f172c0073c0 con 0x7f1744153b10 2024-01-18T00:48:32.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.653+0000 7f173be00640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 0x7f171c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:32.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.653+0000 7f1743e00640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 0x7f171c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:32.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.653+0000 7f1743e00640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 0x7f171c068d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1734001810 tx=0x7f1734009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:32.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.905+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f172c055690 con 0x7f1744153b10 2024-01-18T00:48:32.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:32.905+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f172c0519d0 con 0x7f1744153b10 2024-01-18T00:48:33.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.085+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17440c7820 con 0x7f1744153b10 2024-01-18T00:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f173be00640 1 -- 172.21.15.67:0/274228782 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f172c054ff0 con 0x7f1744153b10 2024-01-18T00:48:33.125 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 msgr2=0x7f171c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 0x7f171c068d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1734001810 tx=0x7f1734009040 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 msgr2=0x7f17441f3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c450 tx=0x7f172c00c910 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 shutdown_connections 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f171c066890 0x7f171c068d50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f174415a560 0x7f1744149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1744153b10 0x7f17441f3010 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 --2- 172.21.15.67:0/274228782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17440c95d0 0x7f17441545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 >> 172.21.15.67:0/274228782 conn(0x7f1744061100 msgr2=0x7f17440cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 shutdown_connections 2024-01-18T00:48:33.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:33.125+0000 7f174b000640 1 -- 172.21.15.67:0/274228782 wait complete. 2024-01-18T00:48:33.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-18T00:48:33.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:48:33.148 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-18T00:48:33.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:48:33.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:48:33.561 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-18T00:48:33.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:48:33.570 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-01-18T00:48:33.621 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-18T00:48:33.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:48:33.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-18T00:48:33.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-18T00:48:33.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-01-18T00:48:33.895 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-18T00:48:33.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-18T00:48:33.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:48:34.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 Processor -- start 2024-01-18T00:48:34.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 -- start start 2024-01-18T00:48:34.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7948072300 0x7f7948072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794815b9c0 con 0x7f79481517a0 2024-01-18T00:48:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7948158530 con 0x7f7948072300 2024-01-18T00:48:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f794d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794815ae40 con 0x7f7948157bc0 2024-01-18T00:48:34.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.045+0000 7f7946800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.049+0000 7f7945400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7948072300 0x7f7948072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.049+0000 7f7946800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:58048/0 (socket says 172.21.15.67:58048) 2024-01-18T00:48:34.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.049+0000 7f7946800640 1 -- 172.21.15.67:0/1388245098 learned_addr learned my addr 172.21.15.67:0/1388245098 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:34.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.057+0000 7f7946800640 1 -- 172.21.15.67:0/1388245098 >> v2:172.21.15.137:3300/0 conn(0x7f7948072300 msgr2=0x7f7948072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:34.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.057+0000 7f7946800640 1 --2- 172.21.15.67:0/1388245098 >> v2:172.21.15.137:3300/0 conn(0x7f7948072300 0x7f7948072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.057+0000 7f7946800640 1 -- 172.21.15.67:0/1388245098 >> v1:172.21.15.137:6789/0 conn(0x7f79481517a0 legacy=0x7f794806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.057+0000 7f7946800640 1 -- 172.21.15.67:0/1388245098 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794815b120 con 0x7f7948157bc0 2024-01-18T00:48:34.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.065+0000 7f7946800640 1 --2- 172.21.15.67:0/1388245098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7940009e50 tx=0x7f794001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c24e6b804bc3e4d server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:34.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f7944a00640 1 -- 172.21.15.67:0/1388245098 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400a58a0 con 0x7f7948157bc0 2024-01-18T00:48:34.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f7944a00640 1 -- 172.21.15.67:0/1388245098 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400a5a00 con 0x7f7948157bc0 2024-01-18T00:48:34.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f7944a00640 1 -- 172.21.15.67:0/1388245098 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400a5d90 con 0x7f7948157bc0 2024-01-18T00:48:34.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- 172.21.15.67:0/1388245098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 msgr2=0x7f7948157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- 172.21.15.67:0/1388245098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7940009e50 tx=0x7f794001c9e0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- 172.21.15.67:0/1388245098 shutdown_connections 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- 172.21.15.67:0/1388245098 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948157bc0 0x7f7948157ff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- 172.21.15.67:0/1388245098 >> v2:172.21.15.137:3300/0 conn(0x7f7948072300 0x7f7948072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- 172.21.15.67:0/1388245098 >> 172.21.15.67:0/1388245098 conn(0x7f79480cb070 msgr2=0x7f79480cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- 172.21.15.67:0/1388245098 shutdown_connections 2024-01-18T00:48:34.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- 172.21.15.67:0/1388245098 wait complete. 2024-01-18T00:48:34.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 Processor -- start 2024-01-18T00:48:34.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- start start 2024-01-18T00:48:34.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948072300 0x7f7948158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79481517a0 0x7f79480c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794815a140 con 0x7f7948157bc0 2024-01-18T00:48:34.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481f5480 con 0x7f79481517a0 2024-01-18T00:48:34.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.077+0000 7f794d000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794814f360 con 0x7f7948072300 2024-01-18T00:48:34.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.081+0000 7f7946800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.081+0000 7f7946800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36132/0 (socket says 172.21.15.67:36132) 2024-01-18T00:48:34.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.081+0000 7f7946800640 1 -- 172.21.15.67:0/104700221 learned_addr learned my addr 172.21.15.67:0/104700221 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:34.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 -- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948072300 msgr2=0x7f7948158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948072300 0x7f7948158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 -- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79481517a0 msgr2=0x7f79480c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79481517a0 0x7f79480c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 -- 172.21.15.67:0/104700221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009b30 con 0x7f7948157bc0 2024-01-18T00:48:34.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.085+0000 7f7946800640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f794001a610 tx=0x7f7940019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400b8670 con 0x7f7948157bc0 2024-01-18T00:48:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400b87f0 con 0x7f7948157bc0 2024-01-18T00:48:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400b8ba0 con 0x7f7948157bc0 2024-01-18T00:48:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79481f5690 con 0x7f7948157bc0 2024-01-18T00:48:34.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79481f5c50 con 0x7f7948157bc0 2024-01-18T00:48:34.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.093+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79480746a0 con 0x7f7948157bc0 2024-01-18T00:48:34.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.405+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f79400b8d00 con 0x7f7948157bc0 2024-01-18T00:48:34.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.405+0000 7f793e000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 0x7f7920068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.409+0000 7f7945e00640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 0x7f7920068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.409+0000 7f7945e00640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 0x7f7920068d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7938000f70 tx=0x7f79380079e0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:34.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.417+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79400c23c0 con 0x7f7948157bc0 2024-01-18T00:48:34.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.421+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f79400ed470 con 0x7f7948157bc0 2024-01-18T00:48:34.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.573+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f794815ab00 con 0x7f79200668c0 2024-01-18T00:48:34.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.605+0000 7f793e000640 1 -- 172.21.15.67:0/104700221 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371345 (secure 0 0 0) 0x7f7938005080 con 0x7f79200668c0 2024-01-18T00:48:34.610 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:34.613 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-18T00:48:34.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 msgr2=0x7f7920068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 0x7f7920068d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7938000f70 tx=0x7f79380079e0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 msgr2=0x7f79480ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f794001a610 tx=0x7f7940019780 comp rx=0 tx=0).stop 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 shutdown_connections 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f79200668c0 0x7f7920068d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7948157bc0 0x7f79480ca530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79481517a0 0x7f79480c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 --2- 172.21.15.67:0/104700221 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7948072300 0x7f7948158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 >> 172.21.15.67:0/104700221 conn(0x7f79480cb070 msgr2=0x7f7948071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 shutdown_connections 2024-01-18T00:48:34.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.609+0000 7f794d000640 1 -- 172.21.15.67:0/104700221 wait complete. 2024-01-18T00:48:34.631 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":3288,"stamp":"2024-01-18T00:48:32.740120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198604358,"num_objects":110,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":3112,"num_read_kb":3689624,"num_write":46723,"num_write_kb":4572586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59416,"ondisk_log_size":59416,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1008552,"kb_used_data":179368,"kb_used_omap":12,"kb_used_meta":829107,"kb_avail":753966168,"statfs":{"total":773094113280,"available":772061356032,"internally_reserved":0,"allocated":183672832,"data_stored":398644955,"data_compressed":51542616,"data_compressed_allocated":69640192,"data_compressed_original":286228480,"omap_allocated":12752,"internal_metadata":849006128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-305419,"num_objects":-80,"num_object_clones":0,"num_object_copies":-320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-80,"num_whiteouts":0,"num_read":5,"num_read_kb":9,"num_write":112,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005284"},"pg_stats":[{"pgid":"2.1f","version":"29'348","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'182","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.611708+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:18.611708+0000","last_peered":"2024-01-18T00:48:18.611708+0000","last_clean":"2024-01-18T00:48:18.611708+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-18T00:48:18.611708+0000","last_undegraded":"2024-01-18T00:48:18.611708+0000","last_fullsized":"2024-01-18T00:48:18.611708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'802","reported_seq":906,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065083+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-18T00:48:21.065083+0000","last_peered":"2024-01-18T00:48:21.065083+0000","last_clean":"2024-01-18T00:48:21.065083+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-18T00:48:21.065083+0000","last_undegraded":"2024-01-18T00:48:21.065083+0000","last_fullsized":"2024-01-18T00:48:21.065083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":142138,"num_write":787,"num_write_kb":155519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'554","reported_seq":627,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:52.788197+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-18T00:46:52.788197+0000","last_peered":"2024-01-18T00:46:52.788197+0000","last_clean":"2024-01-18T00:46:52.788197+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-18T00:46:52.788197+0000","last_undegraded":"2024-01-18T00:46:52.788197+0000","last_fullsized":"2024-01-18T00:46:52.788197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'168","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.517228+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-18T00:48:00.517228+0000","last_peered":"2024-01-18T00:48:00.517228+0000","last_clean":"2024-01-18T00:48:00.517228+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-18T00:48:00.517228+0000","last_undegraded":"2024-01-18T00:48:00.517228+0000","last_fullsized":"2024-01-18T00:48:00.517228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'820","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.292642+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-18T00:48:21.292642+0000","last_peered":"2024-01-18T00:48:21.292642+0000","last_clean":"2024-01-18T00:48:21.292642+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-18T00:48:21.292642+0000","last_undegraded":"2024-01-18T00:48:21.292642+0000","last_fullsized":"2024-01-18T00:48:21.292642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":112120,"num_write":807,"num_write_kb":168152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1017","reported_seq":1080,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:45.207860+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-18T00:46:45.207860+0000","last_peered":"2024-01-18T00:46:45.207860+0000","last_clean":"2024-01-18T00:46:45.207860+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-18T00:46:45.207860+0000","last_undegraded":"2024-01-18T00:46:45.207860+0000","last_fullsized":"2024-01-18T00:46:45.207860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":12756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'181","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.732391+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-18T00:47:50.732391+0000","last_peered":"2024-01-18T00:47:50.732391+0000","last_clean":"2024-01-18T00:47:50.732391+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-18T00:47:50.732391+0000","last_undegraded":"2024-01-18T00:47:50.732391+0000","last_fullsized":"2024-01-18T00:47:50.732391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'736","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.474364+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-18T00:48:18.474364+0000","last_peered":"2024-01-18T00:48:18.474364+0000","last_clean":"2024-01-18T00:48:18.474364+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-18T00:48:18.474364+0000","last_undegraded":"2024-01-18T00:48:18.474364+0000","last_fullsized":"2024-01-18T00:48:18.474364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":76820,"num_write":722,"num_write_kb":119762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'829","reported_seq":892,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.309570+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-18T00:47:15.309570+0000","last_peered":"2024-01-18T00:47:15.309570+0000","last_clean":"2024-01-18T00:47:15.309570+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-18T00:47:15.309570+0000","last_undegraded":"2024-01-18T00:47:15.309570+0000","last_fullsized":"2024-01-18T00:47:15.309570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'198","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.728104+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-18T00:47:50.728104+0000","last_peered":"2024-01-18T00:47:50.728104+0000","last_clean":"2024-01-18T00:47:50.728104+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-18T00:47:50.728104+0000","last_undegraded":"2024-01-18T00:47:50.728104+0000","last_fullsized":"2024-01-18T00:47:50.728104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'727","reported_seq":813,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.363639+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-18T00:48:27.363639+0000","last_peered":"2024-01-18T00:48:27.363639+0000","last_clean":"2024-01-18T00:48:27.363639+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-18T00:48:27.363639+0000","last_undegraded":"2024-01-18T00:48:27.363639+0000","last_fullsized":"2024-01-18T00:48:27.363639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":89221,"num_write":717,"num_write_kb":93426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'209","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.840216+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-18T00:48:11.840216+0000","last_peered":"2024-01-18T00:48:11.840216+0000","last_clean":"2024-01-18T00:48:11.840216+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-18T00:48:11.840216+0000","last_undegraded":"2024-01-18T00:48:11.840216+0000","last_fullsized":"2024-01-18T00:48:11.840216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'1218","reported_seq":1286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.212940+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-18T00:46:56.212940+0000","last_peered":"2024-01-18T00:46:56.212940+0000","last_clean":"2024-01-18T00:46:56.212940+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-18T00:46:56.212940+0000","last_undegraded":"2024-01-18T00:46:56.212940+0000","last_fullsized":"2024-01-18T00:46:56.212940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1218,"log_dups_size":0,"ondisk_log_size":1218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'784","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:19.037590+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-18T00:48:19.037590+0000","last_peered":"2024-01-18T00:48:19.037590+0000","last_clean":"2024-01-18T00:48:19.037590+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-18T00:48:19.037590+0000","last_undegraded":"2024-01-18T00:48:19.037590+0000","last_fullsized":"2024-01-18T00:48:19.037590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":112181,"num_write":768,"num_write_kb":146877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'214","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.281219+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-18T00:48:27.281219+0000","last_peered":"2024-01-18T00:48:27.281219+0000","last_clean":"2024-01-18T00:48:27.281219+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-18T00:48:27.281219+0000","last_undegraded":"2024-01-18T00:48:27.281219+0000","last_fullsized":"2024-01-18T00:48:27.281219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1250","reported_seq":1319,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:02.865589+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-18T00:47:02.865589+0000","last_peered":"2024-01-18T00:47:02.865589+0000","last_clean":"2024-01-18T00:47:02.865589+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-18T00:47:02.865589+0000","last_undegraded":"2024-01-18T00:47:02.865589+0000","last_fullsized":"2024-01-18T00:47:02.865589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'844","reported_seq":945,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.741571+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-18T00:48:21.741571+0000","last_peered":"2024-01-18T00:48:21.741571+0000","last_clean":"2024-01-18T00:48:21.741571+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-18T00:48:21.741571+0000","last_undegraded":"2024-01-18T00:48:21.741571+0000","last_fullsized":"2024-01-18T00:48:21.741571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":112670,"num_write":833,"num_write_kb":127477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'206","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.744028+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-18T00:48:18.744028+0000","last_peered":"2024-01-18T00:48:18.744028+0000","last_clean":"2024-01-18T00:48:18.744028+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-18T00:48:18.744028+0000","last_undegraded":"2024-01-18T00:48:18.744028+0000","last_fullsized":"2024-01-18T00:48:18.744028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'322","reported_seq":391,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.211893+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-18T00:46:56.211893+0000","last_peered":"2024-01-18T00:46:56.211893+0000","last_clean":"2024-01-18T00:46:56.211893+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-18T00:46:56.211893+0000","last_undegraded":"2024-01-18T00:46:56.211893+0000","last_fullsized":"2024-01-18T00:46:56.211893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'756","reported_seq":866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.928596+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-18T00:48:06.928596+0000","last_peered":"2024-01-18T00:48:06.928596+0000","last_clean":"2024-01-18T00:48:06.928596+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-18T00:48:06.928596+0000","last_undegraded":"2024-01-18T00:48:06.928596+0000","last_fullsized":"2024-01-18T00:48:06.928596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":171173,"num_write":745,"num_write_kb":212620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'217","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.076382+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-18T00:48:12.076382+0000","last_peered":"2024-01-18T00:48:12.076382+0000","last_clean":"2024-01-18T00:48:12.076382+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-18T00:48:12.076382+0000","last_undegraded":"2024-01-18T00:48:12.076382+0000","last_fullsized":"2024-01-18T00:48:12.076382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'228","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:44:17.952063+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-18T00:44:17.952063+0000","last_peered":"2024-01-18T00:44:17.952063+0000","last_clean":"2024-01-18T00:44:17.952063+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-18T00:44:17.952063+0000","last_undegraded":"2024-01-18T00:44:17.952063+0000","last_fullsized":"2024-01-18T00:44:17.952063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'704","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071298+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-18T00:48:27.071298+0000","last_peered":"2024-01-18T00:48:27.071298+0000","last_clean":"2024-01-18T00:48:27.071298+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-18T00:48:27.071298+0000","last_undegraded":"2024-01-18T00:48:27.071298+0000","last_fullsized":"2024-01-18T00:48:27.071298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42617,"num_write":681,"num_write_kb":68844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'215","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.469520+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-18T00:47:35.469520+0000","last_peered":"2024-01-18T00:47:35.469520+0000","last_clean":"2024-01-18T00:47:35.469520+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-18T00:47:35.469520+0000","last_undegraded":"2024-01-18T00:47:35.469520+0000","last_fullsized":"2024-01-18T00:47:35.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'301","reported_seq":370,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:50.898336+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-18T00:46:50.898336+0000","last_peered":"2024-01-18T00:46:50.898336+0000","last_clean":"2024-01-18T00:46:50.898336+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-18T00:46:50.898336+0000","last_undegraded":"2024-01-18T00:46:50.898336+0000","last_fullsized":"2024-01-18T00:46:50.898336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'837","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050116+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-18T00:48:21.050116+0000","last_peered":"2024-01-18T00:48:21.050116+0000","last_clean":"2024-01-18T00:48:21.050116+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-18T00:48:21.050116+0000","last_undegraded":"2024-01-18T00:48:21.050116+0000","last_fullsized":"2024-01-18T00:48:21.050116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":234919,"num_write":817,"num_write_kb":206693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'178","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.791280+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-18T00:48:05.791280+0000","last_peered":"2024-01-18T00:48:05.791280+0000","last_clean":"2024-01-18T00:48:05.791280+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-18T00:48:05.791280+0000","last_undegraded":"2024-01-18T00:48:05.791280+0000","last_fullsized":"2024-01-18T00:48:05.791280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'1184","reported_seq":1253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.227870+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-18T00:48:21.227870+0000","last_peered":"2024-01-18T00:48:21.227870+0000","last_clean":"2024-01-18T00:48:21.227870+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-18T00:48:21.227870+0000","last_undegraded":"2024-01-18T00:48:21.227870+0000","last_fullsized":"2024-01-18T00:48:21.227870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3142,"num_write_kb":2233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'823","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065709+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-18T00:48:21.065709+0000","last_peered":"2024-01-18T00:48:21.065709+0000","last_clean":"2024-01-18T00:48:21.065709+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-18T00:48:21.065709+0000","last_undegraded":"2024-01-18T00:48:21.065709+0000","last_fullsized":"2024-01-18T00:48:21.065709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":136936,"num_write":807,"num_write_kb":135857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'196","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.530724+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-18T00:48:00.530724+0000","last_peered":"2024-01-18T00:48:00.530724+0000","last_clean":"2024-01-18T00:48:00.530724+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-18T00:48:00.530724+0000","last_undegraded":"2024-01-18T00:48:00.530724+0000","last_fullsized":"2024-01-18T00:48:00.530724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'794","reported_seq":865,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:12.091765+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-18T00:47:12.091765+0000","last_peered":"2024-01-18T00:47:12.091765+0000","last_clean":"2024-01-18T00:47:12.091765+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-18T00:47:12.091765+0000","last_undegraded":"2024-01-18T00:47:12.091765+0000","last_fullsized":"2024-01-18T00:47:12.091765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'751","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.040646+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-18T00:48:27.040646+0000","last_peered":"2024-01-18T00:48:27.040646+0000","last_clean":"2024-01-18T00:48:27.040646+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-18T00:48:27.040646+0000","last_undegraded":"2024-01-18T00:48:27.040646+0000","last_fullsized":"2024-01-18T00:48:27.040646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":97762,"num_write":737,"num_write_kb":97911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'206","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.314434+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-18T00:48:11.314434+0000","last_peered":"2024-01-18T00:48:11.314434+0000","last_clean":"2024-01-18T00:48:11.314434+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-18T00:48:11.314434+0000","last_undegraded":"2024-01-18T00:48:11.314434+0000","last_fullsized":"2024-01-18T00:48:11.314434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'268","reported_seq":339,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:40.383292+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-18T00:45:40.383292+0000","last_peered":"2024-01-18T00:45:40.383292+0000","last_clean":"2024-01-18T00:45:40.383292+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-18T00:45:40.383292+0000","last_undegraded":"2024-01-18T00:45:40.383292+0000","last_fullsized":"2024-01-18T00:45:40.383292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'803","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.079182+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-18T00:48:27.079182+0000","last_peered":"2024-01-18T00:48:27.079182+0000","last_clean":"2024-01-18T00:48:27.079182+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-18T00:48:27.079182+0000","last_undegraded":"2024-01-18T00:48:27.079182+0000","last_fullsized":"2024-01-18T00:48:27.079182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":142135,"num_write":790,"num_write_kb":151473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.756635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-18T00:48:18.756635+0000","last_peered":"2024-01-18T00:48:18.756635+0000","last_clean":"2024-01-18T00:48:18.756635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-18T00:48:18.756635+0000","last_undegraded":"2024-01-18T00:48:18.756635+0000","last_fullsized":"2024-01-18T00:48:18.756635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'959","reported_seq":1030,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:14.158415+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-18T00:45:14.158415+0000","last_peered":"2024-01-18T00:45:14.158415+0000","last_clean":"2024-01-18T00:45:14.158415+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-18T00:45:14.158415+0000","last_undegraded":"2024-01-18T00:45:14.158415+0000","last_fullsized":"2024-01-18T00:45:14.158415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'706","reported_seq":806,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.550784+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-18T00:48:06.550784+0000","last_peered":"2024-01-18T00:48:06.550784+0000","last_clean":"2024-01-18T00:48:06.550784+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-18T00:48:06.550784+0000","last_undegraded":"2024-01-18T00:48:06.550784+0000","last_fullsized":"2024-01-18T00:48:06.550784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":104293,"num_write":696,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'197","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.043178+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-18T00:48:21.043178+0000","last_peered":"2024-01-18T00:48:21.043178+0000","last_clean":"2024-01-18T00:48:21.043178+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-18T00:48:21.043178+0000","last_undegraded":"2024-01-18T00:48:21.043178+0000","last_fullsized":"2024-01-18T00:48:21.043178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1849","reported_seq":3704,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.260611+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-18T00:48:31.260611+0000","last_peered":"2024-01-18T00:48:31.260611+0000","last_clean":"2024-01-18T00:48:31.260611+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:31.260611+0000","last_undegraded":"2024-01-18T00:48:31.260611+0000","last_fullsized":"2024-01-18T00:48:31.260611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558175,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":1791,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'717","reported_seq":799,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.028723+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-18T00:48:27.028723+0000","last_peered":"2024-01-18T00:48:27.028723+0000","last_clean":"2024-01-18T00:48:27.028723+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-18T00:48:27.028723+0000","last_undegraded":"2024-01-18T00:48:27.028723+0000","last_fullsized":"2024-01-18T00:48:27.028723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54940,"num_write":709,"num_write_kb":85564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'191","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.059510+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-18T00:48:21.059510+0000","last_peered":"2024-01-18T00:48:21.059510+0000","last_clean":"2024-01-18T00:48:21.059510+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-18T00:48:21.059510+0000","last_undegraded":"2024-01-18T00:48:21.059510+0000","last_fullsized":"2024-01-18T00:48:21.059510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'549","reported_seq":622,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.161781+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-18T00:48:00.161781+0000","last_peered":"2024-01-18T00:48:00.161781+0000","last_clean":"2024-01-18T00:48:00.161781+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-18T00:48:00.161781+0000","last_undegraded":"2024-01-18T00:48:00.161781+0000","last_fullsized":"2024-01-18T00:48:00.161781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":12520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'927","reported_seq":1063,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.292487+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-18T00:48:00.292487+0000","last_peered":"2024-01-18T00:48:00.292487+0000","last_clean":"2024-01-18T00:48:00.292487+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-18T00:48:00.292487+0000","last_undegraded":"2024-01-18T00:48:00.292487+0000","last_fullsized":"2024-01-18T00:48:00.292487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":233359,"num_write":916,"num_write_kb":280898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'190","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.069174+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-18T00:48:27.069174+0000","last_peered":"2024-01-18T00:48:27.069174+0000","last_clean":"2024-01-18T00:48:27.069174+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-18T00:48:27.069174+0000","last_undegraded":"2024-01-18T00:48:27.069174+0000","last_fullsized":"2024-01-18T00:48:27.069174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'291","reported_seq":362,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.014348+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-18T00:48:27.014348+0000","last_peered":"2024-01-18T00:48:27.014348+0000","last_clean":"2024-01-18T00:48:27.014348+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-18T00:48:27.014348+0000","last_undegraded":"2024-01-18T00:48:27.014348+0000","last_fullsized":"2024-01-18T00:48:27.014348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'161","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:22.833997+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-18T00:46:22.833997+0000","last_peered":"2024-01-18T00:46:22.833997+0000","last_clean":"2024-01-18T00:46:22.833997+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-18T00:46:22.833997+0000","last_undegraded":"2024-01-18T00:46:22.833997+0000","last_fullsized":"2024-01-18T00:46:22.833997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'848","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.361087+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-18T00:48:18.361087+0000","last_peered":"2024-01-18T00:48:18.361087+0000","last_clean":"2024-01-18T00:48:18.361087+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-18T00:48:18.361087+0000","last_undegraded":"2024-01-18T00:48:18.361087+0000","last_fullsized":"2024-01-18T00:48:18.361087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":221922,"num_write":836,"num_write_kb":231792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'203","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852517+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-18T00:48:17.852517+0000","last_peered":"2024-01-18T00:48:17.852517+0000","last_clean":"2024-01-18T00:48:17.852517+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-18T00:48:17.852517+0000","last_undegraded":"2024-01-18T00:48:17.852517+0000","last_fullsized":"2024-01-18T00:48:17.852517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'352","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121097+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-18T00:48:07.121097+0000","last_peered":"2024-01-18T00:48:07.121097+0000","last_clean":"2024-01-18T00:48:07.121097+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-18T00:48:07.121097+0000","last_undegraded":"2024-01-18T00:48:07.121097+0000","last_fullsized":"2024-01-18T00:48:07.121097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'833","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050673+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-18T00:48:21.050673+0000","last_peered":"2024-01-18T00:48:21.050673+0000","last_clean":"2024-01-18T00:48:21.050673+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-18T00:48:21.050673+0000","last_undegraded":"2024-01-18T00:48:21.050673+0000","last_fullsized":"2024-01-18T00:48:21.050673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":185672,"num_write":820,"num_write_kb":193922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'213","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.803948+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-18T00:48:17.803948+0000","last_peered":"2024-01-18T00:48:17.803948+0000","last_clean":"2024-01-18T00:48:17.803948+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-18T00:48:17.803948+0000","last_undegraded":"2024-01-18T00:48:17.803948+0000","last_fullsized":"2024-01-18T00:48:17.803948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'243","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:35.173699+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-18T00:46:35.173699+0000","last_peered":"2024-01-18T00:46:35.173699+0000","last_clean":"2024-01-18T00:46:35.173699+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-18T00:46:35.173699+0000","last_undegraded":"2024-01-18T00:46:35.173699+0000","last_fullsized":"2024-01-18T00:46:35.173699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.506628+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-18T00:48:27.506628+0000","last_peered":"2024-01-18T00:48:27.506628+0000","last_clean":"2024-01-18T00:48:27.506628+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-18T00:48:27.506628+0000","last_undegraded":"2024-01-18T00:48:27.506628+0000","last_fullsized":"2024-01-18T00:48:27.506628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":76462,"num_write":751,"num_write_kb":105973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'174","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.960208+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-18T00:47:40.960208+0000","last_peered":"2024-01-18T00:47:40.960208+0000","last_clean":"2024-01-18T00:47:40.960208+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-18T00:47:40.960208+0000","last_undegraded":"2024-01-18T00:47:40.960208+0000","last_fullsized":"2024-01-18T00:47:40.960208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'807","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.443753+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-18T00:47:35.443753+0000","last_peered":"2024-01-18T00:47:35.443753+0000","last_clean":"2024-01-18T00:47:35.443753+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:47:35.443753+0000","last_undegraded":"2024-01-18T00:47:35.443753+0000","last_fullsized":"2024-01-18T00:47:35.443753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.498847+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-18T00:48:21.498847+0000","last_peered":"2024-01-18T00:48:21.498847+0000","last_clean":"2024-01-18T00:48:21.498847+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-18T00:48:21.498847+0000","last_undegraded":"2024-01-18T00:48:21.498847+0000","last_fullsized":"2024-01-18T00:48:21.498847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79513,"num_write":758,"num_write_kb":101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'179","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852562+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-18T00:48:17.852562+0000","last_peered":"2024-01-18T00:48:17.852562+0000","last_clean":"2024-01-18T00:48:17.852562+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-18T00:48:17.852562+0000","last_undegraded":"2024-01-18T00:48:17.852562+0000","last_fullsized":"2024-01-18T00:48:17.852562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'897","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.738933+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-18T00:47:47.738933+0000","last_peered":"2024-01-18T00:47:47.738933+0000","last_clean":"2024-01-18T00:47:47.738933+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-18T00:47:47.738933+0000","last_undegraded":"2024-01-18T00:47:47.738933+0000","last_fullsized":"2024-01-18T00:47:47.738933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'793","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.079581+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-18T00:48:12.079581+0000","last_peered":"2024-01-18T00:48:12.079581+0000","last_clean":"2024-01-18T00:48:12.079581+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-18T00:48:12.079581+0000","last_undegraded":"2024-01-18T00:48:12.079581+0000","last_fullsized":"2024-01-18T00:48:12.079581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":97239,"num_write":778,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'226","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073532+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-18T00:48:27.073532+0000","last_peered":"2024-01-18T00:48:27.073532+0000","last_clean":"2024-01-18T00:48:27.073532+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-18T00:48:27.073532+0000","last_undegraded":"2024-01-18T00:48:27.073532+0000","last_fullsized":"2024-01-18T00:48:27.073532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'682","reported_seq":748,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.351601+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-18T00:47:36.351601+0000","last_peered":"2024-01-18T00:47:36.351601+0000","last_clean":"2024-01-18T00:47:36.351601+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-18T00:47:36.351601+0000","last_undegraded":"2024-01-18T00:47:36.351601+0000","last_fullsized":"2024-01-18T00:47:36.351601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":8522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'857","reported_seq":993,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.684093+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-18T00:48:11.684093+0000","last_peered":"2024-01-18T00:48:11.684093+0000","last_clean":"2024-01-18T00:48:11.684093+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-18T00:48:11.684093+0000","last_undegraded":"2024-01-18T00:48:11.684093+0000","last_fullsized":"2024-01-18T00:48:11.684093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":269459,"num_write":851,"num_write_kb":222567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'214","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.758595+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-18T00:48:18.758595+0000","last_peered":"2024-01-18T00:48:18.758595+0000","last_clean":"2024-01-18T00:48:18.758595+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-18T00:48:18.758595+0000","last_undegraded":"2024-01-18T00:48:18.758595+0000","last_fullsized":"2024-01-18T00:48:18.758595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'60","reported_seq":126,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.823501+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-18T00:45:17.823501+0000","last_peered":"2024-01-18T00:45:17.823501+0000","last_clean":"2024-01-18T00:45:17.823501+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-18T00:45:17.823501+0000","last_undegraded":"2024-01-18T00:45:17.823501+0000","last_fullsized":"2024-01-18T00:45:17.823501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'837","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.612230+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-18T00:48:18.612230+0000","last_peered":"2024-01-18T00:48:18.612230+0000","last_clean":"2024-01-18T00:48:18.612230+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-18T00:48:18.612230+0000","last_undegraded":"2024-01-18T00:48:18.612230+0000","last_fullsized":"2024-01-18T00:48:18.612230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":113711,"num_write":815,"num_write_kb":156781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'190","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073325+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-18T00:48:27.073325+0000","last_peered":"2024-01-18T00:48:27.073325+0000","last_clean":"2024-01-18T00:48:27.073325+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-18T00:48:27.073325+0000","last_undegraded":"2024-01-18T00:48:27.073325+0000","last_fullsized":"2024-01-18T00:48:27.073325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'55","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.797338+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-18T00:47:37.797338+0000","last_peered":"2024-01-18T00:47:37.797338+0000","last_clean":"2024-01-18T00:47:37.797338+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-18T00:47:37.797338+0000","last_undegraded":"2024-01-18T00:47:37.797338+0000","last_fullsized":"2024-01-18T00:47:37.797338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'693","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:22.798398+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-18T00:48:22.798398+0000","last_peered":"2024-01-18T00:48:22.798398+0000","last_clean":"2024-01-18T00:48:22.798398+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-18T00:48:22.798398+0000","last_undegraded":"2024-01-18T00:48:22.798398+0000","last_fullsized":"2024-01-18T00:48:22.798398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":99783,"num_write":680,"num_write_kb":117554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'198","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580772+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-18T00:48:06.580772+0000","last_peered":"2024-01-18T00:48:06.580772+0000","last_clean":"2024-01-18T00:48:06.580772+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-18T00:48:06.580772+0000","last_undegraded":"2024-01-18T00:48:06.580772+0000","last_fullsized":"2024-01-18T00:48:06.580772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'380","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.325567+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-18T00:47:15.325567+0000","last_peered":"2024-01-18T00:47:15.325567+0000","last_clean":"2024-01-18T00:47:15.325567+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-18T00:47:15.325567+0000","last_undegraded":"2024-01-18T00:47:15.325567+0000","last_fullsized":"2024-01-18T00:47:15.325567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":8330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'671","reported_seq":735,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.871825+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-18T00:48:11.871825+0000","last_peered":"2024-01-18T00:48:11.871825+0000","last_clean":"2024-01-18T00:48:11.871825+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-18T00:48:11.871825+0000","last_undegraded":"2024-01-18T00:48:11.871825+0000","last_fullsized":"2024-01-18T00:48:11.871825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10831,"num_write":657,"num_write_kb":42746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'199","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.856665+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-18T00:47:50.856665+0000","last_peered":"2024-01-18T00:47:50.856665+0000","last_clean":"2024-01-18T00:47:50.856665+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-18T00:47:50.856665+0000","last_undegraded":"2024-01-18T00:47:50.856665+0000","last_fullsized":"2024-01-18T00:47:50.856665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1377","reported_seq":1443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.852064+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-18T00:48:12.852064+0000","last_peered":"2024-01-18T00:48:12.852064+0000","last_clean":"2024-01-18T00:48:12.852064+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-18T00:48:12.852064+0000","last_undegraded":"2024-01-18T00:48:12.852064+0000","last_fullsized":"2024-01-18T00:48:12.852064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1324,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'774","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.471777+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-18T00:48:27.471777+0000","last_peered":"2024-01-18T00:48:27.471777+0000","last_clean":"2024-01-18T00:48:27.471777+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-18T00:48:27.471777+0000","last_undegraded":"2024-01-18T00:48:27.471777+0000","last_fullsized":"2024-01-18T00:48:27.471777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":74308,"num_write":753,"num_write_kb":109365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.940977+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-18T00:48:18.940977+0000","last_peered":"2024-01-18T00:48:18.940977+0000","last_clean":"2024-01-18T00:48:18.940977+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-18T00:48:18.940977+0000","last_undegraded":"2024-01-18T00:48:18.940977+0000","last_fullsized":"2024-01-18T00:48:18.940977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1522","reported_seq":1586,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.796355+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-18T00:48:21.796355+0000","last_peered":"2024-01-18T00:48:21.796355+0000","last_clean":"2024-01-18T00:48:21.796355+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-18T00:48:21.796355+0000","last_undegraded":"2024-01-18T00:48:21.796355+0000","last_fullsized":"2024-01-18T00:48:21.796355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":5418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'735","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071188+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-18T00:48:27.071188+0000","last_peered":"2024-01-18T00:48:27.071188+0000","last_clean":"2024-01-18T00:48:27.071188+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-18T00:48:27.071188+0000","last_undegraded":"2024-01-18T00:48:27.071188+0000","last_fullsized":"2024-01-18T00:48:27.071188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70860,"num_write":724,"num_write_kb":90941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580761+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-18T00:48:06.580761+0000","last_peered":"2024-01-18T00:48:06.580761+0000","last_clean":"2024-01-18T00:48:06.580761+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-18T00:48:06.580761+0000","last_undegraded":"2024-01-18T00:48:06.580761+0000","last_fullsized":"2024-01-18T00:48:06.580761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'160","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:00.227109+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-18T00:47:00.227109+0000","last_peered":"2024-01-18T00:47:00.227109+0000","last_clean":"2024-01-18T00:47:00.227109+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-18T00:47:00.227109+0000","last_undegraded":"2024-01-18T00:47:00.227109+0000","last_fullsized":"2024-01-18T00:47:00.227109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'831","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.750939+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-18T00:48:18.750939+0000","last_peered":"2024-01-18T00:48:18.750939+0000","last_clean":"2024-01-18T00:48:18.750939+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-18T00:48:18.750939+0000","last_undegraded":"2024-01-18T00:48:18.750939+0000","last_fullsized":"2024-01-18T00:48:18.750939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":102827,"num_write":809,"num_write_kb":147366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'202","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.421691+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-18T00:47:56.421691+0000","last_peered":"2024-01-18T00:47:56.421691+0000","last_clean":"2024-01-18T00:47:56.421691+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-18T00:47:56.421691+0000","last_undegraded":"2024-01-18T00:47:56.421691+0000","last_fullsized":"2024-01-18T00:47:56.421691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'42","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.682096+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-18T00:47:31.682096+0000","last_peered":"2024-01-18T00:47:31.682096+0000","last_clean":"2024-01-18T00:47:31.682096+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-18T00:47:31.682096+0000","last_undegraded":"2024-01-18T00:47:31.682096+0000","last_fullsized":"2024-01-18T00:47:31.682096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'822","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.056297+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-18T00:48:27.056297+0000","last_peered":"2024-01-18T00:48:27.056297+0000","last_clean":"2024-01-18T00:48:27.056297+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-18T00:48:27.056297+0000","last_undegraded":"2024-01-18T00:48:27.056297+0000","last_fullsized":"2024-01-18T00:48:27.056297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":80488,"num_write":796,"num_write_kb":101657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'736","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.950162+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-18T00:48:18.950162+0000","last_peered":"2024-01-18T00:48:18.950162+0000","last_clean":"2024-01-18T00:48:18.950162+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-18T00:48:18.950162+0000","last_undegraded":"2024-01-18T00:48:18.950162+0000","last_fullsized":"2024-01-18T00:48:18.950162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":63205,"num_write":717,"num_write_kb":100634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.792754+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-18T00:48:05.792754+0000","last_peered":"2024-01-18T00:48:05.792754+0000","last_clean":"2024-01-18T00:48:05.792754+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-18T00:48:05.792754+0000","last_undegraded":"2024-01-18T00:48:05.792754+0000","last_fullsized":"2024-01-18T00:48:05.792754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1198","reported_seq":1262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:37.788151+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-18T00:46:37.788151+0000","last_peered":"2024-01-18T00:46:37.788151+0000","last_clean":"2024-01-18T00:46:37.788151+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-18T00:46:37.788151+0000","last_undegraded":"2024-01-18T00:46:37.788151+0000","last_fullsized":"2024-01-18T00:46:37.788151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'702","reported_seq":800,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.513650+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-18T00:48:18.513650+0000","last_peered":"2024-01-18T00:48:18.513650+0000","last_clean":"2024-01-18T00:48:18.513650+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-18T00:48:18.513650+0000","last_undegraded":"2024-01-18T00:48:18.513650+0000","last_fullsized":"2024-01-18T00:48:18.513650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":94856,"num_write":687,"num_write_kb":72747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'231","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.285184+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-18T00:48:21.285184+0000","last_peered":"2024-01-18T00:48:21.285184+0000","last_clean":"2024-01-18T00:48:21.285184+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-18T00:48:21.285184+0000","last_undegraded":"2024-01-18T00:48:21.285184+0000","last_fullsized":"2024-01-18T00:48:21.285184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'180","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:24.583588+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-18T00:46:24.583588+0000","last_peered":"2024-01-18T00:46:24.583588+0000","last_clean":"2024-01-18T00:46:24.583588+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-18T00:46:24.583588+0000","last_undegraded":"2024-01-18T00:46:24.583588+0000","last_fullsized":"2024-01-18T00:46:24.583588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1528","reported_seq":1591,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.115644+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-18T00:48:27.115644+0000","last_peered":"2024-01-18T00:48:27.115644+0000","last_clean":"2024-01-18T00:48:27.115644+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-18T00:48:27.115644+0000","last_undegraded":"2024-01-18T00:48:27.115644+0000","last_fullsized":"2024-01-18T00:48:27.115644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16093277,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1464,"num_write_kb":16481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'176","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'748","reported_seq":853,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.881596+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-18T00:48:05.881596+0000","last_peered":"2024-01-18T00:48:05.881596+0000","last_clean":"2024-01-18T00:48:05.881596+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-18T00:48:05.881596+0000","last_undegraded":"2024-01-18T00:48:05.881596+0000","last_fullsized":"2024-01-18T00:48:05.881596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":128829,"num_write":735,"num_write_kb":187979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'216","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.778219+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-18T00:45:17.778219+0000","last_peered":"2024-01-18T00:45:17.778219+0000","last_clean":"2024-01-18T00:45:17.778219+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-18T00:45:17.778219+0000","last_undegraded":"2024-01-18T00:45:17.778219+0000","last_fullsized":"2024-01-18T00:45:17.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'190","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.470221+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-18T00:48:18.470221+0000","last_peered":"2024-01-18T00:48:18.470221+0000","last_clean":"2024-01-18T00:48:18.470221+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-18T00:48:18.470221+0000","last_undegraded":"2024-01-18T00:48:18.470221+0000","last_fullsized":"2024-01-18T00:48:18.470221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'730","reported_seq":811,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.582524+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-18T00:48:06.582524+0000","last_peered":"2024-01-18T00:48:06.582524+0000","last_clean":"2024-01-18T00:48:06.582524+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-18T00:48:06.582524+0000","last_undegraded":"2024-01-18T00:48:06.582524+0000","last_fullsized":"2024-01-18T00:48:06.582524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":53396,"num_write":716,"num_write_kb":86798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'213","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.681739+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-18T00:47:31.681739+0000","last_peered":"2024-01-18T00:47:31.681739+0000","last_clean":"2024-01-18T00:47:31.681739+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-18T00:47:31.681739+0000","last_undegraded":"2024-01-18T00:47:31.681739+0000","last_fullsized":"2024-01-18T00:47:31.681739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'211","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.359210+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-18T00:48:18.359210+0000","last_peered":"2024-01-18T00:48:18.359210+0000","last_clean":"2024-01-18T00:48:18.359210+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-18T00:48:18.359210+0000","last_undegraded":"2024-01-18T00:48:18.359210+0000","last_fullsized":"2024-01-18T00:48:18.359210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'217","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.739709+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-18T00:48:18.739709+0000","last_peered":"2024-01-18T00:48:18.739709+0000","last_clean":"2024-01-18T00:48:18.739709+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-18T00:48:18.739709+0000","last_undegraded":"2024-01-18T00:48:18.739709+0000","last_fullsized":"2024-01-18T00:48:18.739709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'193","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.037327+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-18T00:48:27.037327+0000","last_peered":"2024-01-18T00:48:27.037327+0000","last_clean":"2024-01-18T00:48:27.037327+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-18T00:48:27.037327+0000","last_undegraded":"2024-01-18T00:48:27.037327+0000","last_fullsized":"2024-01-18T00:48:27.037327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'178","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.549940+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-18T00:48:06.549940+0000","last_peered":"2024-01-18T00:48:06.549940+0000","last_clean":"2024-01-18T00:48:06.549940+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-18T00:48:06.549940+0000","last_undegraded":"2024-01-18T00:48:06.549940+0000","last_fullsized":"2024-01-18T00:48:06.549940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'200","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588202+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-18T00:48:11.588202+0000","last_peered":"2024-01-18T00:48:11.588202+0000","last_clean":"2024-01-18T00:48:11.588202+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-18T00:48:11.588202+0000","last_undegraded":"2024-01-18T00:48:11.588202+0000","last_fullsized":"2024-01-18T00:48:11.588202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'233","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.492779+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-18T00:47:50.492779+0000","last_peered":"2024-01-18T00:47:50.492779+0000","last_clean":"2024-01-18T00:47:50.492779+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-18T00:47:50.492779+0000","last_undegraded":"2024-01-18T00:47:50.492779+0000","last_fullsized":"2024-01-18T00:47:50.492779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'196","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.038653+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-18T00:48:27.038653+0000","last_peered":"2024-01-18T00:48:27.038653+0000","last_clean":"2024-01-18T00:48:27.038653+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-18T00:48:27.038653+0000","last_undegraded":"2024-01-18T00:48:27.038653+0000","last_fullsized":"2024-01-18T00:48:27.038653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'201","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.512046+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-18T00:48:21.512046+0000","last_peered":"2024-01-18T00:48:21.512046+0000","last_clean":"2024-01-18T00:48:21.512046+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-18T00:48:21.512046+0000","last_undegraded":"2024-01-18T00:48:21.512046+0000","last_fullsized":"2024-01-18T00:48:21.512046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"29'195","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.788604+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-18T00:47:47.788604+0000","last_peered":"2024-01-18T00:47:47.788604+0000","last_clean":"2024-01-18T00:47:47.788604+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-18T00:47:47.788604+0000","last_undegraded":"2024-01-18T00:47:47.788604+0000","last_fullsized":"2024-01-18T00:47:47.788604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'198","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.448911+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-18T00:48:18.448911+0000","last_peered":"2024-01-18T00:48:18.448911+0000","last_clean":"2024-01-18T00:48:18.448911+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-18T00:48:18.448911+0000","last_undegraded":"2024-01-18T00:48:18.448911+0000","last_fullsized":"2024-01-18T00:48:18.448911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'193","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.884549+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-18T00:48:17.884549+0000","last_peered":"2024-01-18T00:48:17.884549+0000","last_clean":"2024-01-18T00:48:17.884549+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-18T00:48:17.884549+0000","last_undegraded":"2024-01-18T00:48:17.884549+0000","last_fullsized":"2024-01-18T00:48:17.884549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'219","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852868+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-18T00:48:17.852868+0000","last_peered":"2024-01-18T00:48:17.852868+0000","last_clean":"2024-01-18T00:48:17.852868+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-18T00:48:17.852868+0000","last_undegraded":"2024-01-18T00:48:17.852868+0000","last_fullsized":"2024-01-18T00:48:17.852868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'201","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.476599+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-18T00:48:06.476599+0000","last_peered":"2024-01-18T00:48:06.476599+0000","last_clean":"2024-01-18T00:48:06.476599+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-18T00:48:06.476599+0000","last_undegraded":"2024-01-18T00:48:06.476599+0000","last_fullsized":"2024-01-18T00:48:06.476599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'194","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.655244+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-18T00:47:56.655244+0000","last_peered":"2024-01-18T00:47:56.655244+0000","last_clean":"2024-01-18T00:47:56.655244+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-18T00:47:56.655244+0000","last_undegraded":"2024-01-18T00:47:56.655244+0000","last_fullsized":"2024-01-18T00:47:56.655244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'201","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.561292+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-18T00:48:06.561292+0000","last_peered":"2024-01-18T00:48:06.561292+0000","last_clean":"2024-01-18T00:48:06.561292+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-18T00:48:06.561292+0000","last_undegraded":"2024-01-18T00:48:06.561292+0000","last_fullsized":"2024-01-18T00:48:06.561292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'207","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.847721+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-18T00:47:47.847721+0000","last_peered":"2024-01-18T00:47:47.847721+0000","last_clean":"2024-01-18T00:47:47.847721+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-18T00:47:47.847721+0000","last_undegraded":"2024-01-18T00:47:47.847721+0000","last_fullsized":"2024-01-18T00:47:47.847721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'209","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.390971+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-18T00:48:18.390971+0000","last_peered":"2024-01-18T00:48:18.390971+0000","last_clean":"2024-01-18T00:48:18.390971+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-18T00:48:18.390971+0000","last_undegraded":"2024-01-18T00:48:18.390971+0000","last_fullsized":"2024-01-18T00:48:18.390971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'210","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.464378+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-18T00:48:27.464378+0000","last_peered":"2024-01-18T00:48:27.464378+0000","last_clean":"2024-01-18T00:48:27.464378+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-18T00:48:27.464378+0000","last_undegraded":"2024-01-18T00:48:27.464378+0000","last_fullsized":"2024-01-18T00:48:27.464378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580753+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:06.580753+0000","last_peered":"2024-01-18T00:48:06.580753+0000","last_clean":"2024-01-18T00:48:06.580753+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-18T00:48:06.580753+0000","last_undegraded":"2024-01-18T00:48:06.580753+0000","last_fullsized":"2024-01-18T00:48:06.580753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'168","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.006831+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-18T00:47:31.006831+0000","last_peered":"2024-01-18T00:47:31.006831+0000","last_clean":"2024-01-18T00:47:31.006831+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-18T00:47:31.006831+0000","last_undegraded":"2024-01-18T00:47:31.006831+0000","last_fullsized":"2024-01-18T00:47:31.006831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'170","reported_seq":232,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.868399+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-18T00:48:11.868399+0000","last_peered":"2024-01-18T00:48:11.868399+0000","last_clean":"2024-01-18T00:48:11.868399+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-18T00:48:11.868399+0000","last_undegraded":"2024-01-18T00:48:11.868399+0000","last_fullsized":"2024-01-18T00:48:11.868399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.933683+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-18T00:48:06.933683+0000","last_peered":"2024-01-18T00:48:06.933683+0000","last_clean":"2024-01-18T00:48:06.933683+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-18T00:48:06.933683+0000","last_undegraded":"2024-01-18T00:48:06.933683+0000","last_fullsized":"2024-01-18T00:48:06.933683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'213","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121880+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-18T00:48:07.121880+0000","last_peered":"2024-01-18T00:48:07.121880+0000","last_clean":"2024-01-18T00:48:07.121880+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-18T00:48:07.121880+0000","last_undegraded":"2024-01-18T00:48:07.121880+0000","last_fullsized":"2024-01-18T00:48:07.121880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'191","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.997850+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-18T00:47:50.997850+0000","last_peered":"2024-01-18T00:47:50.997850+0000","last_clean":"2024-01-18T00:47:50.997850+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-18T00:47:50.997850+0000","last_undegraded":"2024-01-18T00:47:50.997850+0000","last_fullsized":"2024-01-18T00:47:50.997850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'198","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.354485+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-18T00:48:06.354485+0000","last_peered":"2024-01-18T00:48:06.354485+0000","last_clean":"2024-01-18T00:48:06.354485+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-18T00:48:06.354485+0000","last_undegraded":"2024-01-18T00:48:06.354485+0000","last_fullsized":"2024-01-18T00:48:06.354485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"29'186","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.304696+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-18T00:48:27.304696+0000","last_peered":"2024-01-18T00:48:27.304696+0000","last_clean":"2024-01-18T00:48:27.304696+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-18T00:48:27.304696+0000","last_undegraded":"2024-01-18T00:48:27.304696+0000","last_fullsized":"2024-01-18T00:48:27.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'201","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.077386+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-18T00:48:12.077386+0000","last_peered":"2024-01-18T00:48:12.077386+0000","last_clean":"2024-01-18T00:48:12.077386+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-18T00:48:12.077386+0000","last_undegraded":"2024-01-18T00:48:12.077386+0000","last_fullsized":"2024-01-18T00:48:12.077386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'188","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.009420+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-18T00:48:06.009420+0000","last_peered":"2024-01-18T00:48:06.009420+0000","last_clean":"2024-01-18T00:48:06.009420+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-18T00:48:06.009420+0000","last_undegraded":"2024-01-18T00:48:06.009420+0000","last_fullsized":"2024-01-18T00:48:06.009420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'186","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.576118+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-18T00:48:06.576118+0000","last_peered":"2024-01-18T00:48:06.576118+0000","last_clean":"2024-01-18T00:48:06.576118+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-18T00:48:06.576118+0000","last_undegraded":"2024-01-18T00:48:06.576118+0000","last_fullsized":"2024-01-18T00:48:06.576118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'194","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588232+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-18T00:48:11.588232+0000","last_peered":"2024-01-18T00:48:11.588232+0000","last_clean":"2024-01-18T00:48:11.588232+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-18T00:48:11.588232+0000","last_undegraded":"2024-01-18T00:48:11.588232+0000","last_fullsized":"2024-01-18T00:48:11.588232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.632621+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-18T00:48:18.632621+0000","last_peered":"2024-01-18T00:48:18.632621+0000","last_clean":"2024-01-18T00:48:18.632621+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-18T00:48:18.632621+0000","last_undegraded":"2024-01-18T00:48:18.632621+0000","last_fullsized":"2024-01-18T00:48:18.632621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1182,"num_read_kb":3686645,"num_write":24415,"num_write_kb":4363145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24889,"ondisk_log_size":24889,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12706,"ondisk_log_size":12706,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198011224,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":22099,"num_write_kb":205979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180715520,"data_stored":396031514,"data_compressed":51429318,"data_compressed_allocated":69492736,"data_compressed_original":284966912,"omap_allocated":0,"internal_metadata":0},"log_size":21660,"ondisk_log_size":21660,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62450,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510747,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139336,"kb_used_data":31872,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94232504,"statfs":{"total":96636764160,"available":96494084096,"internally_reserved":0,"allocated":32636928,"data_stored":76231775,"data_compressed":10068524,"data_compressed_allocated":13414400,"data_compressed_original":57212928,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.91100000000000003,"15min":0.88600000000000001},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1259999999999999,"5min":1.377,"15min":1.377},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.54400000000000004,"15min":0.34599999999999997},"max":{"1min":1.5,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.468,"15min":1.4830000000000001},"last":0.755}]},{"osd":2,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":0.86699999999999999},"min":{"1min":0.622,"5min":0.53600000000000003,"15min":0.47099999999999997},"max":{"1min":1.181,"5min":1.302,"15min":1.619},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.002,"15min":0.97499999999999998},"min":{"1min":0.76700000000000002,"5min":0.58299999999999996,"15min":0.45900000000000002},"max":{"1min":1.6240000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.163}]},{"osd":3,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92500000000000004,"15min":0.92800000000000005},"min":{"1min":0.76700000000000002,"5min":0.55700000000000005,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.3600000000000001,"15min":1.718},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.093,"5min":1.0640000000000001,"15min":1.036},"min":{"1min":0.72499999999999998,"5min":0.65500000000000003,"15min":0.65400000000000003},"max":{"1min":1.7450000000000001,"5min":1.996,"15min":1.996},"last":1.264}]},{"osd":4,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41499999999999998},"max":{"1min":1.4039999999999999,"5min":1.7470000000000001,"15min":1.7929999999999999},"last":1.2},{"interface":"front","average":{"1min":1.028,"5min":1.0429999999999999,"15min":1.02},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4359999999999999,"5min":1.5489999999999999,"15min":1.8700000000000001},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1559999999999999,"15min":1.1040000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.44700000000000001},"max":{"1min":1.8360000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.347},{"interface":"front","average":{"1min":1.131,"5min":1.1399999999999999,"15min":1.101},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":1.4830000000000001,"5min":1.8500000000000001,"15min":1.994},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.585,"5min":1.6319999999999999,"15min":1.891},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.69399999999999995,"5min":0.64500000000000002,"15min":0.44900000000000001},"max":{"1min":1.5760000000000001,"5min":1.6739999999999999,"15min":1.97},"last":1.387}]}]},{"osd":6,"up_from":15,"seq":64424510748,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138864,"kb_used_data":23080,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94232976,"statfs":{"total":96636764160,"available":96494567424,"internally_reserved":0,"allocated":23633920,"data_stored":54035657,"data_compressed":6966432,"data_compressed_allocated":9547776,"data_compressed_original":40148992,"omap_allocated":1594,"internal_metadata":118553030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.36299999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.427},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.871,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.41199999999999998},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.6379999999999999},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.86499999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47699999999999998},"max":{"1min":1.264,"5min":1.357,"15min":1.607},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.40899999999999997},"max":{"1min":1.3600000000000001,"5min":1.466,"15min":1.466},"last":0.97099999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.501},"max":{"1min":1.272,"5min":1.756,"15min":1.756},"last":1.02},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0049999999999999,"15min":1.0409999999999999},"min":{"1min":0.66400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.4209999999999998},"last":1.139}]},{"osd":3,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.53400000000000003},"max":{"1min":1.347,"5min":1.347,"15min":2.3180000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4359999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0900000000000001,"15min":1.0469999999999999},"min":{"1min":0.53800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4770000000000001,"5min":1.964,"15min":1.964},"last":1.212},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.40799999999999997},"max":{"1min":1.353,"5min":2.1339999999999999,"15min":2.3439999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0489999999999999,"15min":1.0669999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.3879999999999999,"5min":1.585,"15min":2.4849999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":1.161},"min":{"1min":0.82899999999999996,"5min":0.56200000000000006,"15min":0.55700000000000005},"max":{"1min":1.6100000000000001,"5min":2.0609999999999999,"15min":2.1400000000000001},"last":1.103}]},{"osd":7,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.099},"min":{"1min":0.66400000000000003,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":1.7430000000000001,"5min":1.837,"15min":1.8959999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.2030000000000001},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.41799999999999998},"max":{"1min":1.831,"5min":1.8819999999999999,"15min":2.5979999999999999},"last":1.256}]}]},{"osd":5,"up_from":15,"seq":64424510748,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123852,"kb_used_data":20548,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94247988,"statfs":{"total":96636764160,"available":96509939712,"internally_reserved":0,"allocated":21041152,"data_stored":42185087,"data_compressed":5247559,"data_compressed_allocated":7098368,"data_compressed_original":28442624,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88800000000000001,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89400000000000002,"15min":0.88100000000000001},"min":{"1min":0.57099999999999995,"5min":0.49399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3740000000000001,"5min":1.482,"15min":1.482},"last":0.748}]},{"osd":1,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.875,"15min":0.86299999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.2350000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.92300000000000004},"min":{"1min":0.59899999999999998,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.512,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.92500000000000004,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.502,"15min":1.5469999999999999},"last":0.88},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":0.92200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.51900000000000002},"max":{"1min":1.369,"5min":1.4690000000000001,"15min":1.6160000000000001},"last":1.111},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0469999999999999,"15min":1.036},"min":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.624},"max":{"1min":1.232,"5min":1.5620000000000001,"15min":1.6919999999999999},"last":1.492}]},{"osd":4,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.02,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.387,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.097},"min":{"1min":0.629,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":1.589,"5min":1.6639999999999999,"15min":1.7709999999999999},"last":1.419}]},{"osd":6,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.119,"15min":1.125},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.51700000000000002},"max":{"1min":1.462,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.379},{"interface":"front","average":{"1min":1.022,"5min":1.1379999999999999,"15min":1.123},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.39000000000000001},"max":{"1min":1.3580000000000001,"5min":2.032,"15min":2.032},"last":1.4530000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.216,"15min":1.2010000000000001},"min":{"1min":0.82599999999999996,"5min":0.58699999999999997,"15min":0.35099999999999998},"max":{"1min":1.925,"5min":1.925,"15min":2.04},"last":1.216},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2370000000000001,"15min":1.2310000000000001},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.56599999999999995},"max":{"1min":1.421,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.5720000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510748,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138676,"kb_used_data":21484,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94233164,"statfs":{"total":96636764160,"available":96494759936,"internally_reserved":0,"allocated":21999616,"data_stored":43677383,"data_compressed":5325157,"data_compressed_allocated":7430144,"data_compressed_original":29310976,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":0.78300000000000003,"15min":0.94199999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83799999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34399999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.91100000000000003},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.587},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.82499999999999996,"15min":0.80000000000000004},"min":{"1min":0.72499999999999998,"5min":0.52700000000000002,"15min":0.48999999999999999},"max":{"1min":1.1399999999999999,"5min":1.296,"15min":1.296},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.48099999999999998},"max":{"1min":1.141,"5min":1.2789999999999999,"15min":1.3080000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.46999999999999997},"max":{"1min":1.028,"5min":1.1599999999999999,"15min":1.1879999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.22,"15min":1.3109999999999999},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.497},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.5620000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85499999999999998,"15min":0.85799999999999998},"min":{"1min":0.69899999999999995,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.256},"last":0.88300000000000001}]}]},{"osd":1,"up_from":15,"seq":64424510750,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141112,"kb_used_data":23920,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94230728,"statfs":{"total":96636764160,"available":96492265472,"internally_reserved":0,"allocated":24494080,"data_stored":54759373,"data_compressed":7394072,"data_compressed_allocated":9871360,"data_compressed_original":40341504,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.438,"15min":0.44},"min":{"1min":0.308,"5min":0.25,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.32500000000000001,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.73099999999999998,"5min":0.74099999999999999,"15min":1.2749999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.0329999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.28699999999999998},"max":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.83799999999999997},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.33400000000000002},"max":{"1min":0.84299999999999997,"5min":0.84899999999999998,"15min":1.375},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":1.2410000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0389999999999999,"5min":1.1839999999999999,"15min":1.3220000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2210000000000001,"5min":1.2629999999999999,"15min":1.5660000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51200000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.222},"last":1.01}]},{"osd":6,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.83899999999999997,"15min":0.83399999999999996},"min":{"1min":0.51600000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1559999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83199999999999996,"15min":0.83099999999999996},"min":{"1min":0.65000000000000002,"5min":0.505,"15min":0.497},"max":{"1min":1.0960000000000001,"5min":1.357,"15min":1.357},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 18 00:47:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86599999999999999,"15min":0.85799999999999998},"min":{"1min":0.64300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2669999999999999,"5min":1.298,"15min":1.4239999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.59699999999999998,"5min":0.57699999999999996,"15min":0.53200000000000003},"max":{"1min":1.28,"5min":1.339,"15min":1.341},"last":1.0660000000000001}]}]},{"osd":0,"up_from":15,"seq":64424510748,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108180,"kb_used_data":18764,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263660,"statfs":{"total":96636764160,"available":96525987840,"internally_reserved":0,"allocated":19214336,"data_stored":46928081,"data_compressed":6415220,"data_compressed_allocated":8437760,"data_compressed_original":36352000,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.79400000000000004},"last":0.499},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70899999999999996,"5min":0.752,"15min":1.0369999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.79500000000000004,"15min":0.81599999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.44,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":1.2350000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.1759999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.90100000000000002,"15min":0.93300000000000005},"last":0.75}]},{"osd":4,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.44600000000000001},"max":{"1min":0.96699999999999997,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.133,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.083,"15min":1.2869999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.335,"15min":1.335},"last":0.98199999999999998}]},{"osd":6,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.52100000000000002},"max":{"1min":1.1619999999999999,"5min":1.377,"15min":1.5649999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.69999999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0349999999999999,"5min":1.2190000000000001,"15min":1.266},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1659999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.411,"15min":1.411},"last":1.155}]}]},{"osd":4,"up_from":14,"seq":60129543454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139424,"kb_used_data":27800,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94232416,"statfs":{"total":96636764160,"available":96493993984,"internally_reserved":0,"allocated":28467200,"data_stored":58171708,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86799999999999999,"15min":0.874},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.286,"5min":1.488,"15min":1.488},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.363,"5min":1.506,"15min":1.506},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0049999999999999,"15min":0.95999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44600000000000001},"max":{"1min":1.3660000000000001,"5min":1.522,"15min":1.5329999999999999},"last":0.747},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.872},"min":{"1min":0.42799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2290000000000001,"5min":1.6200000000000001,"15min":1.7589999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54800000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.353,"5min":1.5429999999999999,"15min":1.587},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0629999999999999,"15min":1.018},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":1.5940000000000001,"15min":1.639},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.405,"5min":1.423,"15min":1.8240000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.03},"min":{"1min":0.70899999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.423,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0569999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46700000000000003},"max":{"1min":1.476,"5min":1.76,"15min":1.76},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":1.7849999999999999,"5min":1.8240000000000001,"15min":2.1960000000000002},"last":1.1970000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.7210000000000001,"5min":1.992,"15min":1.992},"last":1.276},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":1.631,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.371}]},{"osd":7,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1439999999999999,"15min":1.137},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8580000000000001,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.341},{"interface":"front","average":{"1min":1.266,"5min":1.224,"15min":1.2270000000000001},"min":{"1min":0.80400000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5089999999999999,"5min":1.9279999999999999,"15min":2.0110000000000001},"last":1.4990000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79108,"kb_used_data":11900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94292732,"statfs":{"total":96636764160,"available":96555757568,"internally_reserved":0,"allocated":12185600,"data_stored":22655891,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":0.877},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.76300000000000001,"15min":0.82399999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.87},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.052,"5min":1.359,"15min":1.359},"last":0.5},{"interface":"front","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.46300000000000002},"max":{"1min":0.96799999999999997,"5min":1.0900000000000001,"15min":1.3140000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":1.087,"5min":1.3100000000000001,"15min":1.3420000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.81899999999999995},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.998,"5min":1.196,"15min":1.3480000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.52500000000000002},"max":{"1min":1.079,"5min":1.254,"15min":1.476},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.56399999999999995,"15min":0.45100000000000001},"max":{"1min":1,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86099999999999999,"15min":0.85999999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.48299999999999998},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18784256,"data_stored":46138004,"data_compressed":6372185,"data_compressed_allocated":8384512,"data_compressed_original":35753984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24100864,"data_stored":54526896,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":22530423,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":43502250,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28160000,"data_stored":58046864,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":41944418,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23252992,"data_stored":53843617,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":75499042,"data_compressed":10037299,"data_compressed_allocated":13373440,"data_compressed_original":56639488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:48:34.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:48:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 Processor -- start 2024-01-18T00:48:34.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 -- start start 2024-01-18T00:48:34.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05140c8a30 0x7f05140c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140c7d10 con 0x7f051415b620 2024-01-18T00:48:34.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05141576d0 con 0x7f05141517f0 2024-01-18T00:48:34.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f051bc00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0514157970 con 0x7f05140c8a30 2024-01-18T00:48:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f0519c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f05140c8a30 0x7f05140c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f0519200640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f05141517f0 0x7f05140ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:40246/0 (socket says 172.21.15.67:40246) 2024-01-18T00:48:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f0519200640 1 -- 172.21.15.67:0/2115068889 learned_addr learned my addr 172.21.15.67:0/2115068889 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:34.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.813+0000 7f0513e00640 1 --1- 172.21.15.67:0/2115068889 >> v1:172.21.15.67:6789/0 conn(0x7f051415b620 0x7f0514061100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35196/0 (socket says 172.21.15.67:35196) 2024-01-18T00:48:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.817+0000 7f0519c00640 1 -- 172.21.15.67:0/2115068889 >> v1:172.21.15.137:6789/0 conn(0x7f05141517f0 legacy=0x7f05140ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.817+0000 7f0519c00640 1 -- 172.21.15.67:0/2115068889 >> v1:172.21.15.67:6789/0 conn(0x7f051415b620 legacy=0x7f0514061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.817+0000 7f0519c00640 1 -- 172.21.15.67:0/2115068889 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514157c50 con 0x7f05140c8a30 2024-01-18T00:48:34.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.825+0000 7f0519c00640 1 --2- 172.21.15.67:0/2115068889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05140c8e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f050c009d90 tx=0x7f050c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ce16f271532a16 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.825+0000 7f0513400640 1 -- 172.21.15.67:0/2115068889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a5a10 con 0x7f05140c8a30 2024-01-18T00:48:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f0513400640 1 -- 172.21.15.67:0/2115068889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0a5b70 con 0x7f05140c8a30 2024-01-18T00:48:34.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f0513400640 1 -- 172.21.15.67:0/2115068889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0ad440 con 0x7f05140c8a30 2024-01-18T00:48:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- 172.21.15.67:0/2115068889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 msgr2=0x7f05140c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 --2- 172.21.15.67:0/2115068889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05140c8e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f050c009d90 tx=0x7f050c01c950 comp rx=0 tx=0).stop 2024-01-18T00:48:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- 172.21.15.67:0/2115068889 shutdown_connections 2024-01-18T00:48:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 --2- 172.21.15.67:0/2115068889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05140c8e10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- 172.21.15.67:0/2115068889 >> 172.21.15.67:0/2115068889 conn(0x7f051406ad40 msgr2=0x7f051406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- 172.21.15.67:0/2115068889 shutdown_connections 2024-01-18T00:48:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- 172.21.15.67:0/2115068889 wait complete. 2024-01-18T00:48:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 Processor -- start 2024-01-18T00:48:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- start start 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05141517f0 0x7f05141f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f051415b620 0x7f05141f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140b0800 con 0x7f05140c8a30 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141f39c0 con 0x7f051415b620 2024-01-18T00:48:34.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.829+0000 7f051bc00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140b14f0 con 0x7f05141517f0 2024-01-18T00:48:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.833+0000 7f0519200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.833+0000 7f0519200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36154/0 (socket says 172.21.15.67:36154) 2024-01-18T00:48:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.833+0000 7f0519200640 1 -- 172.21.15.67:0/55571356 learned_addr learned my addr 172.21.15.67:0/55571356 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.833+0000 7f0519c00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f051415b620 0x7f05141f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.833+0000 7f0513e00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05141517f0 0x7f05141f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 -- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05141517f0 msgr2=0x7f05141f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05141517f0 0x7f05141f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 -- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f051415b620 msgr2=0x7f05141f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f051415b620 0x7f05141f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 -- 172.21.15.67:0/55571356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009a70 con 0x7f05140c8a30 2024-01-18T00:48:34.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.837+0000 7f0519200640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f050400c500 tx=0x7f050400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.841+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504005cf0 con 0x7f05140c8a30 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.841+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504005e50 con 0x7f05140c8a30 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.841+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140b17d0 con 0x7f05140c8a30 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.841+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040072f0 con 0x7f05140c8a30 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.841+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05140b1d90 con 0x7f05140c8a30 2024-01-18T00:48:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.845+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051406b620 con 0x7f05140c8a30 2024-01-18T00:48:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.865+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0504007450 con 0x7f05140c8a30 2024-01-18T00:48:34.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.865+0000 7f0510c00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 0x7f04ec068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:34.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.865+0000 7f0513e00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 0x7f04ec068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:34.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:34.865+0000 7f0513e00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 0x7f04ec068d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f051415afd0 tx=0x7f04fc007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.113+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0504054ad0 con 0x7f05140c8a30 2024-01-18T00:48:35.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.113+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f0504050e10 con 0x7f05140c8a30 2024-01-18T00:48:35.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.273+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05141508b0 con 0x7f04ec066840 2024-01-18T00:48:35.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.301+0000 7f0510c00640 1 -- 172.21.15.67:0/55571356 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371330 (secure 0 0 0) 0x7f05141508b0 con 0x7f04ec066840 2024-01-18T00:48:35.305 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:35.307 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 msgr2=0x7f04ec068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 0x7f04ec068d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f051415afd0 tx=0x7f04fc007e90 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 msgr2=0x7f05141f4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f050400c500 tx=0x7f050400c9c0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 shutdown_connections 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f04ec066840 0x7f04ec068d00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f051415b620 0x7f05141f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f05141517f0 0x7f05141f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 --2- 172.21.15.67:0/55571356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05140c8a30 0x7f05141f4dd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 >> 172.21.15.67:0/55571356 conn(0x7f051406ad40 msgr2=0x7f05141622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:35.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 shutdown_connections 2024-01-18T00:48:35.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.305+0000 7f051bc00640 1 -- 172.21.15.67:0/55571356 wait complete. 2024-01-18T00:48:35.326 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":3289,"stamp":"2024-01-18T00:48:34.740938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198613937,"num_objects":110,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":3112,"num_read_kb":3689624,"num_write":46730,"num_write_kb":4572599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59425,"ondisk_log_size":59425,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1008192,"kb_used_data":179008,"kb_used_omap":12,"kb_used_meta":829107,"kb_avail":753966528,"statfs":{"total":773094113280,"available":772061724672,"internally_reserved":0,"allocated":183304192,"data_stored":398228540,"data_compressed":51491768,"data_compressed_allocated":69574656,"data_compressed_original":286113792,"omap_allocated":12752,"internal_metadata":849006128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-190864,"num_objects":-65,"num_object_clones":0,"num_object_copies":-260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-65,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":102,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005502"},"pg_stats":[{"pgid":"2.1f","version":"29'348","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'182","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.611708+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:18.611708+0000","last_peered":"2024-01-18T00:48:18.611708+0000","last_clean":"2024-01-18T00:48:18.611708+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-18T00:48:18.611708+0000","last_undegraded":"2024-01-18T00:48:18.611708+0000","last_fullsized":"2024-01-18T00:48:18.611708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'802","reported_seq":906,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065083+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-18T00:48:21.065083+0000","last_peered":"2024-01-18T00:48:21.065083+0000","last_clean":"2024-01-18T00:48:21.065083+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-18T00:48:21.065083+0000","last_undegraded":"2024-01-18T00:48:21.065083+0000","last_fullsized":"2024-01-18T00:48:21.065083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":142138,"num_write":787,"num_write_kb":155519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'554","reported_seq":627,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:52.788197+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-18T00:46:52.788197+0000","last_peered":"2024-01-18T00:46:52.788197+0000","last_clean":"2024-01-18T00:46:52.788197+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-18T00:46:52.788197+0000","last_undegraded":"2024-01-18T00:46:52.788197+0000","last_fullsized":"2024-01-18T00:46:52.788197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'168","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.517228+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-18T00:48:00.517228+0000","last_peered":"2024-01-18T00:48:00.517228+0000","last_clean":"2024-01-18T00:48:00.517228+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-18T00:48:00.517228+0000","last_undegraded":"2024-01-18T00:48:00.517228+0000","last_fullsized":"2024-01-18T00:48:00.517228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'820","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.292642+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-18T00:48:21.292642+0000","last_peered":"2024-01-18T00:48:21.292642+0000","last_clean":"2024-01-18T00:48:21.292642+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-18T00:48:21.292642+0000","last_undegraded":"2024-01-18T00:48:21.292642+0000","last_fullsized":"2024-01-18T00:48:21.292642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":112120,"num_write":807,"num_write_kb":168152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1017","reported_seq":1080,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:45.207860+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-18T00:46:45.207860+0000","last_peered":"2024-01-18T00:46:45.207860+0000","last_clean":"2024-01-18T00:46:45.207860+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-18T00:46:45.207860+0000","last_undegraded":"2024-01-18T00:46:45.207860+0000","last_fullsized":"2024-01-18T00:46:45.207860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":12756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'181","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.732391+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-18T00:47:50.732391+0000","last_peered":"2024-01-18T00:47:50.732391+0000","last_clean":"2024-01-18T00:47:50.732391+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-18T00:47:50.732391+0000","last_undegraded":"2024-01-18T00:47:50.732391+0000","last_fullsized":"2024-01-18T00:47:50.732391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'736","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.474364+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-18T00:48:18.474364+0000","last_peered":"2024-01-18T00:48:18.474364+0000","last_clean":"2024-01-18T00:48:18.474364+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-18T00:48:18.474364+0000","last_undegraded":"2024-01-18T00:48:18.474364+0000","last_fullsized":"2024-01-18T00:48:18.474364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":76820,"num_write":722,"num_write_kb":119762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'829","reported_seq":892,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.309570+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-18T00:47:15.309570+0000","last_peered":"2024-01-18T00:47:15.309570+0000","last_clean":"2024-01-18T00:47:15.309570+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-18T00:47:15.309570+0000","last_undegraded":"2024-01-18T00:47:15.309570+0000","last_fullsized":"2024-01-18T00:47:15.309570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'198","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.728104+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-18T00:47:50.728104+0000","last_peered":"2024-01-18T00:47:50.728104+0000","last_clean":"2024-01-18T00:47:50.728104+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-18T00:47:50.728104+0000","last_undegraded":"2024-01-18T00:47:50.728104+0000","last_fullsized":"2024-01-18T00:47:50.728104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'727","reported_seq":813,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.363639+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-18T00:48:27.363639+0000","last_peered":"2024-01-18T00:48:27.363639+0000","last_clean":"2024-01-18T00:48:27.363639+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-18T00:48:27.363639+0000","last_undegraded":"2024-01-18T00:48:27.363639+0000","last_fullsized":"2024-01-18T00:48:27.363639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":89221,"num_write":717,"num_write_kb":93426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'209","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.840216+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-18T00:48:11.840216+0000","last_peered":"2024-01-18T00:48:11.840216+0000","last_clean":"2024-01-18T00:48:11.840216+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-18T00:48:11.840216+0000","last_undegraded":"2024-01-18T00:48:11.840216+0000","last_fullsized":"2024-01-18T00:48:11.840216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'1218","reported_seq":1286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.212940+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-18T00:46:56.212940+0000","last_peered":"2024-01-18T00:46:56.212940+0000","last_clean":"2024-01-18T00:46:56.212940+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-18T00:46:56.212940+0000","last_undegraded":"2024-01-18T00:46:56.212940+0000","last_fullsized":"2024-01-18T00:46:56.212940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1218,"log_dups_size":0,"ondisk_log_size":1218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'784","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:19.037590+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-18T00:48:19.037590+0000","last_peered":"2024-01-18T00:48:19.037590+0000","last_clean":"2024-01-18T00:48:19.037590+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-18T00:48:19.037590+0000","last_undegraded":"2024-01-18T00:48:19.037590+0000","last_fullsized":"2024-01-18T00:48:19.037590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":112181,"num_write":768,"num_write_kb":146877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'214","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.281219+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-18T00:48:27.281219+0000","last_peered":"2024-01-18T00:48:27.281219+0000","last_clean":"2024-01-18T00:48:27.281219+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-18T00:48:27.281219+0000","last_undegraded":"2024-01-18T00:48:27.281219+0000","last_fullsized":"2024-01-18T00:48:27.281219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1250","reported_seq":1319,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:02.865589+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-18T00:47:02.865589+0000","last_peered":"2024-01-18T00:47:02.865589+0000","last_clean":"2024-01-18T00:47:02.865589+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-18T00:47:02.865589+0000","last_undegraded":"2024-01-18T00:47:02.865589+0000","last_fullsized":"2024-01-18T00:47:02.865589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'844","reported_seq":945,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.741571+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-18T00:48:21.741571+0000","last_peered":"2024-01-18T00:48:21.741571+0000","last_clean":"2024-01-18T00:48:21.741571+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-18T00:48:21.741571+0000","last_undegraded":"2024-01-18T00:48:21.741571+0000","last_fullsized":"2024-01-18T00:48:21.741571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":112670,"num_write":833,"num_write_kb":127477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'206","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.744028+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-18T00:48:18.744028+0000","last_peered":"2024-01-18T00:48:18.744028+0000","last_clean":"2024-01-18T00:48:18.744028+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-18T00:48:18.744028+0000","last_undegraded":"2024-01-18T00:48:18.744028+0000","last_fullsized":"2024-01-18T00:48:18.744028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'322","reported_seq":391,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.211893+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-18T00:46:56.211893+0000","last_peered":"2024-01-18T00:46:56.211893+0000","last_clean":"2024-01-18T00:46:56.211893+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-18T00:46:56.211893+0000","last_undegraded":"2024-01-18T00:46:56.211893+0000","last_fullsized":"2024-01-18T00:46:56.211893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'756","reported_seq":866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.928596+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-18T00:48:06.928596+0000","last_peered":"2024-01-18T00:48:06.928596+0000","last_clean":"2024-01-18T00:48:06.928596+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-18T00:48:06.928596+0000","last_undegraded":"2024-01-18T00:48:06.928596+0000","last_fullsized":"2024-01-18T00:48:06.928596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":171173,"num_write":745,"num_write_kb":212620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'217","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.076382+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-18T00:48:12.076382+0000","last_peered":"2024-01-18T00:48:12.076382+0000","last_clean":"2024-01-18T00:48:12.076382+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-18T00:48:12.076382+0000","last_undegraded":"2024-01-18T00:48:12.076382+0000","last_fullsized":"2024-01-18T00:48:12.076382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'229","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:27.834845+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-18T00:46:27.834845+0000","last_peered":"2024-01-18T00:46:27.834845+0000","last_clean":"2024-01-18T00:46:27.834845+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-18T00:46:27.834845+0000","last_undegraded":"2024-01-18T00:46:27.834845+0000","last_fullsized":"2024-01-18T00:46:27.834845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'704","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071298+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-18T00:48:27.071298+0000","last_peered":"2024-01-18T00:48:27.071298+0000","last_clean":"2024-01-18T00:48:27.071298+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-18T00:48:27.071298+0000","last_undegraded":"2024-01-18T00:48:27.071298+0000","last_fullsized":"2024-01-18T00:48:27.071298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42617,"num_write":681,"num_write_kb":68844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'215","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.469520+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-18T00:47:35.469520+0000","last_peered":"2024-01-18T00:47:35.469520+0000","last_clean":"2024-01-18T00:47:35.469520+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-18T00:47:35.469520+0000","last_undegraded":"2024-01-18T00:47:35.469520+0000","last_fullsized":"2024-01-18T00:47:35.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'302","reported_seq":371,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.114429+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-18T00:46:51.114429+0000","last_peered":"2024-01-18T00:46:51.114429+0000","last_clean":"2024-01-18T00:46:51.114429+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-18T00:46:51.114429+0000","last_undegraded":"2024-01-18T00:46:51.114429+0000","last_fullsized":"2024-01-18T00:46:51.114429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'837","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050116+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-18T00:48:21.050116+0000","last_peered":"2024-01-18T00:48:21.050116+0000","last_clean":"2024-01-18T00:48:21.050116+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-18T00:48:21.050116+0000","last_undegraded":"2024-01-18T00:48:21.050116+0000","last_fullsized":"2024-01-18T00:48:21.050116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":234919,"num_write":817,"num_write_kb":206693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'178","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.791280+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-18T00:48:05.791280+0000","last_peered":"2024-01-18T00:48:05.791280+0000","last_clean":"2024-01-18T00:48:05.791280+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-18T00:48:05.791280+0000","last_undegraded":"2024-01-18T00:48:05.791280+0000","last_fullsized":"2024-01-18T00:48:05.791280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'1185","reported_seq":1254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:26.221101+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-18T00:48:26.221101+0000","last_peered":"2024-01-18T00:48:26.221101+0000","last_clean":"2024-01-18T00:48:26.221101+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-18T00:48:26.221101+0000","last_undegraded":"2024-01-18T00:48:26.221101+0000","last_fullsized":"2024-01-18T00:48:26.221101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3145,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'823","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065709+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-18T00:48:21.065709+0000","last_peered":"2024-01-18T00:48:21.065709+0000","last_clean":"2024-01-18T00:48:21.065709+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-18T00:48:21.065709+0000","last_undegraded":"2024-01-18T00:48:21.065709+0000","last_fullsized":"2024-01-18T00:48:21.065709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":136936,"num_write":807,"num_write_kb":135857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'196","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.530724+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-18T00:48:00.530724+0000","last_peered":"2024-01-18T00:48:00.530724+0000","last_clean":"2024-01-18T00:48:00.530724+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-18T00:48:00.530724+0000","last_undegraded":"2024-01-18T00:48:00.530724+0000","last_fullsized":"2024-01-18T00:48:00.530724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'794","reported_seq":865,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:12.091765+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-18T00:47:12.091765+0000","last_peered":"2024-01-18T00:47:12.091765+0000","last_clean":"2024-01-18T00:47:12.091765+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-18T00:47:12.091765+0000","last_undegraded":"2024-01-18T00:47:12.091765+0000","last_fullsized":"2024-01-18T00:47:12.091765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'751","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.040646+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-18T00:48:27.040646+0000","last_peered":"2024-01-18T00:48:27.040646+0000","last_clean":"2024-01-18T00:48:27.040646+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-18T00:48:27.040646+0000","last_undegraded":"2024-01-18T00:48:27.040646+0000","last_fullsized":"2024-01-18T00:48:27.040646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":97762,"num_write":737,"num_write_kb":97911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'206","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.314434+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-18T00:48:11.314434+0000","last_peered":"2024-01-18T00:48:11.314434+0000","last_clean":"2024-01-18T00:48:11.314434+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-18T00:48:11.314434+0000","last_undegraded":"2024-01-18T00:48:11.314434+0000","last_fullsized":"2024-01-18T00:48:11.314434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'268","reported_seq":339,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:40.383292+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-18T00:45:40.383292+0000","last_peered":"2024-01-18T00:45:40.383292+0000","last_clean":"2024-01-18T00:45:40.383292+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-18T00:45:40.383292+0000","last_undegraded":"2024-01-18T00:45:40.383292+0000","last_fullsized":"2024-01-18T00:45:40.383292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'803","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.079182+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-18T00:48:27.079182+0000","last_peered":"2024-01-18T00:48:27.079182+0000","last_clean":"2024-01-18T00:48:27.079182+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-18T00:48:27.079182+0000","last_undegraded":"2024-01-18T00:48:27.079182+0000","last_fullsized":"2024-01-18T00:48:27.079182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":142135,"num_write":790,"num_write_kb":151473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.756635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-18T00:48:18.756635+0000","last_peered":"2024-01-18T00:48:18.756635+0000","last_clean":"2024-01-18T00:48:18.756635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-18T00:48:18.756635+0000","last_undegraded":"2024-01-18T00:48:18.756635+0000","last_fullsized":"2024-01-18T00:48:18.756635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'959","reported_seq":1030,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:14.158415+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-18T00:45:14.158415+0000","last_peered":"2024-01-18T00:45:14.158415+0000","last_clean":"2024-01-18T00:45:14.158415+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-18T00:45:14.158415+0000","last_undegraded":"2024-01-18T00:45:14.158415+0000","last_fullsized":"2024-01-18T00:45:14.158415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'706","reported_seq":806,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.550784+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-18T00:48:06.550784+0000","last_peered":"2024-01-18T00:48:06.550784+0000","last_clean":"2024-01-18T00:48:06.550784+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-18T00:48:06.550784+0000","last_undegraded":"2024-01-18T00:48:06.550784+0000","last_fullsized":"2024-01-18T00:48:06.550784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":104293,"num_write":696,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'197","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.043178+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-18T00:48:21.043178+0000","last_peered":"2024-01-18T00:48:21.043178+0000","last_clean":"2024-01-18T00:48:21.043178+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-18T00:48:21.043178+0000","last_undegraded":"2024-01-18T00:48:21.043178+0000","last_fullsized":"2024-01-18T00:48:21.043178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1849","reported_seq":3704,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.260611+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-18T00:48:31.260611+0000","last_peered":"2024-01-18T00:48:31.260611+0000","last_clean":"2024-01-18T00:48:31.260611+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:31.260611+0000","last_undegraded":"2024-01-18T00:48:31.260611+0000","last_fullsized":"2024-01-18T00:48:31.260611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558175,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":1791,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'717","reported_seq":799,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.028723+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-18T00:48:27.028723+0000","last_peered":"2024-01-18T00:48:27.028723+0000","last_clean":"2024-01-18T00:48:27.028723+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-18T00:48:27.028723+0000","last_undegraded":"2024-01-18T00:48:27.028723+0000","last_fullsized":"2024-01-18T00:48:27.028723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54940,"num_write":709,"num_write_kb":85564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'191","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.059510+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-18T00:48:21.059510+0000","last_peered":"2024-01-18T00:48:21.059510+0000","last_clean":"2024-01-18T00:48:21.059510+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-18T00:48:21.059510+0000","last_undegraded":"2024-01-18T00:48:21.059510+0000","last_fullsized":"2024-01-18T00:48:21.059510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'549","reported_seq":622,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.161781+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-18T00:48:00.161781+0000","last_peered":"2024-01-18T00:48:00.161781+0000","last_clean":"2024-01-18T00:48:00.161781+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-18T00:48:00.161781+0000","last_undegraded":"2024-01-18T00:48:00.161781+0000","last_fullsized":"2024-01-18T00:48:00.161781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":12520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'927","reported_seq":1063,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.292487+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-18T00:48:00.292487+0000","last_peered":"2024-01-18T00:48:00.292487+0000","last_clean":"2024-01-18T00:48:00.292487+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-18T00:48:00.292487+0000","last_undegraded":"2024-01-18T00:48:00.292487+0000","last_fullsized":"2024-01-18T00:48:00.292487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":233359,"num_write":916,"num_write_kb":280898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'190","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.069174+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-18T00:48:27.069174+0000","last_peered":"2024-01-18T00:48:27.069174+0000","last_clean":"2024-01-18T00:48:27.069174+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-18T00:48:27.069174+0000","last_undegraded":"2024-01-18T00:48:27.069174+0000","last_fullsized":"2024-01-18T00:48:27.069174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'291","reported_seq":362,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.014348+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-18T00:48:27.014348+0000","last_peered":"2024-01-18T00:48:27.014348+0000","last_clean":"2024-01-18T00:48:27.014348+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-18T00:48:27.014348+0000","last_undegraded":"2024-01-18T00:48:27.014348+0000","last_fullsized":"2024-01-18T00:48:27.014348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'161","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:22.833997+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-18T00:46:22.833997+0000","last_peered":"2024-01-18T00:46:22.833997+0000","last_clean":"2024-01-18T00:46:22.833997+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-18T00:46:22.833997+0000","last_undegraded":"2024-01-18T00:46:22.833997+0000","last_fullsized":"2024-01-18T00:46:22.833997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'848","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.361087+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-18T00:48:18.361087+0000","last_peered":"2024-01-18T00:48:18.361087+0000","last_clean":"2024-01-18T00:48:18.361087+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-18T00:48:18.361087+0000","last_undegraded":"2024-01-18T00:48:18.361087+0000","last_fullsized":"2024-01-18T00:48:18.361087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":221922,"num_write":836,"num_write_kb":231792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'203","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852517+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-18T00:48:17.852517+0000","last_peered":"2024-01-18T00:48:17.852517+0000","last_clean":"2024-01-18T00:48:17.852517+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-18T00:48:17.852517+0000","last_undegraded":"2024-01-18T00:48:17.852517+0000","last_fullsized":"2024-01-18T00:48:17.852517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'352","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121097+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-18T00:48:07.121097+0000","last_peered":"2024-01-18T00:48:07.121097+0000","last_clean":"2024-01-18T00:48:07.121097+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-18T00:48:07.121097+0000","last_undegraded":"2024-01-18T00:48:07.121097+0000","last_fullsized":"2024-01-18T00:48:07.121097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'833","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050673+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-18T00:48:21.050673+0000","last_peered":"2024-01-18T00:48:21.050673+0000","last_clean":"2024-01-18T00:48:21.050673+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-18T00:48:21.050673+0000","last_undegraded":"2024-01-18T00:48:21.050673+0000","last_fullsized":"2024-01-18T00:48:21.050673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":185672,"num_write":820,"num_write_kb":193922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'213","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.803948+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-18T00:48:17.803948+0000","last_peered":"2024-01-18T00:48:17.803948+0000","last_clean":"2024-01-18T00:48:17.803948+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-18T00:48:17.803948+0000","last_undegraded":"2024-01-18T00:48:17.803948+0000","last_fullsized":"2024-01-18T00:48:17.803948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'243","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:35.173699+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-18T00:46:35.173699+0000","last_peered":"2024-01-18T00:46:35.173699+0000","last_clean":"2024-01-18T00:46:35.173699+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-18T00:46:35.173699+0000","last_undegraded":"2024-01-18T00:46:35.173699+0000","last_fullsized":"2024-01-18T00:46:35.173699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.506628+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-18T00:48:27.506628+0000","last_peered":"2024-01-18T00:48:27.506628+0000","last_clean":"2024-01-18T00:48:27.506628+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-18T00:48:27.506628+0000","last_undegraded":"2024-01-18T00:48:27.506628+0000","last_fullsized":"2024-01-18T00:48:27.506628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":76462,"num_write":751,"num_write_kb":105973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'174","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.960208+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-18T00:47:40.960208+0000","last_peered":"2024-01-18T00:47:40.960208+0000","last_clean":"2024-01-18T00:47:40.960208+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-18T00:47:40.960208+0000","last_undegraded":"2024-01-18T00:47:40.960208+0000","last_fullsized":"2024-01-18T00:47:40.960208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'807","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.443753+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-18T00:47:35.443753+0000","last_peered":"2024-01-18T00:47:35.443753+0000","last_clean":"2024-01-18T00:47:35.443753+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:47:35.443753+0000","last_undegraded":"2024-01-18T00:47:35.443753+0000","last_fullsized":"2024-01-18T00:47:35.443753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.498847+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-18T00:48:21.498847+0000","last_peered":"2024-01-18T00:48:21.498847+0000","last_clean":"2024-01-18T00:48:21.498847+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-18T00:48:21.498847+0000","last_undegraded":"2024-01-18T00:48:21.498847+0000","last_fullsized":"2024-01-18T00:48:21.498847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79513,"num_write":758,"num_write_kb":101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'179","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852562+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-18T00:48:17.852562+0000","last_peered":"2024-01-18T00:48:17.852562+0000","last_clean":"2024-01-18T00:48:17.852562+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-18T00:48:17.852562+0000","last_undegraded":"2024-01-18T00:48:17.852562+0000","last_fullsized":"2024-01-18T00:48:17.852562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'897","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.738933+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-18T00:47:47.738933+0000","last_peered":"2024-01-18T00:47:47.738933+0000","last_clean":"2024-01-18T00:47:47.738933+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-18T00:47:47.738933+0000","last_undegraded":"2024-01-18T00:47:47.738933+0000","last_fullsized":"2024-01-18T00:47:47.738933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'793","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.079581+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-18T00:48:12.079581+0000","last_peered":"2024-01-18T00:48:12.079581+0000","last_clean":"2024-01-18T00:48:12.079581+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-18T00:48:12.079581+0000","last_undegraded":"2024-01-18T00:48:12.079581+0000","last_fullsized":"2024-01-18T00:48:12.079581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":97239,"num_write":778,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'226","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073532+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-18T00:48:27.073532+0000","last_peered":"2024-01-18T00:48:27.073532+0000","last_clean":"2024-01-18T00:48:27.073532+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-18T00:48:27.073532+0000","last_undegraded":"2024-01-18T00:48:27.073532+0000","last_fullsized":"2024-01-18T00:48:27.073532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'682","reported_seq":748,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.351601+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-18T00:47:36.351601+0000","last_peered":"2024-01-18T00:47:36.351601+0000","last_clean":"2024-01-18T00:47:36.351601+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-18T00:47:36.351601+0000","last_undegraded":"2024-01-18T00:47:36.351601+0000","last_fullsized":"2024-01-18T00:47:36.351601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":8522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'857","reported_seq":993,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.684093+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-18T00:48:11.684093+0000","last_peered":"2024-01-18T00:48:11.684093+0000","last_clean":"2024-01-18T00:48:11.684093+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-18T00:48:11.684093+0000","last_undegraded":"2024-01-18T00:48:11.684093+0000","last_fullsized":"2024-01-18T00:48:11.684093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":269459,"num_write":851,"num_write_kb":222567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'214","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.758595+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-18T00:48:18.758595+0000","last_peered":"2024-01-18T00:48:18.758595+0000","last_clean":"2024-01-18T00:48:18.758595+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-18T00:48:18.758595+0000","last_undegraded":"2024-01-18T00:48:18.758595+0000","last_fullsized":"2024-01-18T00:48:18.758595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'60","reported_seq":126,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.823501+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-18T00:45:17.823501+0000","last_peered":"2024-01-18T00:45:17.823501+0000","last_clean":"2024-01-18T00:45:17.823501+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-18T00:45:17.823501+0000","last_undegraded":"2024-01-18T00:45:17.823501+0000","last_fullsized":"2024-01-18T00:45:17.823501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'837","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.612230+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-18T00:48:18.612230+0000","last_peered":"2024-01-18T00:48:18.612230+0000","last_clean":"2024-01-18T00:48:18.612230+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-18T00:48:18.612230+0000","last_undegraded":"2024-01-18T00:48:18.612230+0000","last_fullsized":"2024-01-18T00:48:18.612230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":113711,"num_write":815,"num_write_kb":156781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'190","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073325+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-18T00:48:27.073325+0000","last_peered":"2024-01-18T00:48:27.073325+0000","last_clean":"2024-01-18T00:48:27.073325+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-18T00:48:27.073325+0000","last_undegraded":"2024-01-18T00:48:27.073325+0000","last_fullsized":"2024-01-18T00:48:27.073325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":122,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.433017+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-18T00:48:11.433017+0000","last_peered":"2024-01-18T00:48:11.433017+0000","last_clean":"2024-01-18T00:48:11.433017+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-18T00:48:11.433017+0000","last_undegraded":"2024-01-18T00:48:11.433017+0000","last_fullsized":"2024-01-18T00:48:11.433017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'693","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:22.798398+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-18T00:48:22.798398+0000","last_peered":"2024-01-18T00:48:22.798398+0000","last_clean":"2024-01-18T00:48:22.798398+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-18T00:48:22.798398+0000","last_undegraded":"2024-01-18T00:48:22.798398+0000","last_fullsized":"2024-01-18T00:48:22.798398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":99783,"num_write":680,"num_write_kb":117554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'198","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580772+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-18T00:48:06.580772+0000","last_peered":"2024-01-18T00:48:06.580772+0000","last_clean":"2024-01-18T00:48:06.580772+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-18T00:48:06.580772+0000","last_undegraded":"2024-01-18T00:48:06.580772+0000","last_fullsized":"2024-01-18T00:48:06.580772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'380","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.325567+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-18T00:47:15.325567+0000","last_peered":"2024-01-18T00:47:15.325567+0000","last_clean":"2024-01-18T00:47:15.325567+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-18T00:47:15.325567+0000","last_undegraded":"2024-01-18T00:47:15.325567+0000","last_fullsized":"2024-01-18T00:47:15.325567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":8330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'671","reported_seq":735,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.871825+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-18T00:48:11.871825+0000","last_peered":"2024-01-18T00:48:11.871825+0000","last_clean":"2024-01-18T00:48:11.871825+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-18T00:48:11.871825+0000","last_undegraded":"2024-01-18T00:48:11.871825+0000","last_fullsized":"2024-01-18T00:48:11.871825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10831,"num_write":657,"num_write_kb":42746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'199","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.856665+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-18T00:47:50.856665+0000","last_peered":"2024-01-18T00:47:50.856665+0000","last_clean":"2024-01-18T00:47:50.856665+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-18T00:47:50.856665+0000","last_undegraded":"2024-01-18T00:47:50.856665+0000","last_fullsized":"2024-01-18T00:47:50.856665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1377","reported_seq":1443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.852064+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-18T00:48:12.852064+0000","last_peered":"2024-01-18T00:48:12.852064+0000","last_clean":"2024-01-18T00:48:12.852064+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-18T00:48:12.852064+0000","last_undegraded":"2024-01-18T00:48:12.852064+0000","last_fullsized":"2024-01-18T00:48:12.852064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1324,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'774","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.471777+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-18T00:48:27.471777+0000","last_peered":"2024-01-18T00:48:27.471777+0000","last_clean":"2024-01-18T00:48:27.471777+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-18T00:48:27.471777+0000","last_undegraded":"2024-01-18T00:48:27.471777+0000","last_fullsized":"2024-01-18T00:48:27.471777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":74308,"num_write":753,"num_write_kb":109365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.940977+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-18T00:48:18.940977+0000","last_peered":"2024-01-18T00:48:18.940977+0000","last_clean":"2024-01-18T00:48:18.940977+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-18T00:48:18.940977+0000","last_undegraded":"2024-01-18T00:48:18.940977+0000","last_fullsized":"2024-01-18T00:48:18.940977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1523","reported_seq":1587,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.647828+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-18T00:48:27.647828+0000","last_peered":"2024-01-18T00:48:27.647828+0000","last_clean":"2024-01-18T00:48:27.647828+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-18T00:48:27.647828+0000","last_undegraded":"2024-01-18T00:48:27.647828+0000","last_fullsized":"2024-01-18T00:48:27.647828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1523,"log_dups_size":0,"ondisk_log_size":1523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":5419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'735","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071188+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-18T00:48:27.071188+0000","last_peered":"2024-01-18T00:48:27.071188+0000","last_clean":"2024-01-18T00:48:27.071188+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-18T00:48:27.071188+0000","last_undegraded":"2024-01-18T00:48:27.071188+0000","last_fullsized":"2024-01-18T00:48:27.071188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70860,"num_write":724,"num_write_kb":90941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580761+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-18T00:48:06.580761+0000","last_peered":"2024-01-18T00:48:06.580761+0000","last_clean":"2024-01-18T00:48:06.580761+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-18T00:48:06.580761+0000","last_undegraded":"2024-01-18T00:48:06.580761+0000","last_fullsized":"2024-01-18T00:48:06.580761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'160","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:00.227109+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-18T00:47:00.227109+0000","last_peered":"2024-01-18T00:47:00.227109+0000","last_clean":"2024-01-18T00:47:00.227109+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-18T00:47:00.227109+0000","last_undegraded":"2024-01-18T00:47:00.227109+0000","last_fullsized":"2024-01-18T00:47:00.227109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'831","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.750939+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-18T00:48:18.750939+0000","last_peered":"2024-01-18T00:48:18.750939+0000","last_clean":"2024-01-18T00:48:18.750939+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-18T00:48:18.750939+0000","last_undegraded":"2024-01-18T00:48:18.750939+0000","last_fullsized":"2024-01-18T00:48:18.750939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":102827,"num_write":809,"num_write_kb":147366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'202","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.421691+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-18T00:47:56.421691+0000","last_peered":"2024-01-18T00:47:56.421691+0000","last_clean":"2024-01-18T00:47:56.421691+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-18T00:47:56.421691+0000","last_undegraded":"2024-01-18T00:47:56.421691+0000","last_fullsized":"2024-01-18T00:47:56.421691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'42","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.682096+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-18T00:47:31.682096+0000","last_peered":"2024-01-18T00:47:31.682096+0000","last_clean":"2024-01-18T00:47:31.682096+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-18T00:47:31.682096+0000","last_undegraded":"2024-01-18T00:47:31.682096+0000","last_fullsized":"2024-01-18T00:47:31.682096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'822","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.056297+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-18T00:48:27.056297+0000","last_peered":"2024-01-18T00:48:27.056297+0000","last_clean":"2024-01-18T00:48:27.056297+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-18T00:48:27.056297+0000","last_undegraded":"2024-01-18T00:48:27.056297+0000","last_fullsized":"2024-01-18T00:48:27.056297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":80488,"num_write":796,"num_write_kb":101657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'736","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.950162+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-18T00:48:18.950162+0000","last_peered":"2024-01-18T00:48:18.950162+0000","last_clean":"2024-01-18T00:48:18.950162+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-18T00:48:18.950162+0000","last_undegraded":"2024-01-18T00:48:18.950162+0000","last_fullsized":"2024-01-18T00:48:18.950162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":63205,"num_write":717,"num_write_kb":100634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.792754+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-18T00:48:05.792754+0000","last_peered":"2024-01-18T00:48:05.792754+0000","last_clean":"2024-01-18T00:48:05.792754+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-18T00:48:05.792754+0000","last_undegraded":"2024-01-18T00:48:05.792754+0000","last_fullsized":"2024-01-18T00:48:05.792754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1198","reported_seq":1262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:37.788151+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-18T00:46:37.788151+0000","last_peered":"2024-01-18T00:46:37.788151+0000","last_clean":"2024-01-18T00:46:37.788151+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-18T00:46:37.788151+0000","last_undegraded":"2024-01-18T00:46:37.788151+0000","last_fullsized":"2024-01-18T00:46:37.788151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'702","reported_seq":800,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.513650+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-18T00:48:18.513650+0000","last_peered":"2024-01-18T00:48:18.513650+0000","last_clean":"2024-01-18T00:48:18.513650+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-18T00:48:18.513650+0000","last_undegraded":"2024-01-18T00:48:18.513650+0000","last_fullsized":"2024-01-18T00:48:18.513650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":94856,"num_write":687,"num_write_kb":72747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'231","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.285184+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-18T00:48:21.285184+0000","last_peered":"2024-01-18T00:48:21.285184+0000","last_clean":"2024-01-18T00:48:21.285184+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-18T00:48:21.285184+0000","last_undegraded":"2024-01-18T00:48:21.285184+0000","last_fullsized":"2024-01-18T00:48:21.285184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'180","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:24.583588+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-18T00:46:24.583588+0000","last_peered":"2024-01-18T00:46:24.583588+0000","last_clean":"2024-01-18T00:46:24.583588+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-18T00:46:24.583588+0000","last_undegraded":"2024-01-18T00:46:24.583588+0000","last_fullsized":"2024-01-18T00:46:24.583588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1531","reported_seq":1594,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.227266+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-18T00:48:31.227266+0000","last_peered":"2024-01-18T00:48:31.227266+0000","last_clean":"2024-01-18T00:48:31.227266+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-18T00:48:31.227266+0000","last_undegraded":"2024-01-18T00:48:31.227266+0000","last_fullsized":"2024-01-18T00:48:31.227266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16102856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1467,"num_write_kb":16492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'176","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'748","reported_seq":853,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.881596+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-18T00:48:05.881596+0000","last_peered":"2024-01-18T00:48:05.881596+0000","last_clean":"2024-01-18T00:48:05.881596+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-18T00:48:05.881596+0000","last_undegraded":"2024-01-18T00:48:05.881596+0000","last_fullsized":"2024-01-18T00:48:05.881596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":128829,"num_write":735,"num_write_kb":187979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'216","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.778219+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-18T00:45:17.778219+0000","last_peered":"2024-01-18T00:45:17.778219+0000","last_clean":"2024-01-18T00:45:17.778219+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-18T00:45:17.778219+0000","last_undegraded":"2024-01-18T00:45:17.778219+0000","last_fullsized":"2024-01-18T00:45:17.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'190","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.470221+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-18T00:48:18.470221+0000","last_peered":"2024-01-18T00:48:18.470221+0000","last_clean":"2024-01-18T00:48:18.470221+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-18T00:48:18.470221+0000","last_undegraded":"2024-01-18T00:48:18.470221+0000","last_fullsized":"2024-01-18T00:48:18.470221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'730","reported_seq":811,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.582524+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-18T00:48:06.582524+0000","last_peered":"2024-01-18T00:48:06.582524+0000","last_clean":"2024-01-18T00:48:06.582524+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-18T00:48:06.582524+0000","last_undegraded":"2024-01-18T00:48:06.582524+0000","last_fullsized":"2024-01-18T00:48:06.582524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":53396,"num_write":716,"num_write_kb":86798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'213","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.681739+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-18T00:47:31.681739+0000","last_peered":"2024-01-18T00:47:31.681739+0000","last_clean":"2024-01-18T00:47:31.681739+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-18T00:47:31.681739+0000","last_undegraded":"2024-01-18T00:47:31.681739+0000","last_fullsized":"2024-01-18T00:47:31.681739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'211","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.359210+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-18T00:48:18.359210+0000","last_peered":"2024-01-18T00:48:18.359210+0000","last_clean":"2024-01-18T00:48:18.359210+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-18T00:48:18.359210+0000","last_undegraded":"2024-01-18T00:48:18.359210+0000","last_fullsized":"2024-01-18T00:48:18.359210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'217","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.739709+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-18T00:48:18.739709+0000","last_peered":"2024-01-18T00:48:18.739709+0000","last_clean":"2024-01-18T00:48:18.739709+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-18T00:48:18.739709+0000","last_undegraded":"2024-01-18T00:48:18.739709+0000","last_fullsized":"2024-01-18T00:48:18.739709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'193","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.037327+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-18T00:48:27.037327+0000","last_peered":"2024-01-18T00:48:27.037327+0000","last_clean":"2024-01-18T00:48:27.037327+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-18T00:48:27.037327+0000","last_undegraded":"2024-01-18T00:48:27.037327+0000","last_fullsized":"2024-01-18T00:48:27.037327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'178","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.549940+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-18T00:48:06.549940+0000","last_peered":"2024-01-18T00:48:06.549940+0000","last_clean":"2024-01-18T00:48:06.549940+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-18T00:48:06.549940+0000","last_undegraded":"2024-01-18T00:48:06.549940+0000","last_fullsized":"2024-01-18T00:48:06.549940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'200","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588202+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-18T00:48:11.588202+0000","last_peered":"2024-01-18T00:48:11.588202+0000","last_clean":"2024-01-18T00:48:11.588202+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-18T00:48:11.588202+0000","last_undegraded":"2024-01-18T00:48:11.588202+0000","last_fullsized":"2024-01-18T00:48:11.588202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'233","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.492779+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-18T00:47:50.492779+0000","last_peered":"2024-01-18T00:47:50.492779+0000","last_clean":"2024-01-18T00:47:50.492779+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-18T00:47:50.492779+0000","last_undegraded":"2024-01-18T00:47:50.492779+0000","last_fullsized":"2024-01-18T00:47:50.492779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'196","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.038653+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-18T00:48:27.038653+0000","last_peered":"2024-01-18T00:48:27.038653+0000","last_clean":"2024-01-18T00:48:27.038653+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-18T00:48:27.038653+0000","last_undegraded":"2024-01-18T00:48:27.038653+0000","last_fullsized":"2024-01-18T00:48:27.038653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'201","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.512046+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-18T00:48:21.512046+0000","last_peered":"2024-01-18T00:48:21.512046+0000","last_clean":"2024-01-18T00:48:21.512046+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-18T00:48:21.512046+0000","last_undegraded":"2024-01-18T00:48:21.512046+0000","last_fullsized":"2024-01-18T00:48:21.512046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"29'196","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.797797+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-18T00:48:17.797797+0000","last_peered":"2024-01-18T00:48:17.797797+0000","last_clean":"2024-01-18T00:48:17.797797+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-18T00:48:17.797797+0000","last_undegraded":"2024-01-18T00:48:17.797797+0000","last_fullsized":"2024-01-18T00:48:17.797797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'198","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.448911+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-18T00:48:18.448911+0000","last_peered":"2024-01-18T00:48:18.448911+0000","last_clean":"2024-01-18T00:48:18.448911+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-18T00:48:18.448911+0000","last_undegraded":"2024-01-18T00:48:18.448911+0000","last_fullsized":"2024-01-18T00:48:18.448911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'193","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.884549+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-18T00:48:17.884549+0000","last_peered":"2024-01-18T00:48:17.884549+0000","last_clean":"2024-01-18T00:48:17.884549+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-18T00:48:17.884549+0000","last_undegraded":"2024-01-18T00:48:17.884549+0000","last_fullsized":"2024-01-18T00:48:17.884549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'219","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852868+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-18T00:48:17.852868+0000","last_peered":"2024-01-18T00:48:17.852868+0000","last_clean":"2024-01-18T00:48:17.852868+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-18T00:48:17.852868+0000","last_undegraded":"2024-01-18T00:48:17.852868+0000","last_fullsized":"2024-01-18T00:48:17.852868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'201","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.476599+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-18T00:48:06.476599+0000","last_peered":"2024-01-18T00:48:06.476599+0000","last_clean":"2024-01-18T00:48:06.476599+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-18T00:48:06.476599+0000","last_undegraded":"2024-01-18T00:48:06.476599+0000","last_fullsized":"2024-01-18T00:48:06.476599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'194","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.655244+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-18T00:47:56.655244+0000","last_peered":"2024-01-18T00:47:56.655244+0000","last_clean":"2024-01-18T00:47:56.655244+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-18T00:47:56.655244+0000","last_undegraded":"2024-01-18T00:47:56.655244+0000","last_fullsized":"2024-01-18T00:47:56.655244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'201","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.561292+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-18T00:48:06.561292+0000","last_peered":"2024-01-18T00:48:06.561292+0000","last_clean":"2024-01-18T00:48:06.561292+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-18T00:48:06.561292+0000","last_undegraded":"2024-01-18T00:48:06.561292+0000","last_fullsized":"2024-01-18T00:48:06.561292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'207","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.847721+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-18T00:47:47.847721+0000","last_peered":"2024-01-18T00:47:47.847721+0000","last_clean":"2024-01-18T00:47:47.847721+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-18T00:47:47.847721+0000","last_undegraded":"2024-01-18T00:47:47.847721+0000","last_fullsized":"2024-01-18T00:47:47.847721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'209","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.390971+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-18T00:48:18.390971+0000","last_peered":"2024-01-18T00:48:18.390971+0000","last_clean":"2024-01-18T00:48:18.390971+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-18T00:48:18.390971+0000","last_undegraded":"2024-01-18T00:48:18.390971+0000","last_fullsized":"2024-01-18T00:48:18.390971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'210","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.464378+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-18T00:48:27.464378+0000","last_peered":"2024-01-18T00:48:27.464378+0000","last_clean":"2024-01-18T00:48:27.464378+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-18T00:48:27.464378+0000","last_undegraded":"2024-01-18T00:48:27.464378+0000","last_fullsized":"2024-01-18T00:48:27.464378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580753+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:06.580753+0000","last_peered":"2024-01-18T00:48:06.580753+0000","last_clean":"2024-01-18T00:48:06.580753+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-18T00:48:06.580753+0000","last_undegraded":"2024-01-18T00:48:06.580753+0000","last_fullsized":"2024-01-18T00:48:06.580753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'168","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.006831+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-18T00:47:31.006831+0000","last_peered":"2024-01-18T00:47:31.006831+0000","last_clean":"2024-01-18T00:47:31.006831+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-18T00:47:31.006831+0000","last_undegraded":"2024-01-18T00:47:31.006831+0000","last_fullsized":"2024-01-18T00:47:31.006831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'170","reported_seq":232,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.868399+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-18T00:48:11.868399+0000","last_peered":"2024-01-18T00:48:11.868399+0000","last_clean":"2024-01-18T00:48:11.868399+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-18T00:48:11.868399+0000","last_undegraded":"2024-01-18T00:48:11.868399+0000","last_fullsized":"2024-01-18T00:48:11.868399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.933683+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-18T00:48:06.933683+0000","last_peered":"2024-01-18T00:48:06.933683+0000","last_clean":"2024-01-18T00:48:06.933683+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-18T00:48:06.933683+0000","last_undegraded":"2024-01-18T00:48:06.933683+0000","last_fullsized":"2024-01-18T00:48:06.933683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'213","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121880+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-18T00:48:07.121880+0000","last_peered":"2024-01-18T00:48:07.121880+0000","last_clean":"2024-01-18T00:48:07.121880+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-18T00:48:07.121880+0000","last_undegraded":"2024-01-18T00:48:07.121880+0000","last_fullsized":"2024-01-18T00:48:07.121880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'191","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.997850+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-18T00:47:50.997850+0000","last_peered":"2024-01-18T00:47:50.997850+0000","last_clean":"2024-01-18T00:47:50.997850+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-18T00:47:50.997850+0000","last_undegraded":"2024-01-18T00:47:50.997850+0000","last_fullsized":"2024-01-18T00:47:50.997850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'198","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.354485+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-18T00:48:06.354485+0000","last_peered":"2024-01-18T00:48:06.354485+0000","last_clean":"2024-01-18T00:48:06.354485+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-18T00:48:06.354485+0000","last_undegraded":"2024-01-18T00:48:06.354485+0000","last_fullsized":"2024-01-18T00:48:06.354485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"29'186","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.304696+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-18T00:48:27.304696+0000","last_peered":"2024-01-18T00:48:27.304696+0000","last_clean":"2024-01-18T00:48:27.304696+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-18T00:48:27.304696+0000","last_undegraded":"2024-01-18T00:48:27.304696+0000","last_fullsized":"2024-01-18T00:48:27.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'201","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.077386+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-18T00:48:12.077386+0000","last_peered":"2024-01-18T00:48:12.077386+0000","last_clean":"2024-01-18T00:48:12.077386+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-18T00:48:12.077386+0000","last_undegraded":"2024-01-18T00:48:12.077386+0000","last_fullsized":"2024-01-18T00:48:12.077386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'188","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.009420+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-18T00:48:06.009420+0000","last_peered":"2024-01-18T00:48:06.009420+0000","last_clean":"2024-01-18T00:48:06.009420+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-18T00:48:06.009420+0000","last_undegraded":"2024-01-18T00:48:06.009420+0000","last_fullsized":"2024-01-18T00:48:06.009420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'186","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.576118+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-18T00:48:06.576118+0000","last_peered":"2024-01-18T00:48:06.576118+0000","last_clean":"2024-01-18T00:48:06.576118+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-18T00:48:06.576118+0000","last_undegraded":"2024-01-18T00:48:06.576118+0000","last_fullsized":"2024-01-18T00:48:06.576118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'194","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588232+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-18T00:48:11.588232+0000","last_peered":"2024-01-18T00:48:11.588232+0000","last_clean":"2024-01-18T00:48:11.588232+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-18T00:48:11.588232+0000","last_undegraded":"2024-01-18T00:48:11.588232+0000","last_fullsized":"2024-01-18T00:48:11.588232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.632621+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-18T00:48:18.632621+0000","last_peered":"2024-01-18T00:48:18.632621+0000","last_clean":"2024-01-18T00:48:18.632621+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-18T00:48:18.632621+0000","last_undegraded":"2024-01-18T00:48:18.632621+0000","last_fullsized":"2024-01-18T00:48:18.632621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1182,"num_read_kb":3686645,"num_write":24415,"num_write_kb":4363145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24889,"ondisk_log_size":24889,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12707,"ondisk_log_size":12707,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198020803,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":22106,"num_write_kb":205992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180723712,"data_stored":396041606,"data_compressed":51429318,"data_compressed_allocated":69492736,"data_compressed_original":284966912,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62450,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510748,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139320,"kb_used_data":31856,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94232520,"statfs":{"total":96636764160,"available":96494100480,"internally_reserved":0,"allocated":32620544,"data_stored":76215391,"data_compressed":10068524,"data_compressed_allocated":13414400,"data_compressed_original":57212928,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.91100000000000003,"15min":0.88600000000000001},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1259999999999999,"5min":1.377,"15min":1.377},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.54400000000000004,"15min":0.34599999999999997},"max":{"1min":1.5,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.468,"15min":1.4830000000000001},"last":1.194}]},{"osd":2,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":0.86699999999999999},"min":{"1min":0.622,"5min":0.53600000000000003,"15min":0.47099999999999997},"max":{"1min":1.181,"5min":1.302,"15min":1.619},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.002,"15min":0.97499999999999998},"min":{"1min":0.76700000000000002,"5min":0.58299999999999996,"15min":0.45900000000000002},"max":{"1min":1.6240000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.389}]},{"osd":3,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92500000000000004,"15min":0.92800000000000005},"min":{"1min":0.76700000000000002,"5min":0.55700000000000005,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.3600000000000001,"15min":1.718},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.0640000000000001,"15min":1.036},"min":{"1min":0.72499999999999998,"5min":0.65500000000000003,"15min":0.65400000000000003},"max":{"1min":1.7450000000000001,"5min":1.996,"15min":1.996},"last":1.639}]},{"osd":4,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41499999999999998},"max":{"1min":1.4039999999999999,"5min":1.7470000000000001,"15min":1.7929999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0429999999999999,"15min":1.02},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4359999999999999,"5min":1.5489999999999999,"15min":1.8700000000000001},"last":1.306}]},{"osd":5,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1559999999999999,"15min":1.1040000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.44700000000000001},"max":{"1min":1.8360000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.702},{"interface":"front","average":{"1min":1.131,"5min":1.1399999999999999,"15min":1.101},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":1.4830000000000001,"5min":1.8500000000000001,"15min":1.994},"last":1.526}]},{"osd":6,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.585,"5min":1.6319999999999999,"15min":1.891},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.69399999999999995,"5min":0.64500000000000002,"15min":0.44900000000000001},"max":{"1min":1.5760000000000001,"5min":1.6739999999999999,"15min":1.97},"last":1.4870000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510749,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138800,"kb_used_data":23016,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94233040,"statfs":{"total":96636764160,"available":96494632960,"internally_reserved":0,"allocated":23568384,"data_stored":53979177,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":1594,"internal_metadata":118553030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.36299999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.427},"last":1.03},{"interface":"front","average":{"1min":0.871,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.41199999999999998},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.6379999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.86499999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47699999999999998},"max":{"1min":1.264,"5min":1.357,"15min":1.607},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.40899999999999997},"max":{"1min":1.3600000000000001,"5min":1.466,"15min":1.466},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.501},"max":{"1min":1.272,"5min":1.756,"15min":1.756},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0049999999999999,"15min":1.0409999999999999},"min":{"1min":0.66400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.4209999999999998},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.53400000000000003},"max":{"1min":1.347,"5min":1.347,"15min":2.3180000000000001},"last":0.999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4359999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0900000000000001,"15min":1.0469999999999999},"min":{"1min":0.53800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4770000000000001,"5min":1.964,"15min":1.964},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.40799999999999997},"max":{"1min":1.353,"5min":2.1339999999999999,"15min":2.3439999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0489999999999999,"15min":1.0669999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.3879999999999999,"5min":1.585,"15min":2.4849999999999999},"last":1.113},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":1.161},"min":{"1min":0.82899999999999996,"5min":0.56200000000000006,"15min":0.55700000000000005},"max":{"1min":1.6100000000000001,"5min":2.0609999999999999,"15min":2.1400000000000001},"last":1.147}]},{"osd":7,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.099},"min":{"1min":0.66400000000000003,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":1.7430000000000001,"5min":1.837,"15min":1.8959999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.2030000000000001},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.41799999999999998},"max":{"1min":1.831,"5min":1.8819999999999999,"15min":2.5979999999999999},"last":1.198}]}]},{"osd":5,"up_from":15,"seq":64424510749,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123756,"kb_used_data":20452,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94248084,"statfs":{"total":96636764160,"available":96510038016,"internally_reserved":0,"allocated":20942848,"data_stored":42070399,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88800000000000001,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89400000000000002,"15min":0.88100000000000001},"min":{"1min":0.57099999999999995,"5min":0.49399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3740000000000001,"5min":1.482,"15min":1.482},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.875,"15min":0.86299999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.2350000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.92300000000000004},"min":{"1min":0.59899999999999998,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.512,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.92500000000000004,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.502,"15min":1.5469999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":0.92200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.51900000000000002},"max":{"1min":1.369,"5min":1.4690000000000001,"15min":1.6160000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0469999999999999,"15min":1.036},"min":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.624},"max":{"1min":1.232,"5min":1.5620000000000001,"15min":1.6919999999999999},"last":1.2010000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.02,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.387,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.468},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.097},"min":{"1min":0.629,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":1.589,"5min":1.6639999999999999,"15min":1.7709999999999999},"last":1.355}]},{"osd":6,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.119,"15min":1.125},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.51700000000000002},"max":{"1min":1.462,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.421},{"interface":"front","average":{"1min":1.022,"5min":1.1379999999999999,"15min":1.123},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.39000000000000001},"max":{"1min":1.3580000000000001,"5min":2.032,"15min":2.032},"last":1.5900000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.216,"15min":1.2010000000000001},"min":{"1min":0.82599999999999996,"5min":0.58699999999999997,"15min":0.35099999999999998},"max":{"1min":1.925,"5min":1.925,"15min":2.04},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2370000000000001,"15min":1.2310000000000001},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.56599999999999995},"max":{"1min":1.421,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.6160000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510749,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138636,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94233204,"statfs":{"total":96636764160,"available":96494800896,"internally_reserved":0,"allocated":21958656,"data_stored":43628744,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.438},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":0.78300000000000003,"15min":0.94199999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83799999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34399999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.91100000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.587},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.82499999999999996,"15min":0.80000000000000004},"min":{"1min":0.72499999999999998,"5min":0.52700000000000002,"15min":0.48999999999999999},"max":{"1min":1.1399999999999999,"5min":1.296,"15min":1.296},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.48099999999999998},"max":{"1min":1.141,"5min":1.2789999999999999,"15min":1.3080000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.46999999999999997},"max":{"1min":1.028,"5min":1.1599999999999999,"15min":1.1879999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.22,"15min":1.3109999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.497},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.5620000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85499999999999998,"15min":0.85799999999999998},"min":{"1min":0.69899999999999995,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.256},"last":1.008}]}]},{"osd":1,"up_from":15,"seq":64424510751,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141028,"kb_used_data":23836,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94230812,"statfs":{"total":96636764160,"available":96492351488,"internally_reserved":0,"allocated":24408064,"data_stored":54652877,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.439},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":1.2749999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":1.0329999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.83799999999999997},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.502},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":1.375},"last":0.434}]},{"osd":4,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.63100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.1759999999999999,"15min":1.3220000000000001},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.2629999999999999,"15min":1.5660000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.2190000000000001,"15min":1.222},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1839999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.83299999999999996},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.497},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.202,"5min":1.298,"15min":1.4239999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.69699999999999995,"5min":0.59699999999999998,"15min":0.53200000000000003},"max":{"1min":1.0660000000000001,"5min":1.339,"15min":1.341},"last":0.79100000000000004}]}]},{"osd":0,"up_from":15,"seq":64424510749,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108120,"kb_used_data":18704,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263720,"statfs":{"total":96636764160,"available":96526049280,"internally_reserved":0,"allocated":19152896,"data_stored":46854353,"data_compressed":6403410,"data_compressed_allocated":8425472,"data_compressed_original":36327424,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.79400000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70899999999999996,"5min":0.752,"15min":1.0369999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.79500000000000004,"15min":0.81599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.44,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":1.2350000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.1759999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.90100000000000002,"15min":0.93300000000000005},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.44600000000000001},"max":{"1min":0.96699999999999997,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.133,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.083,"15min":1.2869999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.335,"15min":1.335},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.52100000000000002},"max":{"1min":1.1619999999999999,"5min":1.377,"15min":1.5649999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.69999999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0349999999999999,"5min":1.2190000000000001,"15min":1.266},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1659999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.411,"15min":1.411},"last":0.79700000000000004}]}]},{"osd":4,"up_from":14,"seq":60129543454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139424,"kb_used_data":27800,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94232416,"statfs":{"total":96636764160,"available":96493993984,"internally_reserved":0,"allocated":28467200,"data_stored":58171708,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86799999999999999,"15min":0.874},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.286,"5min":1.488,"15min":1.488},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.363,"5min":1.506,"15min":1.506},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0049999999999999,"15min":0.95999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44600000000000001},"max":{"1min":1.3660000000000001,"5min":1.522,"15min":1.5329999999999999},"last":0.747},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.872},"min":{"1min":0.42799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2290000000000001,"5min":1.6200000000000001,"15min":1.7589999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54800000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.353,"5min":1.5429999999999999,"15min":1.587},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0629999999999999,"15min":1.018},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":1.5940000000000001,"15min":1.639},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.405,"5min":1.423,"15min":1.8240000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.03},"min":{"1min":0.70899999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.423,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0569999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46700000000000003},"max":{"1min":1.476,"5min":1.76,"15min":1.76},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":1.7849999999999999,"5min":1.8240000000000001,"15min":2.1960000000000002},"last":1.1970000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.7210000000000001,"5min":1.992,"15min":1.992},"last":1.276},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":1.631,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.371}]},{"osd":7,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1439999999999999,"15min":1.137},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8580000000000001,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.341},{"interface":"front","average":{"1min":1.266,"5min":1.224,"15min":1.2270000000000001},"min":{"1min":0.80400000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5089999999999999,"5min":1.9279999999999999,"15min":2.0110000000000001},"last":1.4990000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79108,"kb_used_data":11900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94292732,"statfs":{"total":96636764160,"available":96555757568,"internally_reserved":0,"allocated":12185600,"data_stored":22655891,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":0.877},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.76300000000000001,"15min":0.82399999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.87},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.052,"5min":1.359,"15min":1.359},"last":0.5},{"interface":"front","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.46300000000000002},"max":{"1min":0.96799999999999997,"5min":1.0900000000000001,"15min":1.3140000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":1.087,"5min":1.3100000000000001,"15min":1.3420000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.81899999999999995},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.998,"5min":1.196,"15min":1.3480000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.52500000000000002},"max":{"1min":1.079,"5min":1.254,"15min":1.476},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.56399999999999995,"15min":0.45100000000000001},"max":{"1min":1,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86099999999999999,"15min":0.85999999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.48299999999999998},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18784256,"data_stored":46138004,"data_compressed":6372185,"data_compressed_allocated":8384512,"data_compressed_original":35753984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24100864,"data_stored":54526896,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":22530423,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":43502763,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28160000,"data_stored":58046864,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":41944418,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":53853196,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":75499042,"data_compressed":10037299,"data_compressed_allocated":13373440,"data_compressed_original":56639488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:48:35.331 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-18T00:48:35.331 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:48:35.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.529+0000 7feda6c00640 1 Processor -- start 2024-01-18T00:48:35.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.529+0000 7feda6c00640 1 -- start start 2024-01-18T00:48:35.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda6c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feda0153730 0x7feda00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:35.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda6c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda01598e0 con 0x7feda015d0c0 2024-01-18T00:48:35.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda6c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00cde80 con 0x7feda00cda40 2024-01-18T00:48:35.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda6c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda01596f0 con 0x7feda0153730 2024-01-18T00:48:35.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7fed9fe00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7feda0153730 0x7feda00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:35.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda4c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feda015d0c0 0x7feda015d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35202/0 (socket says 172.21.15.67:35202) 2024-01-18T00:48:35.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.533+0000 7feda4c00640 1 -- 172.21.15.67:0/1259536989 learned_addr learned my addr 172.21.15.67:0/1259536989 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:35.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.537+0000 7fed9fe00640 1 -- 172.21.15.67:0/1259536989 >> v1:172.21.15.137:6789/0 conn(0x7feda00cda40 legacy=0x7feda0070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:35.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.537+0000 7fed9fe00640 1 -- 172.21.15.67:0/1259536989 >> v1:172.21.15.67:6789/0 conn(0x7feda015d0c0 legacy=0x7feda015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.537+0000 7fed9fe00640 1 -- 172.21.15.67:0/1259536989 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0159b80 con 0x7feda0153730 2024-01-18T00:48:35.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.541+0000 7fed9fe00640 1 --2- 172.21.15.67:0/1259536989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda0153730 0x7feda00ca330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed900097c0 tx=0x7fed9001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d3f92e11caf78d server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7fed9ea00640 1 -- 172.21.15.67:0/1259536989 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a8930 con 0x7feda0153730 2024-01-18T00:48:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7fed9ea00640 1 -- 172.21.15.67:0/1259536989 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900a8a90 con 0x7feda0153730 2024-01-18T00:48:35.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7fed9ea00640 1 -- 172.21.15.67:0/1259536989 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a8e20 con 0x7feda0153730 2024-01-18T00:48:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 -- 172.21.15.67:0/1259536989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda0153730 msgr2=0x7feda00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 --2- 172.21.15.67:0/1259536989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda0153730 0x7feda00ca330 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed900097c0 tx=0x7fed9001ec30 comp rx=0 tx=0).stop 2024-01-18T00:48:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 -- 172.21.15.67:0/1259536989 shutdown_connections 2024-01-18T00:48:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 --2- 172.21.15.67:0/1259536989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda0153730 0x7feda00ca330 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 -- 172.21.15.67:0/1259536989 >> 172.21.15.67:0/1259536989 conn(0x7feda0070460 msgr2=0x7feda006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:35.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 -- 172.21.15.67:0/1259536989 shutdown_connections 2024-01-18T00:48:35.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.549+0000 7feda6c00640 1 -- 172.21.15.67:0/1259536989 wait complete. 2024-01-18T00:48:35.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 Processor -- start 2024-01-18T00:48:35.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 -- start start 2024-01-18T00:48:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feda00cda40 0x7feda015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda0153730 0x7feda01f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:35.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda015c380 con 0x7feda015d0c0 2024-01-18T00:48:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda01ef5a0 con 0x7feda0153730 2024-01-18T00:48:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda6c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda01f3870 con 0x7feda00cda40 2024-01-18T00:48:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda4c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36162/0 (socket says 172.21.15.67:36162) 2024-01-18T00:48:35.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.553+0000 7feda4c00640 1 -- 172.21.15.67:0/1790687406 learned_addr learned my addr 172.21.15.67:0/1790687406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:35.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.557+0000 7feda4c00640 1 -- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feda00cda40 msgr2=0x7feda015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.557+0000 7feda4c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feda00cda40 0x7feda015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.557+0000 7feda4c00640 1 -- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda0153730 msgr2=0x7feda01f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:35.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.557+0000 7feda4c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda0153730 0x7feda01f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:35.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.557+0000 7feda4c00640 1 -- 172.21.15.67:0/1790687406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009420 con 0x7feda015d0c0 2024-01-18T00:48:35.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.561+0000 7feda4c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed9800ca80 tx=0x7fed9800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:35.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9800ac30 con 0x7feda015d0c0 2024-01-18T00:48:35.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800ad90 con 0x7feda015d0c0 2024-01-18T00:48:35.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98012600 con 0x7feda015d0c0 2024-01-18T00:48:35.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda015b040 con 0x7feda015d0c0 2024-01-18T00:48:35.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda015c5d0 con 0x7feda015d0c0 2024-01-18T00:48:35.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.565+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda00746a0 con 0x7feda015d0c0 2024-01-18T00:48:35.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.585+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fed98007070 con 0x7feda015d0c0 2024-01-18T00:48:35.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.585+0000 7fed97e00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 0x7fed78068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:35.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.585+0000 7fed9fe00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 0x7fed78068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:35.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.589+0000 7fed9fe00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 0x7fed78068d50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fed900b2000 tx=0x7fed90004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:35.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.589+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed980553f0 con 0x7feda015d0c0 2024-01-18T00:48:35.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.833+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fed98051730 con 0x7feda015d0c0 2024-01-18T00:48:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:35.993+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feda01ef710 con 0x7fed78066890 2024-01-18T00:48:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.021+0000 7fed97e00640 1 -- 172.21.15.67:0/1790687406 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371330 (secure 0 0 0) 0x7feda01ef710 con 0x7fed78066890 2024-01-18T00:48:36.025 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-18T00:48:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 msgr2=0x7fed78068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 0x7fed78068d50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fed900b2000 tx=0x7fed90004740 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 msgr2=0x7feda00c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed9800ca80 tx=0x7fed9800cf40 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 shutdown_connections 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fed78066890 0x7fed78068d50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feda015d0c0 0x7feda00c3780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda0153730 0x7feda01f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 --2- 172.21.15.67:0/1790687406 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7feda00cda40 0x7feda015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 >> 172.21.15.67:0/1790687406 conn(0x7feda0070460 msgr2=0x7feda00c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 shutdown_connections 2024-01-18T00:48:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.025+0000 7feda6c00640 1 -- 172.21.15.67:0/1790687406 wait complete. 2024-01-18T00:48:36.046 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":3289,"stamp":"2024-01-18T00:48:34.740938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198613937,"num_objects":110,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":3112,"num_read_kb":3689624,"num_write":46730,"num_write_kb":4572599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59425,"ondisk_log_size":59425,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1008192,"kb_used_data":179008,"kb_used_omap":12,"kb_used_meta":829107,"kb_avail":753966528,"statfs":{"total":773094113280,"available":772061724672,"internally_reserved":0,"allocated":183304192,"data_stored":398228540,"data_compressed":51491768,"data_compressed_allocated":69574656,"data_compressed_original":286113792,"omap_allocated":12752,"internal_metadata":849006128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-190864,"num_objects":-65,"num_object_clones":0,"num_object_copies":-260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-65,"num_whiteouts":0,"num_read":3,"num_read_kb":6,"num_write":102,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005502"},"pg_stats":[{"pgid":"2.1f","version":"29'348","reported_seq":419,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:17.463759+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'182","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.611708+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:18.611708+0000","last_peered":"2024-01-18T00:48:18.611708+0000","last_clean":"2024-01-18T00:48:18.611708+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-18T00:48:18.611708+0000","last_undegraded":"2024-01-18T00:48:18.611708+0000","last_fullsized":"2024-01-18T00:48:18.611708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'802","reported_seq":906,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065083+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-18T00:48:21.065083+0000","last_peered":"2024-01-18T00:48:21.065083+0000","last_clean":"2024-01-18T00:48:21.065083+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-18T00:48:21.065083+0000","last_undegraded":"2024-01-18T00:48:21.065083+0000","last_fullsized":"2024-01-18T00:48:21.065083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":142138,"num_write":787,"num_write_kb":155519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'554","reported_seq":627,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:52.788197+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-18T00:46:52.788197+0000","last_peered":"2024-01-18T00:46:52.788197+0000","last_clean":"2024-01-18T00:46:52.788197+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-18T00:46:52.788197+0000","last_undegraded":"2024-01-18T00:46:52.788197+0000","last_fullsized":"2024-01-18T00:46:52.788197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:54.029925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'168","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.517228+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-18T00:48:00.517228+0000","last_peered":"2024-01-18T00:48:00.517228+0000","last_clean":"2024-01-18T00:48:00.517228+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-18T00:48:00.517228+0000","last_undegraded":"2024-01-18T00:48:00.517228+0000","last_fullsized":"2024-01-18T00:48:00.517228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'820","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.292642+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-18T00:48:21.292642+0000","last_peered":"2024-01-18T00:48:21.292642+0000","last_clean":"2024-01-18T00:48:21.292642+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-18T00:48:21.292642+0000","last_undegraded":"2024-01-18T00:48:21.292642+0000","last_fullsized":"2024-01-18T00:48:21.292642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":112120,"num_write":807,"num_write_kb":168152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1017","reported_seq":1080,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:45.207860+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-18T00:46:45.207860+0000","last_peered":"2024-01-18T00:46:45.207860+0000","last_clean":"2024-01-18T00:46:45.207860+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-18T00:46:45.207860+0000","last_undegraded":"2024-01-18T00:46:45.207860+0000","last_fullsized":"2024-01-18T00:46:45.207860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":12756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'181","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.732391+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-18T00:47:50.732391+0000","last_peered":"2024-01-18T00:47:50.732391+0000","last_clean":"2024-01-18T00:47:50.732391+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-18T00:47:50.732391+0000","last_undegraded":"2024-01-18T00:47:50.732391+0000","last_fullsized":"2024-01-18T00:47:50.732391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'736","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.474364+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-18T00:48:18.474364+0000","last_peered":"2024-01-18T00:48:18.474364+0000","last_clean":"2024-01-18T00:48:18.474364+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-18T00:48:18.474364+0000","last_undegraded":"2024-01-18T00:48:18.474364+0000","last_fullsized":"2024-01-18T00:48:18.474364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":76820,"num_write":722,"num_write_kb":119762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'829","reported_seq":892,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.309570+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-18T00:47:15.309570+0000","last_peered":"2024-01-18T00:47:15.309570+0000","last_clean":"2024-01-18T00:47:15.309570+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-18T00:47:15.309570+0000","last_undegraded":"2024-01-18T00:47:15.309570+0000","last_fullsized":"2024-01-18T00:47:15.309570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'198","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.728104+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-18T00:47:50.728104+0000","last_peered":"2024-01-18T00:47:50.728104+0000","last_clean":"2024-01-18T00:47:50.728104+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-18T00:47:50.728104+0000","last_undegraded":"2024-01-18T00:47:50.728104+0000","last_fullsized":"2024-01-18T00:47:50.728104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'727","reported_seq":813,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.363639+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-18T00:48:27.363639+0000","last_peered":"2024-01-18T00:48:27.363639+0000","last_clean":"2024-01-18T00:48:27.363639+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-18T00:48:27.363639+0000","last_undegraded":"2024-01-18T00:48:27.363639+0000","last_fullsized":"2024-01-18T00:48:27.363639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":89221,"num_write":717,"num_write_kb":93426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'209","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.840216+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-18T00:48:11.840216+0000","last_peered":"2024-01-18T00:48:11.840216+0000","last_clean":"2024-01-18T00:48:11.840216+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-18T00:48:11.840216+0000","last_undegraded":"2024-01-18T00:48:11.840216+0000","last_fullsized":"2024-01-18T00:48:11.840216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'1218","reported_seq":1286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.212940+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-18T00:46:56.212940+0000","last_peered":"2024-01-18T00:46:56.212940+0000","last_clean":"2024-01-18T00:46:56.212940+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-18T00:46:56.212940+0000","last_undegraded":"2024-01-18T00:46:56.212940+0000","last_fullsized":"2024-01-18T00:46:56.212940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1218,"log_dups_size":0,"ondisk_log_size":1218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'784","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:19.037590+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-18T00:48:19.037590+0000","last_peered":"2024-01-18T00:48:19.037590+0000","last_clean":"2024-01-18T00:48:19.037590+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-18T00:48:19.037590+0000","last_undegraded":"2024-01-18T00:48:19.037590+0000","last_fullsized":"2024-01-18T00:48:19.037590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":112181,"num_write":768,"num_write_kb":146877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'214","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.281219+0000","last_change":"2024-01-17T23:00:20.212025+0000","last_active":"2024-01-18T00:48:27.281219+0000","last_peered":"2024-01-18T00:48:27.281219+0000","last_clean":"2024-01-18T00:48:27.281219+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-18T00:48:27.281219+0000","last_undegraded":"2024-01-18T00:48:27.281219+0000","last_fullsized":"2024-01-18T00:48:27.281219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1250","reported_seq":1319,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:02.865589+0000","last_change":"2024-01-17T23:00:17.443779+0000","last_active":"2024-01-18T00:47:02.865589+0000","last_peered":"2024-01-18T00:47:02.865589+0000","last_clean":"2024-01-18T00:47:02.865589+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-18T00:47:02.865589+0000","last_undegraded":"2024-01-18T00:47:02.865589+0000","last_fullsized":"2024-01-18T00:47:02.865589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'844","reported_seq":945,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.741571+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-18T00:48:21.741571+0000","last_peered":"2024-01-18T00:48:21.741571+0000","last_clean":"2024-01-18T00:48:21.741571+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-18T00:48:21.741571+0000","last_undegraded":"2024-01-18T00:48:21.741571+0000","last_fullsized":"2024-01-18T00:48:21.741571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":112670,"num_write":833,"num_write_kb":127477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'206","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.744028+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-18T00:48:18.744028+0000","last_peered":"2024-01-18T00:48:18.744028+0000","last_clean":"2024-01-18T00:48:18.744028+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-18T00:48:18.744028+0000","last_undegraded":"2024-01-18T00:48:18.744028+0000","last_fullsized":"2024-01-18T00:48:18.744028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'322","reported_seq":391,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.211893+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-18T00:46:56.211893+0000","last_peered":"2024-01-18T00:46:56.211893+0000","last_clean":"2024-01-18T00:46:56.211893+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-18T00:46:56.211893+0000","last_undegraded":"2024-01-18T00:46:56.211893+0000","last_fullsized":"2024-01-18T00:46:56.211893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'756","reported_seq":866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.928596+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-18T00:48:06.928596+0000","last_peered":"2024-01-18T00:48:06.928596+0000","last_clean":"2024-01-18T00:48:06.928596+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-18T00:48:06.928596+0000","last_undegraded":"2024-01-18T00:48:06.928596+0000","last_fullsized":"2024-01-18T00:48:06.928596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:27:01.030077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":171173,"num_write":745,"num_write_kb":212620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'217","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.076382+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-18T00:48:12.076382+0000","last_peered":"2024-01-18T00:48:12.076382+0000","last_clean":"2024-01-18T00:48:12.076382+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-18T00:48:12.076382+0000","last_undegraded":"2024-01-18T00:48:12.076382+0000","last_fullsized":"2024-01-18T00:48:12.076382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'229","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:27.834845+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-18T00:46:27.834845+0000","last_peered":"2024-01-18T00:46:27.834845+0000","last_clean":"2024-01-18T00:46:27.834845+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-18T00:46:27.834845+0000","last_undegraded":"2024-01-18T00:46:27.834845+0000","last_fullsized":"2024-01-18T00:46:27.834845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'704","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071298+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-18T00:48:27.071298+0000","last_peered":"2024-01-18T00:48:27.071298+0000","last_clean":"2024-01-18T00:48:27.071298+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-18T00:48:27.071298+0000","last_undegraded":"2024-01-18T00:48:27.071298+0000","last_fullsized":"2024-01-18T00:48:27.071298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42617,"num_write":681,"num_write_kb":68844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'215","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.469520+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-18T00:47:35.469520+0000","last_peered":"2024-01-18T00:47:35.469520+0000","last_clean":"2024-01-18T00:47:35.469520+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-18T00:47:35.469520+0000","last_undegraded":"2024-01-18T00:47:35.469520+0000","last_fullsized":"2024-01-18T00:47:35.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'302","reported_seq":371,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:51.114429+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-18T00:46:51.114429+0000","last_peered":"2024-01-18T00:46:51.114429+0000","last_clean":"2024-01-18T00:46:51.114429+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-18T00:46:51.114429+0000","last_undegraded":"2024-01-18T00:46:51.114429+0000","last_fullsized":"2024-01-18T00:46:51.114429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'837","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050116+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-18T00:48:21.050116+0000","last_peered":"2024-01-18T00:48:21.050116+0000","last_clean":"2024-01-18T00:48:21.050116+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-18T00:48:21.050116+0000","last_undegraded":"2024-01-18T00:48:21.050116+0000","last_fullsized":"2024-01-18T00:48:21.050116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":234919,"num_write":817,"num_write_kb":206693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'178","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.791280+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-18T00:48:05.791280+0000","last_peered":"2024-01-18T00:48:05.791280+0000","last_clean":"2024-01-18T00:48:05.791280+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-18T00:48:05.791280+0000","last_undegraded":"2024-01-18T00:48:05.791280+0000","last_fullsized":"2024-01-18T00:48:05.791280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'1185","reported_seq":1254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:26.221101+0000","last_change":"2024-01-17T23:00:17.445217+0000","last_active":"2024-01-18T00:48:26.221101+0000","last_peered":"2024-01-18T00:48:26.221101+0000","last_clean":"2024-01-18T00:48:26.221101+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-18T00:48:26.221101+0000","last_undegraded":"2024-01-18T00:48:26.221101+0000","last_fullsized":"2024-01-18T00:48:26.221101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3145,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'823","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.065709+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-18T00:48:21.065709+0000","last_peered":"2024-01-18T00:48:21.065709+0000","last_clean":"2024-01-18T00:48:21.065709+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-18T00:48:21.065709+0000","last_undegraded":"2024-01-18T00:48:21.065709+0000","last_fullsized":"2024-01-18T00:48:21.065709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":136936,"num_write":807,"num_write_kb":135857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'196","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.530724+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-18T00:48:00.530724+0000","last_peered":"2024-01-18T00:48:00.530724+0000","last_clean":"2024-01-18T00:48:00.530724+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-18T00:48:00.530724+0000","last_undegraded":"2024-01-18T00:48:00.530724+0000","last_fullsized":"2024-01-18T00:48:00.530724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'794","reported_seq":865,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:12.091765+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-18T00:47:12.091765+0000","last_peered":"2024-01-18T00:47:12.091765+0000","last_clean":"2024-01-18T00:47:12.091765+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-18T00:47:12.091765+0000","last_undegraded":"2024-01-18T00:47:12.091765+0000","last_fullsized":"2024-01-18T00:47:12.091765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'751","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.040646+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-18T00:48:27.040646+0000","last_peered":"2024-01-18T00:48:27.040646+0000","last_clean":"2024-01-18T00:48:27.040646+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-18T00:48:27.040646+0000","last_undegraded":"2024-01-18T00:48:27.040646+0000","last_fullsized":"2024-01-18T00:48:27.040646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:23.375772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":97762,"num_write":737,"num_write_kb":97911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'206","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.314434+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-18T00:48:11.314434+0000","last_peered":"2024-01-18T00:48:11.314434+0000","last_clean":"2024-01-18T00:48:11.314434+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-18T00:48:11.314434+0000","last_undegraded":"2024-01-18T00:48:11.314434+0000","last_fullsized":"2024-01-18T00:48:11.314434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'268","reported_seq":339,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:40.383292+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-18T00:45:40.383292+0000","last_peered":"2024-01-18T00:45:40.383292+0000","last_clean":"2024-01-18T00:45:40.383292+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-18T00:45:40.383292+0000","last_undegraded":"2024-01-18T00:45:40.383292+0000","last_fullsized":"2024-01-18T00:45:40.383292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'803","reported_seq":917,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.079182+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-18T00:48:27.079182+0000","last_peered":"2024-01-18T00:48:27.079182+0000","last_clean":"2024-01-18T00:48:27.079182+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-18T00:48:27.079182+0000","last_undegraded":"2024-01-18T00:48:27.079182+0000","last_fullsized":"2024-01-18T00:48:27.079182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:07:19.781972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":142135,"num_write":790,"num_write_kb":151473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.756635+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-18T00:48:18.756635+0000","last_peered":"2024-01-18T00:48:18.756635+0000","last_clean":"2024-01-18T00:48:18.756635+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-18T00:48:18.756635+0000","last_undegraded":"2024-01-18T00:48:18.756635+0000","last_fullsized":"2024-01-18T00:48:18.756635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'959","reported_seq":1030,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:14.158415+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-18T00:45:14.158415+0000","last_peered":"2024-01-18T00:45:14.158415+0000","last_clean":"2024-01-18T00:45:14.158415+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-18T00:45:14.158415+0000","last_undegraded":"2024-01-18T00:45:14.158415+0000","last_fullsized":"2024-01-18T00:45:14.158415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'706","reported_seq":806,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.550784+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-18T00:48:06.550784+0000","last_peered":"2024-01-18T00:48:06.550784+0000","last_clean":"2024-01-18T00:48:06.550784+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-18T00:48:06.550784+0000","last_undegraded":"2024-01-18T00:48:06.550784+0000","last_fullsized":"2024-01-18T00:48:06.550784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:22.309426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":104293,"num_write":696,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'197","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.043178+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-18T00:48:21.043178+0000","last_peered":"2024-01-18T00:48:21.043178+0000","last_clean":"2024-01-18T00:48:21.043178+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-18T00:48:21.043178+0000","last_undegraded":"2024-01-18T00:48:21.043178+0000","last_fullsized":"2024-01-18T00:48:21.043178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1849","reported_seq":3704,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.260611+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-18T00:48:31.260611+0000","last_peered":"2024-01-18T00:48:31.260611+0000","last_clean":"2024-01-18T00:48:31.260611+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:31.260611+0000","last_undegraded":"2024-01-18T00:48:31.260611+0000","last_fullsized":"2024-01-18T00:48:31.260611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:56.552263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558175,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":1791,"num_write_kb":2856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'717","reported_seq":799,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.028723+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-18T00:48:27.028723+0000","last_peered":"2024-01-18T00:48:27.028723+0000","last_clean":"2024-01-18T00:48:27.028723+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-18T00:48:27.028723+0000","last_undegraded":"2024-01-18T00:48:27.028723+0000","last_fullsized":"2024-01-18T00:48:27.028723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54940,"num_write":709,"num_write_kb":85564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'191","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.059510+0000","last_change":"2024-01-17T23:00:18.560927+0000","last_active":"2024-01-18T00:48:21.059510+0000","last_peered":"2024-01-18T00:48:21.059510+0000","last_clean":"2024-01-18T00:48:21.059510+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-18T00:48:21.059510+0000","last_undegraded":"2024-01-18T00:48:21.059510+0000","last_fullsized":"2024-01-18T00:48:21.059510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:39.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'549","reported_seq":622,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.161781+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-18T00:48:00.161781+0000","last_peered":"2024-01-18T00:48:00.161781+0000","last_clean":"2024-01-18T00:48:00.161781+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-18T00:48:00.161781+0000","last_undegraded":"2024-01-18T00:48:00.161781+0000","last_fullsized":"2024-01-18T00:48:00.161781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":12520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'927","reported_seq":1063,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.292487+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-18T00:48:00.292487+0000","last_peered":"2024-01-18T00:48:00.292487+0000","last_clean":"2024-01-18T00:48:00.292487+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-18T00:48:00.292487+0000","last_undegraded":"2024-01-18T00:48:00.292487+0000","last_fullsized":"2024-01-18T00:48:00.292487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":233359,"num_write":916,"num_write_kb":280898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'190","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.069174+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-18T00:48:27.069174+0000","last_peered":"2024-01-18T00:48:27.069174+0000","last_clean":"2024-01-18T00:48:27.069174+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-18T00:48:27.069174+0000","last_undegraded":"2024-01-18T00:48:27.069174+0000","last_fullsized":"2024-01-18T00:48:27.069174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'291","reported_seq":362,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.014348+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-18T00:48:27.014348+0000","last_peered":"2024-01-18T00:48:27.014348+0000","last_clean":"2024-01-18T00:48:27.014348+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-18T00:48:27.014348+0000","last_undegraded":"2024-01-18T00:48:27.014348+0000","last_fullsized":"2024-01-18T00:48:27.014348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'161","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:22.833997+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-18T00:46:22.833997+0000","last_peered":"2024-01-18T00:46:22.833997+0000","last_clean":"2024-01-18T00:46:22.833997+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-18T00:46:22.833997+0000","last_undegraded":"2024-01-18T00:46:22.833997+0000","last_fullsized":"2024-01-18T00:46:22.833997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'848","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.361087+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-18T00:48:18.361087+0000","last_peered":"2024-01-18T00:48:18.361087+0000","last_clean":"2024-01-18T00:48:18.361087+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-18T00:48:18.361087+0000","last_undegraded":"2024-01-18T00:48:18.361087+0000","last_fullsized":"2024-01-18T00:48:18.361087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":221922,"num_write":836,"num_write_kb":231792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'203","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852517+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-18T00:48:17.852517+0000","last_peered":"2024-01-18T00:48:17.852517+0000","last_clean":"2024-01-18T00:48:17.852517+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-18T00:48:17.852517+0000","last_undegraded":"2024-01-18T00:48:17.852517+0000","last_fullsized":"2024-01-18T00:48:17.852517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'352","reported_seq":420,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121097+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-18T00:48:07.121097+0000","last_peered":"2024-01-18T00:48:07.121097+0000","last_clean":"2024-01-18T00:48:07.121097+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-18T00:48:07.121097+0000","last_undegraded":"2024-01-18T00:48:07.121097+0000","last_fullsized":"2024-01-18T00:48:07.121097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:35.427262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'833","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050673+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-18T00:48:21.050673+0000","last_peered":"2024-01-18T00:48:21.050673+0000","last_clean":"2024-01-18T00:48:21.050673+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-18T00:48:21.050673+0000","last_undegraded":"2024-01-18T00:48:21.050673+0000","last_fullsized":"2024-01-18T00:48:21.050673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":185672,"num_write":820,"num_write_kb":193922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'213","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.803948+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-18T00:48:17.803948+0000","last_peered":"2024-01-18T00:48:17.803948+0000","last_clean":"2024-01-18T00:48:17.803948+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-18T00:48:17.803948+0000","last_undegraded":"2024-01-18T00:48:17.803948+0000","last_fullsized":"2024-01-18T00:48:17.803948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'243","reported_seq":311,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:35.173699+0000","last_change":"2024-01-17T23:00:17.446151+0000","last_active":"2024-01-18T00:46:35.173699+0000","last_peered":"2024-01-18T00:46:35.173699+0000","last_clean":"2024-01-18T00:46:35.173699+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-18T00:46:35.173699+0000","last_undegraded":"2024-01-18T00:46:35.173699+0000","last_fullsized":"2024-01-18T00:46:35.173699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:57:38.164191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.506628+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-18T00:48:27.506628+0000","last_peered":"2024-01-18T00:48:27.506628+0000","last_clean":"2024-01-18T00:48:27.506628+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-18T00:48:27.506628+0000","last_undegraded":"2024-01-18T00:48:27.506628+0000","last_fullsized":"2024-01-18T00:48:27.506628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:48.839020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":76462,"num_write":751,"num_write_kb":105973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'174","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:40.960208+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-18T00:47:40.960208+0000","last_peered":"2024-01-18T00:47:40.960208+0000","last_clean":"2024-01-18T00:47:40.960208+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-18T00:47:40.960208+0000","last_undegraded":"2024-01-18T00:47:40.960208+0000","last_fullsized":"2024-01-18T00:47:40.960208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'807","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:35.443753+0000","last_change":"2024-01-17T23:00:17.326737+0000","last_active":"2024-01-18T00:47:35.443753+0000","last_peered":"2024-01-18T00:47:35.443753+0000","last_clean":"2024-01-18T00:47:35.443753+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:47:35.443753+0000","last_undegraded":"2024-01-18T00:47:35.443753+0000","last_fullsized":"2024-01-18T00:47:35.443753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:01:05.482028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.498847+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-18T00:48:21.498847+0000","last_peered":"2024-01-18T00:48:21.498847+0000","last_clean":"2024-01-18T00:48:21.498847+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-18T00:48:21.498847+0000","last_undegraded":"2024-01-18T00:48:21.498847+0000","last_fullsized":"2024-01-18T00:48:21.498847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79513,"num_write":758,"num_write_kb":101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'179","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852562+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-18T00:48:17.852562+0000","last_peered":"2024-01-18T00:48:17.852562+0000","last_clean":"2024-01-18T00:48:17.852562+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-18T00:48:17.852562+0000","last_undegraded":"2024-01-18T00:48:17.852562+0000","last_fullsized":"2024-01-18T00:48:17.852562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'897","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.738933+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-18T00:47:47.738933+0000","last_peered":"2024-01-18T00:47:47.738933+0000","last_clean":"2024-01-18T00:47:47.738933+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-18T00:47:47.738933+0000","last_undegraded":"2024-01-18T00:47:47.738933+0000","last_fullsized":"2024-01-18T00:47:47.738933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'793","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.079581+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-18T00:48:12.079581+0000","last_peered":"2024-01-18T00:48:12.079581+0000","last_clean":"2024-01-18T00:48:12.079581+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-18T00:48:12.079581+0000","last_undegraded":"2024-01-18T00:48:12.079581+0000","last_fullsized":"2024-01-18T00:48:12.079581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":97239,"num_write":778,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'226","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073532+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-18T00:48:27.073532+0000","last_peered":"2024-01-18T00:48:27.073532+0000","last_clean":"2024-01-18T00:48:27.073532+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-18T00:48:27.073532+0000","last_undegraded":"2024-01-18T00:48:27.073532+0000","last_fullsized":"2024-01-18T00:48:27.073532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'682","reported_seq":748,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:36.351601+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-18T00:47:36.351601+0000","last_peered":"2024-01-18T00:47:36.351601+0000","last_clean":"2024-01-18T00:47:36.351601+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-18T00:47:36.351601+0000","last_undegraded":"2024-01-18T00:47:36.351601+0000","last_fullsized":"2024-01-18T00:47:36.351601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:24.770725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":8522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'857","reported_seq":993,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.684093+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-18T00:48:11.684093+0000","last_peered":"2024-01-18T00:48:11.684093+0000","last_clean":"2024-01-18T00:48:11.684093+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-18T00:48:11.684093+0000","last_undegraded":"2024-01-18T00:48:11.684093+0000","last_fullsized":"2024-01-18T00:48:11.684093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":269459,"num_write":851,"num_write_kb":222567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'214","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.758595+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-18T00:48:18.758595+0000","last_peered":"2024-01-18T00:48:18.758595+0000","last_clean":"2024-01-18T00:48:18.758595+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-18T00:48:18.758595+0000","last_undegraded":"2024-01-18T00:48:18.758595+0000","last_fullsized":"2024-01-18T00:48:18.758595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'60","reported_seq":126,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.823501+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-18T00:45:17.823501+0000","last_peered":"2024-01-18T00:45:17.823501+0000","last_clean":"2024-01-18T00:45:17.823501+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-18T00:45:17.823501+0000","last_undegraded":"2024-01-18T00:45:17.823501+0000","last_fullsized":"2024-01-18T00:45:17.823501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'837","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.612230+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-18T00:48:18.612230+0000","last_peered":"2024-01-18T00:48:18.612230+0000","last_clean":"2024-01-18T00:48:18.612230+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-18T00:48:18.612230+0000","last_undegraded":"2024-01-18T00:48:18.612230+0000","last_fullsized":"2024-01-18T00:48:18.612230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":113711,"num_write":815,"num_write_kb":156781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'190","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.073325+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-18T00:48:27.073325+0000","last_peered":"2024-01-18T00:48:27.073325+0000","last_clean":"2024-01-18T00:48:27.073325+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-18T00:48:27.073325+0000","last_undegraded":"2024-01-18T00:48:27.073325+0000","last_fullsized":"2024-01-18T00:48:27.073325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":122,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.433017+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-18T00:48:11.433017+0000","last_peered":"2024-01-18T00:48:11.433017+0000","last_clean":"2024-01-18T00:48:11.433017+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-18T00:48:11.433017+0000","last_undegraded":"2024-01-18T00:48:11.433017+0000","last_fullsized":"2024-01-18T00:48:11.433017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'693","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:22.798398+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-18T00:48:22.798398+0000","last_peered":"2024-01-18T00:48:22.798398+0000","last_clean":"2024-01-18T00:48:22.798398+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-18T00:48:22.798398+0000","last_undegraded":"2024-01-18T00:48:22.798398+0000","last_fullsized":"2024-01-18T00:48:22.798398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:41.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":99783,"num_write":680,"num_write_kb":117554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'198","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580772+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-18T00:48:06.580772+0000","last_peered":"2024-01-18T00:48:06.580772+0000","last_clean":"2024-01-18T00:48:06.580772+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-18T00:48:06.580772+0000","last_undegraded":"2024-01-18T00:48:06.580772+0000","last_fullsized":"2024-01-18T00:48:06.580772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:13.246165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'380","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.325567+0000","last_change":"2024-01-17T23:00:17.457181+0000","last_active":"2024-01-18T00:47:15.325567+0000","last_peered":"2024-01-18T00:47:15.325567+0000","last_clean":"2024-01-18T00:47:15.325567+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-18T00:47:15.325567+0000","last_undegraded":"2024-01-18T00:47:15.325567+0000","last_fullsized":"2024-01-18T00:47:15.325567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":8330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'671","reported_seq":735,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.871825+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-18T00:48:11.871825+0000","last_peered":"2024-01-18T00:48:11.871825+0000","last_clean":"2024-01-18T00:48:11.871825+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-18T00:48:11.871825+0000","last_undegraded":"2024-01-18T00:48:11.871825+0000","last_fullsized":"2024-01-18T00:48:11.871825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10831,"num_write":657,"num_write_kb":42746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'199","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.856665+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-18T00:47:50.856665+0000","last_peered":"2024-01-18T00:47:50.856665+0000","last_clean":"2024-01-18T00:47:50.856665+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-18T00:47:50.856665+0000","last_undegraded":"2024-01-18T00:47:50.856665+0000","last_fullsized":"2024-01-18T00:47:50.856665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1377","reported_seq":1443,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.852064+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-18T00:48:12.852064+0000","last_peered":"2024-01-18T00:48:12.852064+0000","last_clean":"2024-01-18T00:48:12.852064+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-18T00:48:12.852064+0000","last_undegraded":"2024-01-18T00:48:12.852064+0000","last_fullsized":"2024-01-18T00:48:12.852064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1324,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'774","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.471777+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-18T00:48:27.471777+0000","last_peered":"2024-01-18T00:48:27.471777+0000","last_clean":"2024-01-18T00:48:27.471777+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-18T00:48:27.471777+0000","last_undegraded":"2024-01-18T00:48:27.471777+0000","last_fullsized":"2024-01-18T00:48:27.471777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":74308,"num_write":753,"num_write_kb":109365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.940977+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-18T00:48:18.940977+0000","last_peered":"2024-01-18T00:48:18.940977+0000","last_clean":"2024-01-18T00:48:18.940977+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-18T00:48:18.940977+0000","last_undegraded":"2024-01-18T00:48:18.940977+0000","last_fullsized":"2024-01-18T00:48:18.940977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1523","reported_seq":1587,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.647828+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-18T00:48:27.647828+0000","last_peered":"2024-01-18T00:48:27.647828+0000","last_clean":"2024-01-18T00:48:27.647828+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-18T00:48:27.647828+0000","last_undegraded":"2024-01-18T00:48:27.647828+0000","last_fullsized":"2024-01-18T00:48:27.647828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1523,"log_dups_size":0,"ondisk_log_size":1523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:21:34.212481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":5419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'735","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071188+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-18T00:48:27.071188+0000","last_peered":"2024-01-18T00:48:27.071188+0000","last_clean":"2024-01-18T00:48:27.071188+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-18T00:48:27.071188+0000","last_undegraded":"2024-01-18T00:48:27.071188+0000","last_fullsized":"2024-01-18T00:48:27.071188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70860,"num_write":724,"num_write_kb":90941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580761+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-18T00:48:06.580761+0000","last_peered":"2024-01-18T00:48:06.580761+0000","last_clean":"2024-01-18T00:48:06.580761+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-18T00:48:06.580761+0000","last_undegraded":"2024-01-18T00:48:06.580761+0000","last_fullsized":"2024-01-18T00:48:06.580761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'160","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:00.227109+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-18T00:47:00.227109+0000","last_peered":"2024-01-18T00:47:00.227109+0000","last_clean":"2024-01-18T00:47:00.227109+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-18T00:47:00.227109+0000","last_undegraded":"2024-01-18T00:47:00.227109+0000","last_fullsized":"2024-01-18T00:47:00.227109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'831","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.750939+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-18T00:48:18.750939+0000","last_peered":"2024-01-18T00:48:18.750939+0000","last_clean":"2024-01-18T00:48:18.750939+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-18T00:48:18.750939+0000","last_undegraded":"2024-01-18T00:48:18.750939+0000","last_fullsized":"2024-01-18T00:48:18.750939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:50.278723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":102827,"num_write":809,"num_write_kb":147366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'202","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.421691+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-18T00:47:56.421691+0000","last_peered":"2024-01-18T00:47:56.421691+0000","last_clean":"2024-01-18T00:47:56.421691+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-18T00:47:56.421691+0000","last_undegraded":"2024-01-18T00:47:56.421691+0000","last_fullsized":"2024-01-18T00:47:56.421691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'42","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.682096+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-18T00:47:31.682096+0000","last_peered":"2024-01-18T00:47:31.682096+0000","last_clean":"2024-01-18T00:47:31.682096+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-18T00:47:31.682096+0000","last_undegraded":"2024-01-18T00:47:31.682096+0000","last_fullsized":"2024-01-18T00:47:31.682096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'822","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.056297+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-18T00:48:27.056297+0000","last_peered":"2024-01-18T00:48:27.056297+0000","last_clean":"2024-01-18T00:48:27.056297+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-18T00:48:27.056297+0000","last_undegraded":"2024-01-18T00:48:27.056297+0000","last_fullsized":"2024-01-18T00:48:27.056297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":80488,"num_write":796,"num_write_kb":101657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'736","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.950162+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-18T00:48:18.950162+0000","last_peered":"2024-01-18T00:48:18.950162+0000","last_clean":"2024-01-18T00:48:18.950162+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-18T00:48:18.950162+0000","last_undegraded":"2024-01-18T00:48:18.950162+0000","last_fullsized":"2024-01-18T00:48:18.950162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:16.678503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":63205,"num_write":717,"num_write_kb":100634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.792754+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-18T00:48:05.792754+0000","last_peered":"2024-01-18T00:48:05.792754+0000","last_clean":"2024-01-18T00:48:05.792754+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-18T00:48:05.792754+0000","last_undegraded":"2024-01-18T00:48:05.792754+0000","last_fullsized":"2024-01-18T00:48:05.792754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1198","reported_seq":1262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:37.788151+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-18T00:46:37.788151+0000","last_peered":"2024-01-18T00:46:37.788151+0000","last_clean":"2024-01-18T00:46:37.788151+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-18T00:46:37.788151+0000","last_undegraded":"2024-01-18T00:46:37.788151+0000","last_fullsized":"2024-01-18T00:46:37.788151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'702","reported_seq":800,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.513650+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-18T00:48:18.513650+0000","last_peered":"2024-01-18T00:48:18.513650+0000","last_clean":"2024-01-18T00:48:18.513650+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-18T00:48:18.513650+0000","last_undegraded":"2024-01-18T00:48:18.513650+0000","last_fullsized":"2024-01-18T00:48:18.513650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":94856,"num_write":687,"num_write_kb":72747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'231","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.285184+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-18T00:48:21.285184+0000","last_peered":"2024-01-18T00:48:21.285184+0000","last_clean":"2024-01-18T00:48:21.285184+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-18T00:48:21.285184+0000","last_undegraded":"2024-01-18T00:48:21.285184+0000","last_fullsized":"2024-01-18T00:48:21.285184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'180","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:24.583588+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-18T00:46:24.583588+0000","last_peered":"2024-01-18T00:46:24.583588+0000","last_clean":"2024-01-18T00:46:24.583588+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-18T00:46:24.583588+0000","last_undegraded":"2024-01-18T00:46:24.583588+0000","last_fullsized":"2024-01-18T00:46:24.583588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:18:44.825200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1531","reported_seq":1594,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.227266+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-18T00:48:31.227266+0000","last_peered":"2024-01-18T00:48:31.227266+0000","last_clean":"2024-01-18T00:48:31.227266+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-18T00:48:31.227266+0000","last_undegraded":"2024-01-18T00:48:31.227266+0000","last_fullsized":"2024-01-18T00:48:31.227266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16102856,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1467,"num_write_kb":16492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'176","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.097682+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-18T00:48:12.097682+0000","last_peered":"2024-01-18T00:48:12.097682+0000","last_clean":"2024-01-18T00:48:12.097682+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-18T00:48:12.097682+0000","last_undegraded":"2024-01-18T00:48:12.097682+0000","last_fullsized":"2024-01-18T00:48:12.097682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'748","reported_seq":853,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:05.881596+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-18T00:48:05.881596+0000","last_peered":"2024-01-18T00:48:05.881596+0000","last_clean":"2024-01-18T00:48:05.881596+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-18T00:48:05.881596+0000","last_undegraded":"2024-01-18T00:48:05.881596+0000","last_fullsized":"2024-01-18T00:48:05.881596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":128829,"num_write":735,"num_write_kb":187979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'216","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:45:17.778219+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-18T00:45:17.778219+0000","last_peered":"2024-01-18T00:45:17.778219+0000","last_clean":"2024-01-18T00:45:17.778219+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-18T00:45:17.778219+0000","last_undegraded":"2024-01-18T00:45:17.778219+0000","last_fullsized":"2024-01-18T00:45:17.778219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:51:54.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'190","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.470221+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-18T00:48:18.470221+0000","last_peered":"2024-01-18T00:48:18.470221+0000","last_clean":"2024-01-18T00:48:18.470221+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-18T00:48:18.470221+0000","last_undegraded":"2024-01-18T00:48:18.470221+0000","last_fullsized":"2024-01-18T00:48:18.470221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'730","reported_seq":811,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.582524+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-18T00:48:06.582524+0000","last_peered":"2024-01-18T00:48:06.582524+0000","last_clean":"2024-01-18T00:48:06.582524+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-18T00:48:06.582524+0000","last_undegraded":"2024-01-18T00:48:06.582524+0000","last_fullsized":"2024-01-18T00:48:06.582524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:56:05.147146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":53396,"num_write":716,"num_write_kb":86798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'213","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.681739+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-18T00:47:31.681739+0000","last_peered":"2024-01-18T00:47:31.681739+0000","last_clean":"2024-01-18T00:47:31.681739+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-18T00:47:31.681739+0000","last_undegraded":"2024-01-18T00:47:31.681739+0000","last_fullsized":"2024-01-18T00:47:31.681739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'211","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.359210+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-18T00:48:18.359210+0000","last_peered":"2024-01-18T00:48:18.359210+0000","last_clean":"2024-01-18T00:48:18.359210+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-18T00:48:18.359210+0000","last_undegraded":"2024-01-18T00:48:18.359210+0000","last_fullsized":"2024-01-18T00:48:18.359210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:09:46.777971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'217","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.739709+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-18T00:48:18.739709+0000","last_peered":"2024-01-18T00:48:18.739709+0000","last_clean":"2024-01-18T00:48:18.739709+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-18T00:48:18.739709+0000","last_undegraded":"2024-01-18T00:48:18.739709+0000","last_fullsized":"2024-01-18T00:48:18.739709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'193","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.037327+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-18T00:48:27.037327+0000","last_peered":"2024-01-18T00:48:27.037327+0000","last_clean":"2024-01-18T00:48:27.037327+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-18T00:48:27.037327+0000","last_undegraded":"2024-01-18T00:48:27.037327+0000","last_fullsized":"2024-01-18T00:48:27.037327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:23:33.361911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'178","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.549940+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-18T00:48:06.549940+0000","last_peered":"2024-01-18T00:48:06.549940+0000","last_clean":"2024-01-18T00:48:06.549940+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-18T00:48:06.549940+0000","last_undegraded":"2024-01-18T00:48:06.549940+0000","last_fullsized":"2024-01-18T00:48:06.549940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:55:59.043250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'200","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588202+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-18T00:48:11.588202+0000","last_peered":"2024-01-18T00:48:11.588202+0000","last_clean":"2024-01-18T00:48:11.588202+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-18T00:48:11.588202+0000","last_undegraded":"2024-01-18T00:48:11.588202+0000","last_fullsized":"2024-01-18T00:48:11.588202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'233","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.492779+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-18T00:47:50.492779+0000","last_peered":"2024-01-18T00:47:50.492779+0000","last_clean":"2024-01-18T00:47:50.492779+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-18T00:47:50.492779+0000","last_undegraded":"2024-01-18T00:47:50.492779+0000","last_fullsized":"2024-01-18T00:47:50.492779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'196","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.038653+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-18T00:48:27.038653+0000","last_peered":"2024-01-18T00:48:27.038653+0000","last_clean":"2024-01-18T00:48:27.038653+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-18T00:48:27.038653+0000","last_undegraded":"2024-01-18T00:48:27.038653+0000","last_fullsized":"2024-01-18T00:48:27.038653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'201","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.512046+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-18T00:48:21.512046+0000","last_peered":"2024-01-18T00:48:21.512046+0000","last_clean":"2024-01-18T00:48:21.512046+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-18T00:48:21.512046+0000","last_undegraded":"2024-01-18T00:48:21.512046+0000","last_fullsized":"2024-01-18T00:48:21.512046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:29:41.969454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"29'196","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.797797+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-18T00:48:17.797797+0000","last_peered":"2024-01-18T00:48:17.797797+0000","last_clean":"2024-01-18T00:48:17.797797+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-18T00:48:17.797797+0000","last_undegraded":"2024-01-18T00:48:17.797797+0000","last_fullsized":"2024-01-18T00:48:17.797797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:54.908531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'198","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.448911+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-18T00:48:18.448911+0000","last_peered":"2024-01-18T00:48:18.448911+0000","last_clean":"2024-01-18T00:48:18.448911+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-18T00:48:18.448911+0000","last_undegraded":"2024-01-18T00:48:18.448911+0000","last_fullsized":"2024-01-18T00:48:18.448911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'193","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.884549+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-18T00:48:17.884549+0000","last_peered":"2024-01-18T00:48:17.884549+0000","last_clean":"2024-01-18T00:48:17.884549+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-18T00:48:17.884549+0000","last_undegraded":"2024-01-18T00:48:17.884549+0000","last_fullsized":"2024-01-18T00:48:17.884549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:42:05.757982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'219","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:17.852868+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-18T00:48:17.852868+0000","last_peered":"2024-01-18T00:48:17.852868+0000","last_clean":"2024-01-18T00:48:17.852868+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-18T00:48:17.852868+0000","last_undegraded":"2024-01-18T00:48:17.852868+0000","last_fullsized":"2024-01-18T00:48:17.852868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'201","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.476599+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-18T00:48:06.476599+0000","last_peered":"2024-01-18T00:48:06.476599+0000","last_clean":"2024-01-18T00:48:06.476599+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-18T00:48:06.476599+0000","last_undegraded":"2024-01-18T00:48:06.476599+0000","last_fullsized":"2024-01-18T00:48:06.476599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'194","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.655244+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-18T00:47:56.655244+0000","last_peered":"2024-01-18T00:47:56.655244+0000","last_clean":"2024-01-18T00:47:56.655244+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-18T00:47:56.655244+0000","last_undegraded":"2024-01-18T00:47:56.655244+0000","last_fullsized":"2024-01-18T00:47:56.655244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:08:55.323686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'201","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.561292+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-18T00:48:06.561292+0000","last_peered":"2024-01-18T00:48:06.561292+0000","last_clean":"2024-01-18T00:48:06.561292+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-18T00:48:06.561292+0000","last_undegraded":"2024-01-18T00:48:06.561292+0000","last_fullsized":"2024-01-18T00:48:06.561292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'207","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:47.847721+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-18T00:47:47.847721+0000","last_peered":"2024-01-18T00:47:47.847721+0000","last_clean":"2024-01-18T00:47:47.847721+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-18T00:47:47.847721+0000","last_undegraded":"2024-01-18T00:47:47.847721+0000","last_fullsized":"2024-01-18T00:47:47.847721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'209","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.390971+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-18T00:48:18.390971+0000","last_peered":"2024-01-18T00:48:18.390971+0000","last_clean":"2024-01-18T00:48:18.390971+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-18T00:48:18.390971+0000","last_undegraded":"2024-01-18T00:48:18.390971+0000","last_fullsized":"2024-01-18T00:48:18.390971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'210","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.464378+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-18T00:48:27.464378+0000","last_peered":"2024-01-18T00:48:27.464378+0000","last_clean":"2024-01-18T00:48:27.464378+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-18T00:48:27.464378+0000","last_undegraded":"2024-01-18T00:48:27.464378+0000","last_fullsized":"2024-01-18T00:48:27.464378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'195","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.580753+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:06.580753+0000","last_peered":"2024-01-18T00:48:06.580753+0000","last_clean":"2024-01-18T00:48:06.580753+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-18T00:48:06.580753+0000","last_undegraded":"2024-01-18T00:48:06.580753+0000","last_fullsized":"2024-01-18T00:48:06.580753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'168","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:31.006831+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-18T00:47:31.006831+0000","last_peered":"2024-01-18T00:47:31.006831+0000","last_clean":"2024-01-18T00:47:31.006831+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-18T00:47:31.006831+0000","last_undegraded":"2024-01-18T00:47:31.006831+0000","last_fullsized":"2024-01-18T00:47:31.006831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'170","reported_seq":232,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.868399+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-18T00:48:11.868399+0000","last_peered":"2024-01-18T00:48:11.868399+0000","last_clean":"2024-01-18T00:48:11.868399+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-18T00:48:11.868399+0000","last_undegraded":"2024-01-18T00:48:11.868399+0000","last_fullsized":"2024-01-18T00:48:11.868399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'205","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.933683+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-18T00:48:06.933683+0000","last_peered":"2024-01-18T00:48:06.933683+0000","last_clean":"2024-01-18T00:48:06.933683+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-18T00:48:06.933683+0000","last_undegraded":"2024-01-18T00:48:06.933683+0000","last_fullsized":"2024-01-18T00:48:06.933683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'213","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.121880+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-18T00:48:07.121880+0000","last_peered":"2024-01-18T00:48:07.121880+0000","last_clean":"2024-01-18T00:48:07.121880+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-18T00:48:07.121880+0000","last_undegraded":"2024-01-18T00:48:07.121880+0000","last_fullsized":"2024-01-18T00:48:07.121880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'191","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.997850+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-18T00:47:50.997850+0000","last_peered":"2024-01-18T00:47:50.997850+0000","last_clean":"2024-01-18T00:47:50.997850+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-18T00:47:50.997850+0000","last_undegraded":"2024-01-18T00:47:50.997850+0000","last_fullsized":"2024-01-18T00:47:50.997850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:24:07.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'198","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.354485+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-18T00:48:06.354485+0000","last_peered":"2024-01-18T00:48:06.354485+0000","last_clean":"2024-01-18T00:48:06.354485+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-18T00:48:06.354485+0000","last_undegraded":"2024-01-18T00:48:06.354485+0000","last_fullsized":"2024-01-18T00:48:06.354485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:34.351857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"29'186","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.304696+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-18T00:48:27.304696+0000","last_peered":"2024-01-18T00:48:27.304696+0000","last_clean":"2024-01-18T00:48:27.304696+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-18T00:48:27.304696+0000","last_undegraded":"2024-01-18T00:48:27.304696+0000","last_fullsized":"2024-01-18T00:48:27.304696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:58.793331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'201","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:12.077386+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-18T00:48:12.077386+0000","last_peered":"2024-01-18T00:48:12.077386+0000","last_clean":"2024-01-18T00:48:12.077386+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-18T00:48:12.077386+0000","last_undegraded":"2024-01-18T00:48:12.077386+0000","last_fullsized":"2024-01-18T00:48:12.077386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'188","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.009420+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-18T00:48:06.009420+0000","last_peered":"2024-01-18T00:48:06.009420+0000","last_clean":"2024-01-18T00:48:06.009420+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-18T00:48:06.009420+0000","last_undegraded":"2024-01-18T00:48:06.009420+0000","last_fullsized":"2024-01-18T00:48:06.009420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'186","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.576118+0000","last_change":"2024-01-17T23:00:18.556822+0000","last_active":"2024-01-18T00:48:06.576118+0000","last_peered":"2024-01-18T00:48:06.576118+0000","last_clean":"2024-01-18T00:48:06.576118+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-18T00:48:06.576118+0000","last_undegraded":"2024-01-18T00:48:06.576118+0000","last_fullsized":"2024-01-18T00:48:06.576118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:18:23.883747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'194","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.588232+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-18T00:48:11.588232+0000","last_peered":"2024-01-18T00:48:11.588232+0000","last_clean":"2024-01-18T00:48:11.588232+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-18T00:48:11.588232+0000","last_undegraded":"2024-01-18T00:48:11.588232+0000","last_fullsized":"2024-01-18T00:48:11.588232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'198","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.632621+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-18T00:48:18.632621+0000","last_peered":"2024-01-18T00:48:18.632621+0000","last_clean":"2024-01-18T00:48:18.632621+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-18T00:48:18.632621+0000","last_undegraded":"2024-01-18T00:48:18.632621+0000","last_fullsized":"2024-01-18T00:48:18.632621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2766,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1182,"num_read_kb":3686645,"num_write":24415,"num_write_kb":4363145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24889,"ondisk_log_size":24889,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12707,"ondisk_log_size":12707,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198020803,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1784,"num_read_kb":2852,"num_write":22106,"num_write_kb":205992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180723712,"data_stored":396041606,"data_compressed":51429318,"data_compressed_allocated":69492736,"data_compressed_original":284966912,"omap_allocated":0,"internal_metadata":0},"log_size":21668,"ondisk_log_size":21668,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62450,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510748,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139320,"kb_used_data":31856,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94232520,"statfs":{"total":96636764160,"available":96494100480,"internally_reserved":0,"allocated":32620544,"data_stored":76215391,"data_compressed":10068524,"data_compressed_allocated":13414400,"data_compressed_original":57212928,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.91100000000000003,"15min":0.88600000000000001},"min":{"1min":0.46700000000000003,"5min":0.44800000000000001,"15min":0.35399999999999998},"max":{"1min":1.381,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1259999999999999,"5min":1.377,"15min":1.377},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90600000000000003,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.54400000000000004,"15min":0.34599999999999997},"max":{"1min":1.5,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.046},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.59799999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.347,"5min":1.468,"15min":1.4830000000000001},"last":1.194}]},{"osd":2,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84399999999999997,"15min":0.86699999999999999},"min":{"1min":0.622,"5min":0.53600000000000003,"15min":0.47099999999999997},"max":{"1min":1.181,"5min":1.302,"15min":1.619},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.002,"15min":0.97499999999999998},"min":{"1min":0.76700000000000002,"5min":0.58299999999999996,"15min":0.45900000000000002},"max":{"1min":1.6240000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.389}]},{"osd":3,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.92500000000000004,"15min":0.92800000000000005},"min":{"1min":0.76700000000000002,"5min":0.55700000000000005,"15min":0.44900000000000001},"max":{"1min":1.1359999999999999,"5min":1.3600000000000001,"15min":1.718},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.0640000000000001,"15min":1.036},"min":{"1min":0.72499999999999998,"5min":0.65500000000000003,"15min":0.65400000000000003},"max":{"1min":1.7450000000000001,"5min":1.996,"15min":1.996},"last":1.639}]},{"osd":4,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41499999999999998},"max":{"1min":1.4039999999999999,"5min":1.7470000000000001,"15min":1.7929999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0429999999999999,"15min":1.02},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4359999999999999,"5min":1.5489999999999999,"15min":1.8700000000000001},"last":1.306}]},{"osd":5,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.1559999999999999,"15min":1.1040000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.44700000000000001},"max":{"1min":1.8360000000000001,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.702},{"interface":"front","average":{"1min":1.131,"5min":1.1399999999999999,"15min":1.101},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":1.4830000000000001,"5min":1.8500000000000001,"15min":1.994},"last":1.526}]},{"osd":6,"last update":"Thu Jan 18 00:47:34 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.585,"5min":1.6319999999999999,"15min":1.891},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.69399999999999995,"5min":0.64500000000000002,"15min":0.44900000000000001},"max":{"1min":1.5760000000000001,"5min":1.6739999999999999,"15min":1.97},"last":1.4870000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510749,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138800,"kb_used_data":23016,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94233040,"statfs":{"total":96636764160,"available":96494632960,"internally_reserved":0,"allocated":23568384,"data_stored":53979177,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":1594,"internal_metadata":118553030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.36299999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.427},"last":1.03},{"interface":"front","average":{"1min":0.871,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.41199999999999998},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.6379999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.86499999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47699999999999998},"max":{"1min":1.264,"5min":1.357,"15min":1.607},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.40899999999999997},"max":{"1min":1.3600000000000001,"5min":1.466,"15min":1.466},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.501},"max":{"1min":1.272,"5min":1.756,"15min":1.756},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0049999999999999,"15min":1.0409999999999999},"min":{"1min":0.66400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.4209999999999998},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.53400000000000003},"max":{"1min":1.347,"5min":1.347,"15min":2.3180000000000001},"last":0.999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4359999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0900000000000001,"15min":1.0469999999999999},"min":{"1min":0.53800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4770000000000001,"5min":1.964,"15min":1.964},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.40799999999999997},"max":{"1min":1.353,"5min":2.1339999999999999,"15min":2.3439999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0489999999999999,"15min":1.0669999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.3879999999999999,"5min":1.585,"15min":2.4849999999999999},"last":1.113},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":1.161},"min":{"1min":0.82899999999999996,"5min":0.56200000000000006,"15min":0.55700000000000005},"max":{"1min":1.6100000000000001,"5min":2.0609999999999999,"15min":2.1400000000000001},"last":1.147}]},{"osd":7,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.099},"min":{"1min":0.66400000000000003,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":1.7430000000000001,"5min":1.837,"15min":1.8959999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.2030000000000001},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.41799999999999998},"max":{"1min":1.831,"5min":1.8819999999999999,"15min":2.5979999999999999},"last":1.198}]}]},{"osd":5,"up_from":15,"seq":64424510749,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123756,"kb_used_data":20452,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94248084,"statfs":{"total":96636764160,"available":96510038016,"internally_reserved":0,"allocated":20942848,"data_stored":42070399,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.88800000000000001,"15min":0.879},"min":{"1min":0.56399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.89400000000000002,"15min":0.88100000000000001},"min":{"1min":0.57099999999999995,"5min":0.49399999999999999,"15min":0.46999999999999997},"max":{"1min":1.3740000000000001,"5min":1.482,"15min":1.482},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.875,"15min":0.86299999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.2350000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.93600000000000005,"15min":0.92300000000000004},"min":{"1min":0.59899999999999998,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":1.512,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.92500000000000004,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.502,"15min":1.5469999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":0.92200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2789999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.51900000000000002},"max":{"1min":1.369,"5min":1.4690000000000001,"15min":1.6160000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0469999999999999,"15min":1.036},"min":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.624},"max":{"1min":1.232,"5min":1.5620000000000001,"15min":1.6919999999999999},"last":1.2010000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.02,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.387,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.468},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.097},"min":{"1min":0.629,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":1.589,"5min":1.6639999999999999,"15min":1.7709999999999999},"last":1.355}]},{"osd":6,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.119,"15min":1.125},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.51700000000000002},"max":{"1min":1.462,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.421},{"interface":"front","average":{"1min":1.022,"5min":1.1379999999999999,"15min":1.123},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.39000000000000001},"max":{"1min":1.3580000000000001,"5min":2.032,"15min":2.032},"last":1.5900000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:47:32 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.216,"15min":1.2010000000000001},"min":{"1min":0.82599999999999996,"5min":0.58699999999999997,"15min":0.35099999999999998},"max":{"1min":1.925,"5min":1.925,"15min":2.04},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2370000000000001,"15min":1.2310000000000001},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.56599999999999995},"max":{"1min":1.421,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.6160000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510749,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138636,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94233204,"statfs":{"total":96636764160,"available":96494800896,"internally_reserved":0,"allocated":21958656,"data_stored":43628744,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":1593,"internal_metadata":119994823},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.438},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":0.78300000000000003,"15min":0.94199999999999995},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83799999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34399999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.91100000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.587},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.82499999999999996,"15min":0.80000000000000004},"min":{"1min":0.72499999999999998,"5min":0.52700000000000002,"15min":0.48999999999999999},"max":{"1min":1.1399999999999999,"5min":1.296,"15min":1.296},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.48099999999999998},"max":{"1min":1.141,"5min":1.2789999999999999,"15min":1.3080000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.46999999999999997},"max":{"1min":1.028,"5min":1.1599999999999999,"15min":1.1879999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.22,"15min":1.3109999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.497},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.5620000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85499999999999998,"15min":0.85799999999999998},"min":{"1min":0.69899999999999995,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.256},"last":1.008}]}]},{"osd":1,"up_from":15,"seq":64424510751,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141028,"kb_used_data":23836,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94230812,"statfs":{"total":96636764160,"available":96492351488,"internally_reserved":0,"allocated":24408064,"data_stored":54652877,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.439},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":1.2749999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":1.0329999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.83799999999999997},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.502},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":1.375},"last":0.434}]},{"osd":4,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.63100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.1759999999999999,"15min":1.3220000000000001},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.2629999999999999,"15min":1.5660000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.2190000000000001,"15min":1.222},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1839999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.83299999999999996},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.497},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.202,"5min":1.298,"15min":1.4239999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.69699999999999995,"5min":0.59699999999999998,"15min":0.53200000000000003},"max":{"1min":1.0660000000000001,"5min":1.339,"15min":1.341},"last":0.79100000000000004}]}]},{"osd":0,"up_from":15,"seq":64424510749,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108120,"kb_used_data":18704,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263720,"statfs":{"total":96636764160,"available":96526049280,"internally_reserved":0,"allocated":19152896,"data_stored":46854353,"data_compressed":6403410,"data_compressed_allocated":8425472,"data_compressed_original":36327424,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.79400000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70899999999999996,"5min":0.752,"15min":1.0369999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.79500000000000004,"15min":0.81599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.44,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":1.2350000000000001},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.1759999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.90100000000000002,"15min":0.93300000000000005},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.44600000000000001},"max":{"1min":0.96699999999999997,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.133,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.083,"15min":1.2869999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.335,"15min":1.335},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.52100000000000002},"max":{"1min":1.1619999999999999,"5min":1.377,"15min":1.5649999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.69999999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0349999999999999,"5min":1.2190000000000001,"15min":1.266},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1659999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.411,"15min":1.411},"last":0.79700000000000004}]}]},{"osd":4,"up_from":14,"seq":60129543454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139424,"kb_used_data":27800,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94232416,"statfs":{"total":96636764160,"available":96493993984,"internally_reserved":0,"allocated":28467200,"data_stored":58171708,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86799999999999999,"15min":0.874},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.286,"5min":1.488,"15min":1.488},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.363,"5min":1.506,"15min":1.506},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0049999999999999,"15min":0.95999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44600000000000001},"max":{"1min":1.3660000000000001,"5min":1.522,"15min":1.5329999999999999},"last":0.747},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.872},"min":{"1min":0.42799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2290000000000001,"5min":1.6200000000000001,"15min":1.7589999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54800000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.353,"5min":1.5429999999999999,"15min":1.587},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0629999999999999,"15min":1.018},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":1.5940000000000001,"15min":1.639},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.405,"5min":1.423,"15min":1.8240000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.03},"min":{"1min":0.70899999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.423,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0569999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46700000000000003},"max":{"1min":1.476,"5min":1.76,"15min":1.76},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":1.7849999999999999,"5min":1.8240000000000001,"15min":2.1960000000000002},"last":1.1970000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.7210000000000001,"5min":1.992,"15min":1.992},"last":1.276},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":1.631,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.371}]},{"osd":7,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1439999999999999,"15min":1.137},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8580000000000001,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.341},{"interface":"front","average":{"1min":1.266,"5min":1.224,"15min":1.2270000000000001},"min":{"1min":0.80400000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5089999999999999,"5min":1.9279999999999999,"15min":2.0110000000000001},"last":1.4990000000000001}]}]},{"osd":2,"up_from":14,"seq":60129543453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79108,"kb_used_data":11900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94292732,"statfs":{"total":96636764160,"available":96555757568,"internally_reserved":0,"allocated":12185600,"data_stored":22655891,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":0.877},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.76300000000000001,"15min":0.82399999999999995},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.87},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.052,"5min":1.359,"15min":1.359},"last":0.5},{"interface":"front","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.46300000000000002},"max":{"1min":0.96799999999999997,"5min":1.0900000000000001,"15min":1.3140000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":1.087,"5min":1.3100000000000001,"15min":1.3420000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.81899999999999995},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.998,"5min":1.196,"15min":1.3480000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.52500000000000002},"max":{"1min":1.079,"5min":1.254,"15min":1.476},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.56399999999999995,"15min":0.45100000000000001},"max":{"1min":1,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86099999999999999,"15min":0.85999999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.48299999999999998},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18784256,"data_stored":46138004,"data_compressed":6372185,"data_compressed_allocated":8384512,"data_compressed_original":35753984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24100864,"data_stored":54526896,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":22530423,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":43502763,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28160000,"data_stored":58046864,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":41944418,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23261184,"data_stored":53853196,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":75499042,"data_compressed":10037299,"data_compressed_allocated":13373440,"data_compressed_original":56639488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:48:36.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:48:36.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.233+0000 7f9a0d400640 1 Processor -- start 2024-01-18T00:48:36.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.233+0000 7f9a0d400640 1 -- start start 2024-01-18T00:48:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a0d400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9a08153970 0x7f9a0815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a0d400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a080cc010 0x7f9a080cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a0d400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0815a6b0 con 0x7f9a0806e970 2024-01-18T00:48:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a0d400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0806af30 con 0x7f9a080cc010 2024-01-18T00:48:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a0d400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0806e720 con 0x7f9a08153970 2024-01-18T00:48:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a07200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a080cc010 0x7f9a080cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a07200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f9a080cc010 0x7f9a080cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36176/0 (socket says 172.21.15.67:36176) 2024-01-18T00:48:36.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.237+0000 7f9a07200640 1 -- 172.21.15.67:0/827049349 learned_addr learned my addr 172.21.15.67:0/827049349 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.241+0000 7f9a07200640 1 -- 172.21.15.67:0/827049349 >> v2:172.21.15.137:3300/0 conn(0x7f9a08153970 msgr2=0x7f9a0815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.241+0000 7f9a07200640 1 --2- 172.21.15.67:0/827049349 >> v2:172.21.15.137:3300/0 conn(0x7f9a08153970 0x7f9a0815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.241+0000 7f9a07200640 1 -- 172.21.15.67:0/827049349 >> v1:172.21.15.137:6789/0 conn(0x7f9a0806e970 legacy=0x7f9a0815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.241+0000 7f9a07200640 1 -- 172.21.15.67:0/827049349 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0806ac50 con 0x7f9a080cc010 2024-01-18T00:48:36.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.245+0000 7f9a07200640 1 --2- 172.21.15.67:0/827049349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a080cc010 0x7f9a080cc480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9a080624d0 tx=0x7f9a0001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bcb3154631d2aa server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.245+0000 7f9a05400640 1 -- 172.21.15.67:0/827049349 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000af400 con 0x7f9a080cc010 2024-01-18T00:48:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a05400640 1 -- 172.21.15.67:0/827049349 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a000ab050 con 0x7f9a080cc010 2024-01-18T00:48:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a05400640 1 -- 172.21.15.67:0/827049349 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000af780 con 0x7f9a080cc010 2024-01-18T00:48:36.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- 172.21.15.67:0/827049349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a080cc010 msgr2=0x7f9a080cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- 172.21.15.67:0/827049349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a080cc010 0x7f9a080cc480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9a080624d0 tx=0x7f9a0001f180 comp rx=0 tx=0).stop 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- 172.21.15.67:0/827049349 shutdown_connections 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- 172.21.15.67:0/827049349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a080cc010 0x7f9a080cc480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- 172.21.15.67:0/827049349 >> v2:172.21.15.137:3300/0 conn(0x7f9a08153970 0x7f9a0815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- 172.21.15.67:0/827049349 >> 172.21.15.67:0/827049349 conn(0x7f9a08072670 msgr2=0x7f9a0806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- 172.21.15.67:0/827049349 shutdown_connections 2024-01-18T00:48:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- 172.21.15.67:0/827049349 wait complete. 2024-01-18T00:48:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 Processor -- start 2024-01-18T00:48:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 -- start start 2024-01-18T00:48:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a080cc010 0x7f9a0806ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.249+0000 7f9a0d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a08153970 0x7f9a081f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a0d400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080c5a10 con 0x7f9a0806e970 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a0d400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0815aa50 con 0x7f9a08153970 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a0d400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0815ad30 con 0x7f9a080cc010 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a06800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a06800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36190/0 (socket says 172.21.15.67:36190) 2024-01-18T00:48:36.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.253+0000 7f9a06800640 1 -- 172.21.15.67:0/21095576 learned_addr learned my addr 172.21.15.67:0/21095576 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 -- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a080cc010 msgr2=0x7f9a0806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a080cc010 0x7f9a0806ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 -- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a08153970 msgr2=0x7f9a081f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a08153970 0x7f9a081f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 -- 172.21.15.67:0/21095576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009b30 con 0x7f9a0806e970 2024-01-18T00:48:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.257+0000 7f9a06800640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b550 tx=0x7f99f800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.261+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8010870 con 0x7f9a0806e970 2024-01-18T00:48:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.261+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80109f0 con 0x7f9a0806e970 2024-01-18T00:48:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.261+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8010da0 con 0x7f9a0806e970 2024-01-18T00:48:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.261+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0815b010 con 0x7f9a0806e970 2024-01-18T00:48:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.261+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0815b5d0 con 0x7f9a0806e970 2024-01-18T00:48:36.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.265+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080746a0 con 0x7f9a0806e970 2024-01-18T00:48:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.284+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f99f8023480 con 0x7f9a0806e970 2024-01-18T00:48:36.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.284+0000 7f99fea00640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 0x7f99e0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.284+0000 7f9a05e00640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 0x7f99e0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.284+0000 7f9a05e00640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 0x7f99e0068d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a081e9df0 tx=0x7f99f0006bb0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.536+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99f8055bb0 con 0x7f9a0806e970 2024-01-18T00:48:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.536+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f99f8055280 con 0x7f9a0806e970 2024-01-18T00:48:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.696+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a0806b420 con 0x7f9a0806e970 2024-01-18T00:48:36.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f99fea00640 1 -- 172.21.15.67:0/21095576 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f99f801e090 con 0x7f9a0806e970 2024-01-18T00:48:36.742 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:36.742 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 msgr2=0x7f99e0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 0x7f99e0068d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a081e9df0 tx=0x7f99f0006bb0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 msgr2=0x7f9a0815be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b550 tx=0x7f99f800ba10 comp rx=0 tx=0).stop 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 shutdown_connections 2024-01-18T00:48:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f99e0066890 0x7f99e0068d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a08153970 0x7f9a081f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f9a080cc010 0x7f9a0806ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 --2- 172.21.15.67:0/21095576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a0806e970 0x7f9a0815be80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 >> 172.21.15.67:0/21095576 conn(0x7f9a08072670 msgr2=0x7f9a08158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 shutdown_connections 2024-01-18T00:48:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:36.740+0000 7f9a0d400640 1 -- 172.21.15.67:0/21095576 wait complete. 2024-01-18T00:48:37.765 INFO:tasks.ceph:Scrubbing osd.0 2024-01-18T00:48:37.766 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:37.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 Processor -- start 2024-01-18T00:48:37.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 -- start start 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 0x7f08040c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f08040c66d0 0x7f08040cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f08040cb8d0 0x7f080406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08041578c0 con 0x7f08040c66d0 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040c7770 con 0x7f08040cb8d0 2024-01-18T00:48:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.912+0000 7f080a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804157b80 con 0x7f08041518e0 2024-01-18T00:48:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f08040c66d0 0x7f08040cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f08040c66d0 0x7f08040cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36204/0 (socket says 172.21.15.67:36204) 2024-01-18T00:48:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 -- 172.21.15.67:0/2091623873 learned_addr learned my addr 172.21.15.67:0/2091623873 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0803e00640 1 --2- 172.21.15.67:0/2091623873 >> v2:172.21.15.137:3300/0 conn(0x7f08040cb8d0 0x7f080406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0803400640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 0x7f08040c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 -- 172.21.15.67:0/2091623873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 msgr2=0x7f08040c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 0x7f08040c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 -- 172.21.15.67:0/2091623873 >> v2:172.21.15.137:3300/0 conn(0x7f08040cb8d0 msgr2=0x7f080406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 --2- 172.21.15.67:0/2091623873 >> v2:172.21.15.137:3300/0 conn(0x7f08040cb8d0 0x7f080406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0802a00640 1 -- 172.21.15.67:0/2091623873 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804157e60 con 0x7f08040c66d0 2024-01-18T00:48:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.916+0000 7f0803400640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 0x7f08040c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-18T00:48:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.920+0000 7f0802a00640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08040c66d0 0x7f08040cb390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f080406fc80 tx=0x7f07ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18a7e92f0d136eb server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:37.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f0802000640 1 -- 172.21.15.67:0/2091623873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0ac600 con 0x7f08040c66d0 2024-01-18T00:48:37.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f0802000640 1 -- 172.21.15.67:0/2091623873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0a8050 con 0x7f08040c66d0 2024-01-18T00:48:37.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f0802000640 1 -- 172.21.15.67:0/2091623873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0ac980 con 0x7f08040c66d0 2024-01-18T00:48:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 -- 172.21.15.67:0/2091623873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08040c66d0 msgr2=0x7f08040cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08040c66d0 0x7f08040cb390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f080406fc80 tx=0x7f07ec01c4d0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 -- 172.21.15.67:0/2091623873 shutdown_connections 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 --2- 172.21.15.67:0/2091623873 >> v2:172.21.15.137:3300/0 conn(0x7f08040cb8d0 0x7f080406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08040c66d0 0x7f08040cb390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 --2- 172.21.15.67:0/2091623873 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08041518e0 0x7f08040c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.924+0000 7f080a400640 1 -- 172.21.15.67:0/2091623873 >> 172.21.15.67:0/2091623873 conn(0x7f080406aae0 msgr2=0x7f080406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- 172.21.15.67:0/2091623873 shutdown_connections 2024-01-18T00:48:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- 172.21.15.67:0/2091623873 wait complete. 2024-01-18T00:48:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 Processor -- start 2024-01-18T00:48:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- start start 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08040c66d0 0x7f0804144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08040cb8d0 0x7f080414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 0x7f080413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804144170 con 0x7f08041518e0 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804144e70 con 0x7f08040cb8d0 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f080a400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08041409c0 con 0x7f08040c66d0 2024-01-18T00:48:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.928+0000 7f0803e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 0x7f080413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 0x7f080413f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36212/0 (socket says 172.21.15.67:36212) 2024-01-18T00:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 -- 172.21.15.67:0/2533495997 learned_addr learned my addr 172.21.15.67:0/2533495997 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0802a00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08040cb8d0 0x7f080414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08040c66d0 0x7f0804144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 -- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08040c66d0 msgr2=0x7f0804144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08040c66d0 0x7f0804144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 -- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08040cb8d0 msgr2=0x7f080414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08040cb8d0 0x7f080414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.932+0000 7f0803e00640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0094d0 con 0x7f08041518e0 2024-01-18T00:48:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.936+0000 7f0803e00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 0x7f080413f940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00efc0 tx=0x7f07fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc014480 con 0x7f08041518e0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc00f040 con 0x7f08041518e0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc014820 con 0x7f08041518e0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08041423b0 con 0x7f08041518e0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804140ca0 con 0x7f08041518e0 2024-01-18T00:48:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.944+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08040c5c70 con 0x7f08041518e0 2024-01-18T00:48:37.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.964+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f07fc014980 con 0x7f08041518e0 2024-01-18T00:48:37.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.964+0000 7f07fb400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f07dc066890 0x7f07dc068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f0803400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f07dc066890 0x7f07dc068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f0803400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f07dc066890 0x7f07dc068d50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009650 tx=0x7f07f4008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07fc0569c0 con 0x7f08041518e0 2024-01-18T00:48:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f07fb400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f07dc0700f0 0x7f07dc072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07dc072c60 con 0x7f07dc0700f0 2024-01-18T00:48:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f0802a00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f07dc0700f0 0x7f07dc072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc052600 con 0x7f08041518e0 2024-01-18T00:48:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f0802a00640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f07dc0700f0 0x7f07dc072590 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:37.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.968+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== osd.0 v2:172.21.15.67:6808/3222856110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f07dc072c60 con 0x7f07dc0700f0 2024-01-18T00:48:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 --> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f080406e590 con 0x7f07dc0700f0 2024-01-18T00:48:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f07fb400640 1 -- 172.21.15.67:0/2533495997 <== osd.0 v2:172.21.15.67:6808/3222856110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f07ec0ac520 con 0x7f07dc0700f0 2024-01-18T00:48:37.986 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:37.986 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:37.986 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f07dc0700f0 msgr2=0x7f07dc072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:6808/3222856110,v1:172.21.15.67:6809/3222856110] conn(0x7f07dc0700f0 0x7f07dc072590 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f07dc066890 msgr2=0x7f07dc068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f07dc066890 0x7f07dc068d50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009650 tx=0x7f07f4008040 comp rx=0 tx=0).stop 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 msgr2=0x7f080413f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 --2- 172.21.15.67:0/2533495997 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08041518e0 0x7f080413f940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00efc0 tx=0x7f07fc00c490 comp rx=0 tx=0).stop 2024-01-18T00:48:37.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f0803e00640 1 -- 172.21.15.67:0/2533495997 reap_dead start 2024-01-18T00:48:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 shutdown_connections 2024-01-18T00:48:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 >> 172.21.15.67:0/2533495997 conn(0x7f080406aae0 msgr2=0x7f080406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 shutdown_connections 2024-01-18T00:48:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:37.984+0000 7f080a400640 1 -- 172.21.15.67:0/2533495997 wait complete. 2024-01-18T00:48:38.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-18T00:48:38.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 Processor -- start 2024-01-18T00:48:38.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 -- start start 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3da4153af0 0x7f3da415a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3da4153ed0 0x7f3da406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da40ca590 0x7f3da415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da415d7e0 con 0x7f3da4153ed0 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da415dd80 con 0x7f3da4153af0 2024-01-18T00:48:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.144+0000 7f3da8e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415daa0 con 0x7f3da40ca590 2024-01-18T00:48:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3da4153ed0 0x7f3da406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3da4153ed0 0x7f3da406b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36214/0 (socket says 172.21.15.67:36214) 2024-01-18T00:48:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 -- 172.21.15.67:0/2014365717 learned_addr learned my addr 172.21.15.67:0/2014365717 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1e00640 1 --2- 172.21.15.67:0/2014365717 >> v2:172.21.15.137:3300/0 conn(0x7f3da4153af0 0x7f3da415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da2800640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da40ca590 0x7f3da415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 -- 172.21.15.67:0/2014365717 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da40ca590 msgr2=0x7f3da415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da40ca590 0x7f3da415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 -- 172.21.15.67:0/2014365717 >> v2:172.21.15.137:3300/0 conn(0x7f3da4153af0 msgr2=0x7f3da415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 --2- 172.21.15.67:0/2014365717 >> v2:172.21.15.137:3300/0 conn(0x7f3da4153af0 0x7f3da415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.148+0000 7f3da1400640 1 -- 172.21.15.67:0/2014365717 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4159a80 con 0x7f3da4153ed0 2024-01-18T00:48:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.152+0000 7f3da1400640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da4153ed0 0x7f3da406b7f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3da406fff0 tx=0x7f3d8c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6519c19767bfaab server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da0a00640 1 -- 172.21.15.67:0/2014365717 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0aa620 con 0x7f3da4153ed0 2024-01-18T00:48:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da0a00640 1 -- 172.21.15.67:0/2014365717 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0aa780 con 0x7f3da4153ed0 2024-01-18T00:48:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da0a00640 1 -- 172.21.15.67:0/2014365717 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0aab10 con 0x7f3da4153ed0 2024-01-18T00:48:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 -- 172.21.15.67:0/2014365717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da4153ed0 msgr2=0x7f3da406b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da4153ed0 0x7f3da406b7f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3da406fff0 tx=0x7f3d8c01c500 comp rx=0 tx=0).stop 2024-01-18T00:48:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 -- 172.21.15.67:0/2014365717 shutdown_connections 2024-01-18T00:48:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da40ca590 0x7f3da415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 --2- 172.21.15.67:0/2014365717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da4153ed0 0x7f3da406b7f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 --2- 172.21.15.67:0/2014365717 >> v2:172.21.15.137:3300/0 conn(0x7f3da4153af0 0x7f3da415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.156+0000 7f3da8e00640 1 -- 172.21.15.67:0/2014365717 >> 172.21.15.67:0/2014365717 conn(0x7f3da40704f0 msgr2=0x7f3da406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- 172.21.15.67:0/2014365717 shutdown_connections 2024-01-18T00:48:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- 172.21.15.67:0/2014365717 wait complete. 2024-01-18T00:48:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 Processor -- start 2024-01-18T00:48:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- start start 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da4153af0 0x7f3da41f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da4153ed0 0x7f3da40b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40b1f80 con 0x7f3da40ca590 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da415af70 con 0x7f3da4153af0 2024-01-18T00:48:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da8e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da413c710 con 0x7f3da4153ed0 2024-01-18T00:48:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da1e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36220/0 (socket says 172.21.15.67:36220) 2024-01-18T00:48:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da1e00640 1 -- 172.21.15.67:0/742166386 learned_addr learned my addr 172.21.15.67:0/742166386 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da1400640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da4153af0 0x7f3da41f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.160+0000 7f3da2800640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da4153ed0 0x7f3da40b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.164+0000 7f3da1e00640 1 -- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da4153ed0 msgr2=0x7f3da40b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.164+0000 7f3da1e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da4153ed0 0x7f3da40b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.164+0000 7f3da1e00640 1 -- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da4153af0 msgr2=0x7f3da41f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.164+0000 7f3da1e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da4153af0 0x7f3da41f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.164+0000 7f3da1e00640 1 -- 172.21.15.67:0/742166386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0094d0 con 0x7f3da40ca590 2024-01-18T00:48:38.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.168+0000 7f3da1e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e960 tx=0x7f3d9400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94009690 con 0x7f3da40ca590 2024-01-18T00:48:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400ca00 con 0x7f3da40ca590 2024-01-18T00:48:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400cd70 con 0x7f3da40ca590 2024-01-18T00:48:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da41f2c30 con 0x7f3da40ca590 2024-01-18T00:48:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da40b1ca0 con 0x7f3da40ca590 2024-01-18T00:48:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.172+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da40746a0 con 0x7f3da40ca590 2024-01-18T00:48:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.192+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f3d94013470 con 0x7f3da40ca590 2024-01-18T00:48:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.196+0000 7f3d9a000640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 0x7f3d7c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.196+0000 7f3da1400640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 0x7f3d7c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.196+0000 7f3da1400640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 0x7f3d7c068d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0ae000 tx=0x7f3d8c0b5040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.196+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d94055a90 con 0x7f3da40ca590 2024-01-18T00:48:38.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.440+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f3d94051dd0 con 0x7f3da40ca590 2024-01-18T00:48:38.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.600+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3da40cd090 con 0x7f3d7c066890 2024-01-18T00:48:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3d9a000640 1 -- 172.21.15.67:0/742166386 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d8c0aa520 con 0x7f3d7c066890 2024-01-18T00:48:38.605 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 msgr2=0x7f3d7c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 0x7f3d7c068d50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0ae000 tx=0x7f3d8c0b5040 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 msgr2=0x7f3da415b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e960 tx=0x7f3d9400ee20 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 shutdown_connections 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f3d7c066890 0x7f3d7c068d50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f3da4153ed0 0x7f3da40b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3da4153af0 0x7f3da41f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 --2- 172.21.15.67:0/742166386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3da40ca590 0x7f3da415b400 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 >> 172.21.15.67:0/742166386 conn(0x7f3da40704f0 msgr2=0x7f3da40cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:38.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 shutdown_connections 2024-01-18T00:48:38.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.604+0000 7f3da8e00640 1 -- 172.21.15.67:0/742166386 wait complete. 2024-01-18T00:48:38.628 INFO:tasks.ceph:Scrubbing osd.1 2024-01-18T00:48:38.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:38.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 Processor -- start 2024-01-18T00:48:38.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 -- start start 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1fa414fb50 0x7f1fa4071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 0x7f1fa40c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 0x7f1fa40c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa4155b30 con 0x7f1fa414fb50 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa41590d0 con 0x7f1fa40717c0 2024-01-18T00:48:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4155d20 con 0x7f1fa4072930 2024-01-18T00:48:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fa3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1fa414fb50 0x7f1fa4071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fa3e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1fa414fb50 0x7f1fa4071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36228/0 (socket says 172.21.15.67:36228) 2024-01-18T00:48:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fa3e00640 1 -- 172.21.15.67:0/4140963167 learned_addr learned my addr 172.21.15.67:0/4140963167 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fa9200640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 0x7f1fa40c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.772+0000 7f1fa3400640 1 --2- 172.21.15.67:0/4140963167 >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 0x7f1fa40c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3e00640 1 -- 172.21.15.67:0/4140963167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 msgr2=0x7f1fa40c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:38.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3e00640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 0x7f1fa40c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3e00640 1 -- 172.21.15.67:0/4140963167 >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 msgr2=0x7f1fa40c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:38.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3e00640 1 --2- 172.21.15.67:0/4140963167 >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 0x7f1fa40c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3e00640 1 -- 172.21.15.67:0/4140963167 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4155fe0 con 0x7f1fa414fb50 2024-01-18T00:48:38.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa9200640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 0x7f1fa40c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-18T00:48:38.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.776+0000 7f1fa3400640 1 --2- 172.21.15.67:0/4140963167 >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 0x7f1fa40c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-18T00:48:38.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.780+0000 7f1fa3e00640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa414fb50 0x7f1fa4071280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40cbdb0 tx=0x7f1f9401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd59421ea8b9ead server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fa2a00640 1 -- 172.21.15.67:0/4140963167 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940a7bb0 con 0x7f1fa414fb50 2024-01-18T00:48:38.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fa2a00640 1 -- 172.21.15.67:0/4140963167 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940a7d10 con 0x7f1fa414fb50 2024-01-18T00:48:38.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fa2a00640 1 -- 172.21.15.67:0/4140963167 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940af660 con 0x7f1fa414fb50 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 -- 172.21.15.67:0/4140963167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa414fb50 msgr2=0x7f1fa4071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa414fb50 0x7f1fa4071280 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40cbdb0 tx=0x7f1f9401eba0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 -- 172.21.15.67:0/4140963167 shutdown_connections 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa4072930 0x7f1fa40c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 --2- 172.21.15.67:0/4140963167 >> v2:172.21.15.137:3300/0 conn(0x7f1fa40717c0 0x7f1fa40c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 --2- 172.21.15.67:0/4140963167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa414fb50 0x7f1fa4071280 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 -- 172.21.15.67:0/4140963167 >> 172.21.15.67:0/4140963167 conn(0x7f1fa406aae0 msgr2=0x7f1fa406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 -- 172.21.15.67:0/4140963167 shutdown_connections 2024-01-18T00:48:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.784+0000 7f1fab200640 1 -- 172.21.15.67:0/4140963167 wait complete. 2024-01-18T00:48:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 Processor -- start 2024-01-18T00:48:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 -- start start 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fa40717c0 0x7f1fa413b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa4072930 0x7f1fa4134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa414fb50 0x7f1fa412fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa413b760 con 0x7f1fa4072930 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41faae0 con 0x7f1fa40717c0 2024-01-18T00:48:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fab200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa413a580 con 0x7f1fa414fb50 2024-01-18T00:48:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fa9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa414fb50 0x7f1fa412fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fa3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fa40717c0 0x7f1fa413b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fa9200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa414fb50 0x7f1fa412fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:58124/0 (socket says 172.21.15.67:58124) 2024-01-18T00:48:38.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fa9200640 1 -- 172.21.15.67:0/3105259726 learned_addr learned my addr 172.21.15.67:0/3105259726 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:38.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.788+0000 7f1fa3400640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa4072930 0x7f1fa4134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.792+0000 7f1fa3400640 1 -- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa414fb50 msgr2=0x7f1fa412fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.792+0000 7f1fa3400640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f1fa414fb50 0x7f1fa412fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.792+0000 7f1fa3400640 1 -- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fa40717c0 msgr2=0x7f1fa413b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.792+0000 7f1fa3400640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fa40717c0 0x7f1fa413b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.792+0000 7f1fa3400640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9400b770 con 0x7f1fa4072930 2024-01-18T00:48:38.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.796+0000 7f1fa3400640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa4072930 0x7f1fa4134b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e5e0 tx=0x7f1f8c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004230 con 0x7f1fa4072930 2024-01-18T00:48:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c004390 con 0x7f1fa4072930 2024-01-18T00:48:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003860 con 0x7f1fa4072930 2024-01-18T00:48:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa41350d0 con 0x7f1fa4072930 2024-01-18T00:48:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa41f9f10 con 0x7f1fa4072930 2024-01-18T00:48:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.800+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fa414ff30 con 0x7f1fa4072930 2024-01-18T00:48:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.820+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f1f8c0039c0 con 0x7f1fa4072930 2024-01-18T00:48:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.820+0000 7f1f9be00640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f7c0668c0 0x7f1f7c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1fa3e00640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f7c0668c0 0x7f1f7c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1fa3e00640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f7c0668c0 0x7f1f7c068d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f940b1000 tx=0x7f1f940a9070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f8c054ea0 con 0x7f1fa4072930 2024-01-18T00:48:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1f9be00640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f1f7c0701a0 0x7f1f7c072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f7c072d10 con 0x7f1f7c0701a0 2024-01-18T00:48:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f8c0511e0 con 0x7f1fa4072930 2024-01-18T00:48:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.824+0000 7f1fa9200640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f1f7c0701a0 0x7f1f7c072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.828+0000 7f1fa9200640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f1f7c0701a0 0x7f1f7c072640 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:38.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.828+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== osd.1 v2:172.21.15.67:6816/2710123956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1f7c072d10 con 0x7f1f7c0701a0 2024-01-18T00:48:38.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 --> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1fa40746a0 con 0x7f1f7c0701a0 2024-01-18T00:48:38.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1f9be00640 1 -- 172.21.15.67:0/3105259726 <== osd.1 v2:172.21.15.67:6816/2710123956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1fa40746a0 con 0x7f1f7c0701a0 2024-01-18T00:48:38.844 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:38.844 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:38.844 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f1f7c0701a0 msgr2=0x7f1f7c072640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:6816/2710123956,v1:172.21.15.67:6817/2710123956] conn(0x7f1f7c0701a0 0x7f1f7c072640 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f7c0668c0 msgr2=0x7f1f7c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f1f7c0668c0 0x7f1f7c068d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f940b1000 tx=0x7f1f940a9070 comp rx=0 tx=0).stop 2024-01-18T00:48:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa4072930 msgr2=0x7f1fa4134b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 --2- 172.21.15.67:0/3105259726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1fa4072930 0x7f1fa4134b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00e5e0 tx=0x7f1f8c00eaa0 comp rx=0 tx=0).stop 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fa9200640 1 -- 172.21.15.67:0/3105259726 reap_dead start 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 shutdown_connections 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.840+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 >> 172.21.15.67:0/3105259726 conn(0x7f1fa406aae0 msgr2=0x7f1fa4071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.844+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 shutdown_connections 2024-01-18T00:48:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:38.844+0000 7f1fab200640 1 -- 172.21.15.67:0/3105259726 wait complete. 2024-01-18T00:48:38.864 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-18T00:48:39.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.004+0000 7f541f600640 1 Processor -- start 2024-01-18T00:48:39.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.004+0000 7f541f600640 1 -- start start 2024-01-18T00:48:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 0x7f5418156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541f600640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f54180c68c0 0x7f541806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541f600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5418159ad0 con 0x7f54180c6480 2024-01-18T00:48:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541f600640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5418156ad0 con 0x7f54180c68c0 2024-01-18T00:48:39.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541806cc20 con 0x7f541814ff10 2024-01-18T00:48:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f5417e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f54180c6480 0x7f541806d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:35204/0 (socket says 172.21.15.67:35204) 2024-01-18T00:48:39.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f5417e00640 1 -- 172.21.15.67:0/2359877491 learned_addr learned my addr 172.21.15.67:0/2359877491 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.008+0000 7f541cc00640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 0x7f5418156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.012+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901232886 0 0) 0x7f5418159ad0 con 0x7f54180c6480 2024-01-18T00:48:39.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.012+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f8003530 con 0x7f54180c6480 2024-01-18T00:48:39.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.012+0000 7f541d600640 1 --2- 172.21.15.67:0/2359877491 >> v2:172.21.15.137:3300/0 conn(0x7f54180c68c0 0x7f541806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288889885 0 0) 0x7f53f8003530 con 0x7f54180c6480 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 msgr2=0x7f5418156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 0x7f5418156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 >> v2:172.21.15.137:3300/0 conn(0x7f54180c68c0 msgr2=0x7f541806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 --2- 172.21.15.67:0/2359877491 >> v2:172.21.15.137:3300/0 conn(0x7f54180c68c0 0x7f541806de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541806cf00 con 0x7f54180c6480 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f5400001680 con 0x7f54180c6480 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 >> v1:172.21.15.67:6789/0 conn(0x7f54180c6480 legacy=0x7f541806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f53f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53f80047d0 0x7f53f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 0x7f53f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418156ad0 con 0x7f53f8003980 2024-01-18T00:48:39.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541806cc20 con 0x7f53f80047d0 2024-01-18T00:48:39.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f800b9c0 con 0x7f541814ff10 2024-01-18T00:48:39.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.016+0000 7f541cc00640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f53f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.024+0000 7f541cc00640 1 -- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 msgr2=0x7f53f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.024+0000 7f541cc00640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f541814ff10 0x7f53f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.024+0000 7f541cc00640 1 -- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53f80047d0 msgr2=0x7f53f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.024+0000 7f541cc00640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53f80047d0 0x7f53f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.024+0000 7f541cc00640 1 -- 172.21.15.67:0/2359877491 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8003530 con 0x7f53f8003980 2024-01-18T00:48:39.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.028+0000 7f541cc00640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f53f8003da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ae0 tx=0x7f540801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1d7cab755323d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080a55a0 con 0x7f53f8003980 2024-01-18T00:48:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080a5700 con 0x7f53f8003980 2024-01-18T00:48:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f5417400640 1 -- 172.21.15.67:0/2359877491 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080a5af0 con 0x7f53f8003980 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- 172.21.15.67:0/2359877491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 msgr2=0x7f53f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 --2- 172.21.15.67:0/2359877491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f53f8003da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ae0 tx=0x7f540801ca90 comp rx=0 tx=0).stop 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541d600640 1 -- 172.21.15.67:0/2359877491 reap_dead start 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- 172.21.15.67:0/2359877491 shutdown_connections 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- 172.21.15.67:0/2359877491 >> 172.21.15.67:0/2359877491 conn(0x7f54180cb070 msgr2=0x7f54180cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- 172.21.15.67:0/2359877491 shutdown_connections 2024-01-18T00:48:39.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- 172.21.15.67:0/2359877491 wait complete. 2024-01-18T00:48:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 Processor -- start 2024-01-18T00:48:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.032+0000 7f541f600640 1 -- start start 2024-01-18T00:48:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5418154b00 0x7f5418154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54180c17b0 0x7f54180c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54181554a0 con 0x7f53f8003980 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180c0d20 con 0x7f5418154b00 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541f600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54181514b0 con 0x7f54180c17b0 2024-01-18T00:48:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541cc00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36258/0 (socket says 172.21.15.67:36258) 2024-01-18T00:48:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541cc00640 1 -- 172.21.15.67:0/3545048028 learned_addr learned my addr 172.21.15.67:0/3545048028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f541d600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54180c17b0 0x7f54180c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.036+0000 7f5417e00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5418154b00 0x7f5418154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 -- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54180c17b0 msgr2=0x7f54180c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54180c17b0 0x7f54180c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 -- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5418154b00 msgr2=0x7f5418154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5418154b00 0x7f5418154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 -- 172.21.15.67:0/3545048028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418151790 con 0x7f53f8003980 2024-01-18T00:48:39.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.040+0000 7f541cc00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f540801c8c0 tx=0x7f53f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.044+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080be070 con 0x7f53f8003980 2024-01-18T00:48:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.044+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080a5d90 con 0x7f53f8003980 2024-01-18T00:48:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.044+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5418151a70 con 0x7f53f8003980 2024-01-18T00:48:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.044+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408004240 con 0x7f53f8003980 2024-01-18T00:48:39.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.044+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5418150540 con 0x7f53f8003980 2024-01-18T00:48:39.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.048+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54180746a0 con 0x7f53f8003980 2024-01-18T00:48:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.068+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f54080b4040 con 0x7f53f8003980 2024-01-18T00:48:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.068+0000 7f5414c00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 0x7f53f0068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.068+0000 7f5417e00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 0x7f53f0068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.068+0000 7f5417e00640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 0x7f53f0068d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5400004880 tx=0x7f540000a9a0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.072+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54080ef110 con 0x7f53f8003980 2024-01-18T00:48:39.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.316+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f54080eb450 con 0x7f53f8003980 2024-01-18T00:48:39.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.476+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5418159760 con 0x7f53f00668c0 2024-01-18T00:48:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.476+0000 7f5414c00640 1 -- 172.21.15.67:0/3545048028 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f540000a050 con 0x7f53f00668c0 2024-01-18T00:48:39.480 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 msgr2=0x7f53f0068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 0x7f53f0068d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5400004880 tx=0x7f540000a9a0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 msgr2=0x7f5418150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f540801c8c0 tx=0x7f53f8005800 comp rx=0 tx=0).stop 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 shutdown_connections 2024-01-18T00:48:39.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f53f00668c0 0x7f53f0068d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f54180c17b0 0x7f54180c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5418154b00 0x7f5418154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 --2- 172.21.15.67:0/3545048028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f8003980 0x7f5418150a10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 >> 172.21.15.67:0/3545048028 conn(0x7f54180cb070 msgr2=0x7f54180c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 shutdown_connections 2024-01-18T00:48:39.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.480+0000 7f541f600640 1 -- 172.21.15.67:0/3545048028 wait complete. 2024-01-18T00:48:39.503 INFO:tasks.ceph:Scrubbing osd.2 2024-01-18T00:48:39.503 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.644+0000 7fcc77600640 1 Processor -- start 2024-01-18T00:48:39.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.644+0000 7fcc77600640 1 -- start start 2024-01-18T00:48:39.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc77600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc70157000 0x7fcc700c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc77600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700c9530 con 0x7fcc700cc1d0 2024-01-18T00:48:39.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc77600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700c8c40 con 0x7fcc700cc5b0 2024-01-18T00:48:39.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc77600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc700c8a30 con 0x7fcc70157000 2024-01-18T00:48:39.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc75600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc70157000 0x7fcc700c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc6fe00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcc700cc5b0 0x7fcc701568f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:40276/0 (socket says 172.21.15.67:40276) 2024-01-18T00:48:39.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.648+0000 7fcc6fe00640 1 -- 172.21.15.67:0/3042551350 learned_addr learned my addr 172.21.15.67:0/3042551350 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:39.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.652+0000 7fcc75600640 1 -- 172.21.15.67:0/3042551350 >> v1:172.21.15.137:6789/0 conn(0x7fcc700cc5b0 legacy=0x7fcc701568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.652+0000 7fcc75600640 1 -- 172.21.15.67:0/3042551350 >> v1:172.21.15.67:6789/0 conn(0x7fcc700cc1d0 legacy=0x7fcc7015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.652+0000 7fcc75600640 1 -- 172.21.15.67:0/3042551350 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7006b390 con 0x7fcc70157000 2024-01-18T00:48:39.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.656+0000 7fcc75600640 1 --2- 172.21.15.67:0/3042551350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc70157000 0x7fcc700c28c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc6801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bdcb11d5c8f728 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.660+0000 7fcc6f400640 1 -- 172.21.15.67:0/3042551350 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5780 con 0x7fcc70157000 2024-01-18T00:48:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.660+0000 7fcc6f400640 1 -- 172.21.15.67:0/3042551350 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc680a58e0 con 0x7fcc70157000 2024-01-18T00:48:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.660+0000 7fcc6f400640 1 -- 172.21.15.67:0/3042551350 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680a5c70 con 0x7fcc70157000 2024-01-18T00:48:39.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.660+0000 7fcc77600640 1 -- 172.21.15.67:0/3042551350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc70157000 msgr2=0x7fcc700c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.660+0000 7fcc77600640 1 --2- 172.21.15.67:0/3042551350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc70157000 0x7fcc700c28c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d90 tx=0x7fcc6801c8c0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- 172.21.15.67:0/3042551350 shutdown_connections 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 --2- 172.21.15.67:0/3042551350 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc70157000 0x7fcc700c28c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- 172.21.15.67:0/3042551350 >> 172.21.15.67:0/3042551350 conn(0x7fcc7006b7f0 msgr2=0x7fcc7006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- 172.21.15.67:0/3042551350 shutdown_connections 2024-01-18T00:48:39.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- 172.21.15.67:0/3042551350 wait complete. 2024-01-18T00:48:39.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 Processor -- start 2024-01-18T00:48:39.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- start start 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cc1d0 0x7fcc700c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 0x7fcc700c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc70157000 0x7fcc70147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70154ff0 con 0x7fcc700cc5b0 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc701f6c80 con 0x7fcc700cc1d0 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc77600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70152970 con 0x7fcc70157000 2024-01-18T00:48:39.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.664+0000 7fcc6fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 0x7fcc700c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc6fe00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 0x7fcc700c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36274/0 (socket says 172.21.15.67:36274) 2024-01-18T00:48:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc6fe00640 1 -- 172.21.15.67:0/3340690175 learned_addr learned my addr 172.21.15.67:0/3340690175 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc74c00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cc1d0 0x7fcc700c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc75600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc70157000 0x7fcc70147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc6fe00640 1 -- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc70157000 msgr2=0x7fcc70147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc6fe00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fcc70157000 0x7fcc70147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.668+0000 7fcc6fe00640 1 -- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cc1d0 msgr2=0x7fcc700c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.672+0000 7fcc6fe00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc700cc1d0 0x7fcc700c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.672+0000 7fcc6fe00640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68009a70 con 0x7fcc700cc5b0 2024-01-18T00:48:39.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.676+0000 7fcc6fe00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 0x7fcc700c50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c3a0 tx=0x7fcc5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.676+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58005cf0 con 0x7fcc700cc5b0 2024-01-18T00:48:39.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.676+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58005e50 con 0x7fcc700cc5b0 2024-01-18T00:48:39.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.676+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580072f0 con 0x7fcc700cc5b0 2024-01-18T00:48:39.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.680+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7015d650 con 0x7fcc700cc5b0 2024-01-18T00:48:39.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.680+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc70152c50 con 0x7fcc700cc5b0 2024-01-18T00:48:39.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.680+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc7006afc0 con 0x7fcc700cc5b0 2024-01-18T00:48:39.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.700+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fcc58007450 con 0x7fcc700cc5b0 2024-01-18T00:48:39.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.700+0000 7fcc6cc00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fcc48066890 0x7fcc48068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.700+0000 7fcc74c00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fcc48066890 0x7fcc48068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.700+0000 7fcc74c00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fcc48066890 0x7fcc48068d50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001770 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcc58054d10 con 0x7fcc700cc5b0 2024-01-18T00:48:39.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc6cc00640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7fcc48070170 0x7fcc48072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc48072ce0 con 0x7fcc48070170 2024-01-18T00:48:39.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc58051050 con 0x7fcc700cc5b0 2024-01-18T00:48:39.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc75600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7fcc48070170 0x7fcc48072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc75600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7fcc48070170 0x7fcc48072610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:39.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.704+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== osd.2 v2:172.21.15.67:6800/549028895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcc48072ce0 con 0x7fcc48070170 2024-01-18T00:48:39.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 --> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc70152ab0 con 0x7fcc48070170 2024-01-18T00:48:39.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc6cc00640 1 -- 172.21.15.67:0/3340690175 <== osd.2 v2:172.21.15.67:6800/549028895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcc680a5af0 con 0x7fcc48070170 2024-01-18T00:48:39.721 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:39.721 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:39.721 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7fcc48070170 msgr2=0x7fcc48072610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:6800/549028895,v1:172.21.15.67:6801/549028895] conn(0x7fcc48070170 0x7fcc48072610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fcc48066890 msgr2=0x7fcc48068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fcc48066890 0x7fcc48068d50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001770 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 msgr2=0x7fcc700c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 --2- 172.21.15.67:0/3340690175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc700cc5b0 0x7fcc700c50c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c3a0 tx=0x7fcc5800c860 comp rx=0 tx=0).stop 2024-01-18T00:48:39.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc75600640 1 -- 172.21.15.67:0/3340690175 reap_dead start 2024-01-18T00:48:39.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 shutdown_connections 2024-01-18T00:48:39.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 >> 172.21.15.67:0/3340690175 conn(0x7fcc7006b7f0 msgr2=0x7fcc7006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:39.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 shutdown_connections 2024-01-18T00:48:39.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.720+0000 7fcc77600640 1 -- 172.21.15.67:0/3340690175 wait complete. 2024-01-18T00:48:39.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-18T00:48:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 Processor -- start 2024-01-18T00:48:39.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 -- start start 2024-01-18T00:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f7815b620 0x7f6f78061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f78061640 0x7f6f780c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f780c7d10 con 0x7f6f781517f0 2024-01-18T00:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f781576d0 con 0x7f6f7815b620 2024-01-18T00:48:39.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.888+0000 7f6f7f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78157970 con 0x7f6f78061640 2024-01-18T00:48:39.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.896+0000 7f6f77e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6f781517f0 0x7f6f780ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:40292/0 (socket says 172.21.15.67:40292) 2024-01-18T00:48:39.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.896+0000 7f6f77e00640 1 -- 172.21.15.67:0/2521275595 learned_addr learned my addr 172.21.15.67:0/2521275595 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:39.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.896+0000 7f6f7d200640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f78061640 0x7f6f780c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.896+0000 7f6f77400640 1 --2- 172.21.15.67:0/2521275595 >> v2:172.21.15.137:3300/0 conn(0x7f6f7815b620 0x7f6f78061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:39.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.908+0000 7f6f77400640 1 -- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f78061640 msgr2=0x7f6f780c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:39.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.908+0000 7f6f77400640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f78061640 0x7f6f780c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:39.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.908+0000 7f6f77400640 1 -- 172.21.15.67:0/2521275595 >> v1:172.21.15.137:6789/0 conn(0x7f6f781517f0 legacy=0x7f6f780ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:39.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:39.908+0000 7f6f77400640 1 -- 172.21.15.67:0/2521275595 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78157c50 con 0x7f6f7815b620 2024-01-18T00:48:40.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.008+0000 7f6f77400640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f78061100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f6001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d4fc5fccb611872 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.016+0000 7f6f76a00640 1 -- 172.21.15.67:0/2521275595 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600ad640 con 0x7f6f7815b620 2024-01-18T00:48:40.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.016+0000 7f6f76a00640 1 -- 172.21.15.67:0/2521275595 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600ad7a0 con 0x7f6f7815b620 2024-01-18T00:48:40.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.016+0000 7f6f76a00640 1 -- 172.21.15.67:0/2521275595 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600adb30 con 0x7f6f7815b620 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 msgr2=0x7f6f78061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f78061100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f6001c480 comp rx=0 tx=0).stop 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- 172.21.15.67:0/2521275595 shutdown_connections 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f78061640 0x7f6f780c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- 172.21.15.67:0/2521275595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f78061100 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- 172.21.15.67:0/2521275595 >> 172.21.15.67:0/2521275595 conn(0x7f6f7806ad40 msgr2=0x7f6f7806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:40.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- 172.21.15.67:0/2521275595 shutdown_connections 2024-01-18T00:48:40.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- 172.21.15.67:0/2521275595 wait complete. 2024-01-18T00:48:40.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 Processor -- start 2024-01-18T00:48:40.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- start start 2024-01-18T00:48:40.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f781517f0 0x7f6f780cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f781f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78141b90 con 0x7f6f78061640 2024-01-18T00:48:40.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78144240 con 0x7f6f7815b620 2024-01-18T00:48:40.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.020+0000 7f6f7f200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f78145160 con 0x7f6f781517f0 2024-01-18T00:48:40.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.024+0000 7f6f77e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.024+0000 7f6f77400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f781517f0 0x7f6f780cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.024+0000 7f6f77e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36284/0 (socket says 172.21.15.67:36284) 2024-01-18T00:48:40.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.024+0000 7f6f77e00640 1 -- 172.21.15.67:0/376240944 learned_addr learned my addr 172.21.15.67:0/376240944 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:40.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.024+0000 7f6f7d200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f781f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 -- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f781517f0 msgr2=0x7f6f780cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f781517f0 0x7f6f780cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 -- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 msgr2=0x7f6f781f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f781f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 -- 172.21.15.67:0/376240944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009420 con 0x7f6f78061640 2024-01-18T00:48:40.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.028+0000 7f6f77e00640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c420 tx=0x7f6f6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68005cf0 con 0x7f6f78061640 2024-01-18T00:48:40.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f68005e50 con 0x7f6f78061640 2024-01-18T00:48:40.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f680072f0 con 0x7f6f78061640 2024-01-18T00:48:40.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78145440 con 0x7f6f78061640 2024-01-18T00:48:40.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f78144480 con 0x7f6f78061640 2024-01-18T00:48:40.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.036+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780c76f0 con 0x7f6f78061640 2024-01-18T00:48:40.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.056+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f6f68007450 con 0x7f6f78061640 2024-01-18T00:48:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.056+0000 7f6f6fe00640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 0x7f6f50068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.060+0000 7f6f77400640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 0x7f6f50068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.060+0000 7f6f77400640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 0x7f6f50068d50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f600af000 tx=0x7f6f600a7070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.304+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f68013e70 con 0x7f6f78061640 2024-01-18T00:48:40.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.304+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f6f68050dd0 con 0x7f6f78061640 2024-01-18T00:48:40.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.468+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f78151bd0 con 0x7f6f50066890 2024-01-18T00:48:40.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.468+0000 7f6f6fe00640 1 -- 172.21.15.67:0/376240944 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f600bd090 con 0x7f6f50066890 2024-01-18T00:48:40.471 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 msgr2=0x7f6f50068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 0x7f6f50068d50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f600af000 tx=0x7f6f600a7070 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 msgr2=0x7f6f780b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800c420 tx=0x7f6f6800c8e0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 shutdown_connections 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f6f50066890 0x7f6f50068d50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f7815b620 0x7f6f781f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f6f781517f0 0x7f6f780cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 --2- 172.21.15.67:0/376240944 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f78061640 0x7f6f780b0500 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 >> 172.21.15.67:0/376240944 conn(0x7f6f7806ad40 msgr2=0x7f6f78073ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:40.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 shutdown_connections 2024-01-18T00:48:40.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.472+0000 7f6f7f200640 1 -- 172.21.15.67:0/376240944 wait complete. 2024-01-18T00:48:40.495 INFO:tasks.ceph:Scrubbing osd.3 2024-01-18T00:48:40.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 Processor -- start 2024-01-18T00:48:40.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 -- start start 2024-01-18T00:48:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 0x7f31d4164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415a5e0 con 0x7f31d41539b0 2024-01-18T00:48:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d4153d90 con 0x7f31d40ca2b0 2024-01-18T00:48:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.640+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d415ce40 con 0x7f31d40c93a0 2024-01-18T00:48:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.644+0000 7f31d3400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f31d40ca2b0 0x7f31d415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:33954/0 (socket says 172.21.15.67:33954) 2024-01-18T00:48:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.644+0000 7f31d3400640 1 -- 172.21.15.67:0/4199154478 learned_addr learned my addr 172.21.15.67:0/4199154478 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.644+0000 7f31d9200640 1 --2- 172.21.15.67:0/4199154478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 0x7f31d4164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.648+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298349186 0 0) 0x7f31d415a5e0 con 0x7f31d41539b0 2024-01-18T00:48:40.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.648+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b4003530 con 0x7f31d41539b0 2024-01-18T00:48:40.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.648+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 <== mon.1 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488032578 0 0) 0x7f31d4153d90 con 0x7f31d40ca2b0 2024-01-18T00:48:40.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.648+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d415a5e0 con 0x7f31d40ca2b0 2024-01-18T00:48:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.652+0000 7f31d9200640 1 -- 172.21.15.67:0/4199154478 >> v1:172.21.15.137:6789/0 conn(0x7f31d40ca2b0 legacy=0x7f31d415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.652+0000 7f31d9200640 1 -- 172.21.15.67:0/4199154478 >> v1:172.21.15.67:6789/0 conn(0x7f31d41539b0 legacy=0x7f31d4070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.652+0000 7f31d9200640 1 -- 172.21.15.67:0/4199154478 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d40c7900 con 0x7f31d40c93a0 2024-01-18T00:48:40.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.660+0000 7f31d9200640 1 --2- 172.21.15.67:0/4199154478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 0x7f31d4164fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009dc0 tx=0x7f31cc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b61de06ff0f5d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0a5940 con 0x7f31d40c93a0 2024-01-18T00:48:40.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc0a5aa0 con 0x7f31d40c93a0 2024-01-18T00:48:40.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31d2a00640 1 -- 172.21.15.67:0/4199154478 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0a5e30 con 0x7f31d40c93a0 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- 172.21.15.67:0/4199154478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 msgr2=0x7f31d4164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 --2- 172.21.15.67:0/4199154478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 0x7f31d4164fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009dc0 tx=0x7f31cc01c970 comp rx=0 tx=0).stop 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- 172.21.15.67:0/4199154478 shutdown_connections 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 --2- 172.21.15.67:0/4199154478 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d40c93a0 0x7f31d4164fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- 172.21.15.67:0/4199154478 >> 172.21.15.67:0/4199154478 conn(0x7f31d406ad40 msgr2=0x7f31d406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- 172.21.15.67:0/4199154478 shutdown_connections 2024-01-18T00:48:40.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- 172.21.15.67:0/4199154478 wait complete. 2024-01-18T00:48:40.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 Processor -- start 2024-01-18T00:48:40.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.672+0000 7f31db200640 1 -- start start 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31d40c93a0 0x7f31d4149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 0x7f31d406bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41539b0 0x7f31d414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41f2770 con 0x7f31d40ca2b0 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d414b0e0 con 0x7f31d40c93a0 2024-01-18T00:48:40.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31db200640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d41f1df0 con 0x7f31d41539b0 2024-01-18T00:48:40.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 0x7f31d406bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31d3400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 0x7f31d406bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54838/0 (socket says 172.21.15.67:54838) 2024-01-18T00:48:40.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31d3400640 1 -- 172.21.15.67:0/4261140192 learned_addr learned my addr 172.21.15.67:0/4261140192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:40.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31d3e00640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31d40c93a0 0x7f31d4149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.676+0000 7f31d9200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41539b0 0x7f31d414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 -- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41539b0 msgr2=0x7f31d414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f31d41539b0 0x7f31d414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 -- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31d40c93a0 msgr2=0x7f31d4149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31d40c93a0 0x7f31d4149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc009a70 con 0x7f31d40ca2b0 2024-01-18T00:48:40.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.680+0000 7f31d3400640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 0x7f31d406bca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c4d0 tx=0x7f31bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc005cf0 con 0x7f31d40ca2b0 2024-01-18T00:48:40.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d41f5e10 con 0x7f31d40ca2b0 2024-01-18T00:48:40.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d41f20b0 con 0x7f31d40ca2b0 2024-01-18T00:48:40.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31d415a300 con 0x7f31d40ca2b0 2024-01-18T00:48:40.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc005e50 con 0x7f31d40ca2b0 2024-01-18T00:48:40.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.684+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc007270 con 0x7f31d40ca2b0 2024-01-18T00:48:40.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.708+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f31bc0073d0 con 0x7f31d40ca2b0 2024-01-18T00:48:40.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.708+0000 7f31cbe00640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f31ac066840 0x7f31ac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.708+0000 7f31d3e00640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f31ac066840 0x7f31ac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.708+0000 7f31d3e00640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f31ac066840 0x7f31ac068d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001720 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31bc055180 con 0x7f31d40ca2b0 2024-01-18T00:48:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31cbe00640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f31ac070020 0x7f31ac0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31ac072b90 con 0x7f31ac070020 2024-01-18T00:48:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31bc0514c0 con 0x7f31d40ca2b0 2024-01-18T00:48:40.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31d9200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f31ac070020 0x7f31ac0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31d9200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f31ac070020 0x7f31ac0724c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:40.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.712+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== osd.3 v2:172.21.15.67:6822/3364232548 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f31ac072b90 con 0x7f31ac070020 2024-01-18T00:48:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.724+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 --> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31d41f28b0 con 0x7f31ac070020 2024-01-18T00:48:40.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31cbe00640 1 -- 172.21.15.67:0/4261140192 <== osd.3 v2:172.21.15.67:6822/3364232548 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31d41f28b0 con 0x7f31ac070020 2024-01-18T00:48:40.729 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:40.729 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:40.729 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f31ac070020 msgr2=0x7f31ac0724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:6822/3364232548,v1:172.21.15.67:6824/3364232548] conn(0x7f31ac070020 0x7f31ac0724c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f31ac066840 msgr2=0x7f31ac068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f31ac066840 0x7f31ac068d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001720 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 msgr2=0x7f31d406bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 --2- 172.21.15.67:0/4261140192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31d40ca2b0 0x7f31d406bca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c4d0 tx=0x7f31bc00c990 comp rx=0 tx=0).stop 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31d9200640 1 -- 172.21.15.67:0/4261140192 reap_dead start 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 shutdown_connections 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 >> 172.21.15.67:0/4261140192 conn(0x7f31d406ad40 msgr2=0x7f31d4157670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 shutdown_connections 2024-01-18T00:48:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.728+0000 7f31db200640 1 -- 172.21.15.67:0/4261140192 wait complete. 2024-01-18T00:48:40.748 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-18T00:48:40.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 Processor -- start 2024-01-18T00:48:40.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 -- start start 2024-01-18T00:48:40.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f50e4061640 0x7f50e40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:40.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40c7d10 con 0x7f50e41517f0 2024-01-18T00:48:40.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e41576d0 con 0x7f50e4061640 2024-01-18T00:48:40.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.888+0000 7f50e9400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4157970 con 0x7f50e415b620 2024-01-18T00:48:40.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.892+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:40.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.892+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:53082/0 (socket says 172.21.15.67:53082) 2024-01-18T00:48:40.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.892+0000 7f50e1e00640 1 -- 172.21.15.67:0/1500681024 learned_addr learned my addr 172.21.15.67:0/1500681024 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:40.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.896+0000 7f50e1e00640 1 -- 172.21.15.67:0/1500681024 >> v2:172.21.15.67:3300/0 conn(0x7f50e4061640 msgr2=0x7f50e40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:40.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.896+0000 7f50e1e00640 1 --2- 172.21.15.67:0/1500681024 >> v2:172.21.15.67:3300/0 conn(0x7f50e4061640 0x7f50e40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:40.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.896+0000 7f50e1e00640 1 -- 172.21.15.67:0/1500681024 >> v1:172.21.15.67:6789/0 conn(0x7f50e41517f0 legacy=0x7f50e40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:40.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.896+0000 7f50e1e00640 1 -- 172.21.15.67:0/1500681024 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4157c50 con 0x7f50e415b620 2024-01-18T00:48:40.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:40.908+0000 7f50e1e00640 1 --2- 172.21.15.67:0/1500681024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65834a7187419a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e1400640 1 -- 172.21.15.67:0/1500681024 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0aa640 con 0x7f50e415b620 2024-01-18T00:48:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e1400640 1 -- 172.21.15.67:0/1500681024 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0aa7a0 con 0x7f50e415b620 2024-01-18T00:48:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e1400640 1 -- 172.21.15.67:0/1500681024 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0aab30 con 0x7f50e415b620 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- 172.21.15.67:0/1500681024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 msgr2=0x7f50e4061100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 --2- 172.21.15.67:0/1500681024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009870 tx=0x7f50cc01c500 comp rx=0 tx=0).stop 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- 172.21.15.67:0/1500681024 shutdown_connections 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 --2- 172.21.15.67:0/1500681024 >> v2:172.21.15.67:3300/0 conn(0x7f50e4061640 0x7f50e40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 --2- 172.21.15.67:0/1500681024 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e415b620 0x7f50e4061100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- 172.21.15.67:0/1500681024 >> 172.21.15.67:0/1500681024 conn(0x7f50e406ad40 msgr2=0x7f50e406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- 172.21.15.67:0/1500681024 shutdown_connections 2024-01-18T00:48:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- 172.21.15.67:0/1500681024 wait complete. 2024-01-18T00:48:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 Processor -- start 2024-01-18T00:48:41.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.032+0000 7f50e9400640 1 -- start start 2024-01-18T00:48:41.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e41517f0 0x7f50e4159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e415b620 0x7f50e41449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c5250 con 0x7f50e4061640 2024-01-18T00:48:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c6f40 con 0x7f50e415b620 2024-01-18T00:48:41.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e9400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c63a0 con 0x7f50e41517f0 2024-01-18T00:48:41.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e3200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e415b620 0x7f50e41449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e2800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54854/0 (socket says 172.21.15.67:54854) 2024-01-18T00:48:41.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.036+0000 7f50e2800640 1 -- 172.21.15.67:0/729787635 learned_addr learned my addr 172.21.15.67:0/729787635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:41.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.040+0000 7f50e2800640 1 -- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e41517f0 msgr2=0x7f50e4159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.040+0000 7f50e2800640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e41517f0 0x7f50e4159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.040+0000 7f50e2800640 1 -- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e415b620 msgr2=0x7f50e41449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.040+0000 7f50e2800640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e415b620 0x7f50e41449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.040+0000 7f50e2800640 1 -- 172.21.15.67:0/729787635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0094d0 con 0x7f50e4061640 2024-01-18T00:48:41.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.044+0000 7f50e2800640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c4f0 tx=0x7f50d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4005480 con 0x7f50e4061640 2024-01-18T00:48:41.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4003600 con 0x7f50e4061640 2024-01-18T00:48:41.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4161bc0 con 0x7f50e4061640 2024-01-18T00:48:41.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4003990 con 0x7f50e4061640 2024-01-18T00:48:41.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e40c68f0 con 0x7f50e4061640 2024-01-18T00:48:41.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.048+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e406b620 con 0x7f50e4061640 2024-01-18T00:48:41.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.068+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f50d4003af0 con 0x7f50e4061640 2024-01-18T00:48:41.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.068+0000 7f50daa00640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 0x7f50bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.068+0000 7f50e1e00640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 0x7f50bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.072+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50d4054b10 con 0x7f50e4061640 2024-01-18T00:48:41.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.072+0000 7f50e1e00640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 0x7f50bc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ae000 tx=0x7f50cc008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.316+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f50d4050e50 con 0x7f50e4061640 2024-01-18T00:48:41.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.480+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f50e415ba00 con 0x7f50bc066840 2024-01-18T00:48:41.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.480+0000 7f50daa00640 1 -- 172.21.15.67:0/729787635 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50cc0aa5a0 con 0x7f50bc066840 2024-01-18T00:48:41.484 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 msgr2=0x7f50bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 0x7f50bc068d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0ae000 tx=0x7f50cc008040 comp rx=0 tx=0).stop 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 msgr2=0x7f50e41613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c4f0 tx=0x7f50d4001e80 comp rx=0 tx=0).stop 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 shutdown_connections 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f50bc066840 0x7f50bc068d00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e415b620 0x7f50e41449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f50e41517f0 0x7f50e4159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 --2- 172.21.15.67:0/729787635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50e4061640 0x7f50e41613a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 >> 172.21.15.67:0/729787635 conn(0x7f50e406ad40 msgr2=0x7f50e4155820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:41.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 shutdown_connections 2024-01-18T00:48:41.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.484+0000 7f50e9400640 1 -- 172.21.15.67:0/729787635 wait complete. 2024-01-18T00:48:41.511 INFO:tasks.ceph:Scrubbing osd.4 2024-01-18T00:48:41.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 Processor -- start 2024-01-18T00:48:41.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 -- start start 2024-01-18T00:48:41.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb380cb390 0x7ffb380cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb3806dc40 0x7ffb3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3806e5d0 con 0x7ffb381518e0 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb381578c0 con 0x7ffb380cb390 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.656+0000 7ffb40000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380c7770 con 0x7ffb3806dc40 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.660+0000 7ffb3cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb380cb390 0x7ffb380cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.660+0000 7ffb3cc00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffb380cb390 0x7ffb380cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54860/0 (socket says 172.21.15.67:54860) 2024-01-18T00:48:41.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.660+0000 7ffb3cc00640 1 -- 172.21.15.67:0/3427425285 learned_addr learned my addr 172.21.15.67:0/3427425285 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:41.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.660+0000 7ffb3e000640 1 --2- 172.21.15.67:0/3427425285 >> v2:172.21.15.137:3300/0 conn(0x7ffb3806dc40 0x7ffb3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.664+0000 7ffb3cc00640 1 -- 172.21.15.67:0/3427425285 >> v2:172.21.15.137:3300/0 conn(0x7ffb3806dc40 msgr2=0x7ffb3806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.664+0000 7ffb3cc00640 1 --2- 172.21.15.67:0/3427425285 >> v2:172.21.15.137:3300/0 conn(0x7ffb3806dc40 0x7ffb3806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.664+0000 7ffb3cc00640 1 -- 172.21.15.67:0/3427425285 >> v1:172.21.15.67:6789/0 conn(0x7ffb381518e0 legacy=0x7ffb380c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.664+0000 7ffb3cc00640 1 -- 172.21.15.67:0/3427425285 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38157b80 con 0x7ffb380cb390 2024-01-18T00:48:41.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.668+0000 7ffb3cc00640 1 --2- 172.21.15.67:0/3427425285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb380cb390 0x7ffb380cb800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb3815bbc0 tx=0x7ffb2001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461fc67307bd84c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb37e00640 1 -- 172.21.15.67:0/3427425285 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200a89f0 con 0x7ffb380cb390 2024-01-18T00:48:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb37e00640 1 -- 172.21.15.67:0/3427425285 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb200a8b50 con 0x7ffb380cb390 2024-01-18T00:48:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb37e00640 1 -- 172.21.15.67:0/3427425285 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200b0440 con 0x7ffb380cb390 2024-01-18T00:48:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 -- 172.21.15.67:0/3427425285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb380cb390 msgr2=0x7ffb380cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 --2- 172.21.15.67:0/3427425285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb380cb390 0x7ffb380cb800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb3815bbc0 tx=0x7ffb2001ecf0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 -- 172.21.15.67:0/3427425285 shutdown_connections 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 --2- 172.21.15.67:0/3427425285 >> v2:172.21.15.137:3300/0 conn(0x7ffb3806dc40 0x7ffb3806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 --2- 172.21.15.67:0/3427425285 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb380cb390 0x7ffb380cb800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 -- 172.21.15.67:0/3427425285 >> 172.21.15.67:0/3427425285 conn(0x7ffb3806aae0 msgr2=0x7ffb3806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 -- 172.21.15.67:0/3427425285 shutdown_connections 2024-01-18T00:48:41.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.672+0000 7ffb40000640 1 -- 172.21.15.67:0/3427425285 wait complete. 2024-01-18T00:48:41.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 Processor -- start 2024-01-18T00:48:41.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 -- start start 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3806dc40 0x7ffb381e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb380cb390 0x7ffb38155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 0x7ffb38155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb381f36a0 con 0x7ffb381518e0 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c3cc0 con 0x7ffb3806dc40 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb40000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c30b0 con 0x7ffb380cb390 2024-01-18T00:48:41.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 0x7ffb38155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb3e000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 0x7ffb38155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54872/0 (socket says 172.21.15.67:54872) 2024-01-18T00:48:41.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb3e000640 1 -- 172.21.15.67:0/511523414 learned_addr learned my addr 172.21.15.67:0/511523414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:41.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb3cc00640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb380cb390 0x7ffb38155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.676+0000 7ffb3d600640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3806dc40 0x7ffb381e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.680+0000 7ffb3e000640 1 -- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb380cb390 msgr2=0x7ffb38155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.680+0000 7ffb3e000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7ffb380cb390 0x7ffb38155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.680+0000 7ffb3e000640 1 -- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3806dc40 msgr2=0x7ffb381e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.680+0000 7ffb3e000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb3806dc40 0x7ffb381e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.680+0000 7ffb3e000640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb200094d0 con 0x7ffb381518e0 2024-01-18T00:48:41.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.684+0000 7ffb3e000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 0x7ffb38155e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000efc0 tx=0x7ffb3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30009ba0 con 0x7ffb381518e0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000f040 con 0x7ffb381518e0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb300146c0 con 0x7ffb381518e0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380c3390 con 0x7ffb381518e0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380c3950 con 0x7ffb381518e0 2024-01-18T00:48:41.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.688+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb38158420 con 0x7ffb381518e0 2024-01-18T00:48:41.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.708+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7ffb30014820 con 0x7ffb381518e0 2024-01-18T00:48:41.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.708+0000 7ffb35600640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb10066870 0x7ffb10068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.708+0000 7ffb3d600640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb10066870 0x7ffb10068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb3d600640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb10066870 0x7ffb10068d30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001810 tx=0x7ffb28009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb30056200 con 0x7ffb381518e0 2024-01-18T00:48:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb35600640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7ffb10070050 0x7ffb100724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb10072bc0 con 0x7ffb10070050 2024-01-18T00:48:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb3cc00640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7ffb10070050 0x7ffb100724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb3cc00640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7ffb10070050 0x7ffb100724f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.712+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb30052540 con 0x7ffb381518e0 2024-01-18T00:48:41.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.716+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== osd.4 v2:172.21.15.137:6802/2141080358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffb10072bc0 con 0x7ffb10070050 2024-01-18T00:48:41.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 --> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb38158140 con 0x7ffb10070050 2024-01-18T00:48:41.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb35600640 1 -- 172.21.15.67:0/511523414 <== osd.4 v2:172.21.15.137:6802/2141080358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb200bb450 con 0x7ffb10070050 2024-01-18T00:48:41.732 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:41.732 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:41.732 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7ffb10070050 msgr2=0x7ffb100724f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6802/2141080358,v1:172.21.15.137:6803/2141080358] conn(0x7ffb10070050 0x7ffb100724f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb10066870 msgr2=0x7ffb10068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7ffb10066870 0x7ffb10068d30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb28001810 tx=0x7ffb28009040 comp rx=0 tx=0).stop 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 msgr2=0x7ffb38155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.728+0000 7ffb40000640 1 --2- 172.21.15.67:0/511523414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb381518e0 0x7ffb38155e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000efc0 tx=0x7ffb3000c490 comp rx=0 tx=0).stop 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.732+0000 7ffb3e000640 1 -- 172.21.15.67:0/511523414 reap_dead start 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.732+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 shutdown_connections 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.732+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 >> 172.21.15.67:0/511523414 conn(0x7ffb3806aae0 msgr2=0x7ffb38150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.732+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 shutdown_connections 2024-01-18T00:48:41.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.732+0000 7ffb40000640 1 -- 172.21.15.67:0/511523414 wait complete. 2024-01-18T00:48:41.752 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-18T00:48:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.892+0000 7f4382c00640 1 Processor -- start 2024-01-18T00:48:41.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.892+0000 7f4382c00640 1 -- start start 2024-01-18T00:48:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4382c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f437c0c73d0 0x7f437c157440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4382c00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f437c06f210 0x7f437c151290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4382c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437c06a6e0 con 0x7f437c0c77b0 2024-01-18T00:48:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4382c00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c06aca0 con 0x7f437c06f210 2024-01-18T00:48:41.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4382c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f437c157cf0 con 0x7f437c0c73d0 2024-01-18T00:48:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f4381600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f437c06f210 0x7f437c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f437b400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f437c0c77b0 0x7f437c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59824/0 (socket says 172.21.15.67:59824) 2024-01-18T00:48:41.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f437b400640 1 -- 172.21.15.67:0/1728496373 learned_addr learned my addr 172.21.15.67:0/1728496373 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:41.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.896+0000 7f437be00640 1 --2- 172.21.15.67:0/1728496373 >> v2:172.21.15.137:3300/0 conn(0x7f437c0c73d0 0x7f437c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.900+0000 7f4381600640 1 -- 172.21.15.67:0/1728496373 >> v2:172.21.15.137:3300/0 conn(0x7f437c0c73d0 msgr2=0x7f437c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:41.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.900+0000 7f4381600640 1 --2- 172.21.15.67:0/1728496373 >> v2:172.21.15.137:3300/0 conn(0x7f437c0c73d0 0x7f437c157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.900+0000 7f4381600640 1 -- 172.21.15.67:0/1728496373 >> v1:172.21.15.67:6789/0 conn(0x7f437c0c77b0 legacy=0x7f437c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.900+0000 7f4381600640 1 -- 172.21.15.67:0/1728496373 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437c157fd0 con 0x7f437c06f210 2024-01-18T00:48:41.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.908+0000 7f4381600640 1 --2- 172.21.15.67:0/1728496373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c151290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f437c08b3f0 tx=0x7f437401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c798b6fcd9235b server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f437aa00640 1 -- 172.21.15.67:0/1728496373 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740a5820 con 0x7f437c06f210 2024-01-18T00:48:41.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f437aa00640 1 -- 172.21.15.67:0/1728496373 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740a5980 con 0x7f437c06f210 2024-01-18T00:48:41.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f437aa00640 1 -- 172.21.15.67:0/1728496373 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740a5d10 con 0x7f437c06f210 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- 172.21.15.67:0/1728496373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 msgr2=0x7f437c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 --2- 172.21.15.67:0/1728496373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c151290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f437c08b3f0 tx=0x7f437401c850 comp rx=0 tx=0).stop 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- 172.21.15.67:0/1728496373 shutdown_connections 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 --2- 172.21.15.67:0/1728496373 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c151290 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 --2- 172.21.15.67:0/1728496373 >> v2:172.21.15.137:3300/0 conn(0x7f437c0c73d0 0x7f437c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- 172.21.15.67:0/1728496373 >> 172.21.15.67:0/1728496373 conn(0x7f437c061100 msgr2=0x7f437c06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:41.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- 172.21.15.67:0/1728496373 shutdown_connections 2024-01-18T00:48:41.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- 172.21.15.67:0/1728496373 wait complete. 2024-01-18T00:48:41.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 Processor -- start 2024-01-18T00:48:41.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.916+0000 7f4382c00640 1 -- start start 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437c0c77b0 0x7f437c14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c144e90 con 0x7f437c06f210 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c141a80 con 0x7f437c0c73d0 2024-01-18T00:48:41.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4382c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c1f63b0 con 0x7f437c0c77b0 2024-01-18T00:48:41.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f437b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f4381600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437c0c77b0 0x7f437c14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:41.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f437b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:39286/0 (socket says 172.21.15.67:39286) 2024-01-18T00:48:41.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.920+0000 7f437b400640 1 -- 172.21.15.67:0/692350209 learned_addr learned my addr 172.21.15.67:0/692350209 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:41.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.932+0000 7f437b400640 1 -- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437c0c77b0 msgr2=0x7f437c14c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.932+0000 7f437b400640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437c0c77b0 0x7f437c14c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.932+0000 7f437b400640 1 -- 172.21.15.67:0/692350209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 msgr2=0x7f437c144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:41.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.932+0000 7f437b400640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:41.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.932+0000 7f437b400640 1 -- 172.21.15.67:0/692350209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374009a70 con 0x7f437c0c73d0 2024-01-18T00:48:41.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.936+0000 7f437b400640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f436400c3a0 tx=0x7f436400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:41.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.948+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364005cf0 con 0x7f437c0c73d0 2024-01-18T00:48:41.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.948+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437c140e70 con 0x7f437c0c73d0 2024-01-18T00:48:41.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.948+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437c141430 con 0x7f437c0c73d0 2024-01-18T00:48:41.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:41.948+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f437c0746a0 con 0x7f437c0c73d0 2024-01-18T00:48:42.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.356+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364005e50 con 0x7f437c0c73d0 2024-01-18T00:48:42.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.356+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364001110 con 0x7f437c0c73d0 2024-01-18T00:48:42.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.356+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4364007270 con 0x7f437c0c73d0 2024-01-18T00:48:42.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.356+0000 7f4373e00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 0x7f4354068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.356+0000 7f437be00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 0x7f4354068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.360+0000 7f437be00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 0x7f4354068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f436c00b850 tx=0x7f436c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:42.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.364+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4364054da0 con 0x7f437c0c73d0 2024-01-18T00:48:42.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.384+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f43640510e0 con 0x7f437c0c73d0 2024-01-18T00:48:42.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.548+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f437c061e10 con 0x7f4354066840 2024-01-18T00:48:42.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.548+0000 7f4373e00640 1 -- 172.21.15.67:0/692350209 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f437c061e10 con 0x7f4354066840 2024-01-18T00:48:42.551 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-01-18T00:48:42.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 msgr2=0x7f4354068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 0x7f4354068d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f436c00b850 tx=0x7f436c008040 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 msgr2=0x7f437c14beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f436400c3a0 tx=0x7f436400c860 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 shutdown_connections 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4354066840 0x7f4354068d00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f437c0c77b0 0x7f437c14c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f437c0c73d0 0x7f437c14beb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 --2- 172.21.15.67:0/692350209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f437c06f210 0x7f437c144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 >> 172.21.15.67:0/692350209 conn(0x7f437c061100 msgr2=0x7f437c0c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 shutdown_connections 2024-01-18T00:48:42.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.552+0000 7f4382c00640 1 -- 172.21.15.67:0/692350209 wait complete. 2024-01-18T00:48:42.573 INFO:tasks.ceph:Scrubbing osd.5 2024-01-18T00:48:42.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.716+0000 7efca0800640 1 Processor -- start 2024-01-18T00:48:42.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.716+0000 7efca0800640 1 -- start start 2024-01-18T00:48:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efca0800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efc981518e0 0x7efc980c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efca0800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efc9806dc40 0x7efc9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efca0800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9806e5d0 con 0x7efc980c66d0 2024-01-18T00:48:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efca0800640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc981578c0 con 0x7efc9806dc40 2024-01-18T00:48:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efca0800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc980c7770 con 0x7efc981518e0 2024-01-18T00:48:42.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efc9e800640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efc9806dc40 0x7efc9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efc9d400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efc980c66d0 0x7efc980cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59836/0 (socket says 172.21.15.67:59836) 2024-01-18T00:48:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efc9d400640 1 -- 172.21.15.67:0/610053057 learned_addr learned my addr 172.21.15.67:0/610053057 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:42.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.720+0000 7efc9de00640 1 --2- 172.21.15.67:0/610053057 >> v2:172.21.15.137:3300/0 conn(0x7efc981518e0 0x7efc980c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.724+0000 7efc9e800640 1 -- 172.21.15.67:0/610053057 >> v2:172.21.15.137:3300/0 conn(0x7efc981518e0 msgr2=0x7efc980c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:42.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.724+0000 7efc9e800640 1 --2- 172.21.15.67:0/610053057 >> v2:172.21.15.137:3300/0 conn(0x7efc981518e0 0x7efc980c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.724+0000 7efc9e800640 1 -- 172.21.15.67:0/610053057 >> v1:172.21.15.67:6789/0 conn(0x7efc980c66d0 legacy=0x7efc980cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.724+0000 7efc9e800640 1 -- 172.21.15.67:0/610053057 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98157b80 con 0x7efc9806dc40 2024-01-18T00:48:42.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.732+0000 7efc9e800640 1 --2- 172.21.15.67:0/610053057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc9806e090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc980c2290 tx=0x7efc9001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7e607867e6f1ce server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:42.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.732+0000 7efc9ca00640 1 -- 172.21.15.67:0/610053057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900b0440 con 0x7efc9806dc40 2024-01-18T00:48:42.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.732+0000 7efc9ca00640 1 -- 172.21.15.67:0/610053057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc900b05a0 con 0x7efc9806dc40 2024-01-18T00:48:42.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.732+0000 7efc9ca00640 1 -- 172.21.15.67:0/610053057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900b0930 con 0x7efc9806dc40 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- 172.21.15.67:0/610053057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 msgr2=0x7efc9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- 172.21.15.67:0/610053057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc9806e090 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc980c2290 tx=0x7efc9001f0f0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- 172.21.15.67:0/610053057 shutdown_connections 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- 172.21.15.67:0/610053057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc9806e090 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- 172.21.15.67:0/610053057 >> v2:172.21.15.137:3300/0 conn(0x7efc981518e0 0x7efc980c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- 172.21.15.67:0/610053057 >> 172.21.15.67:0/610053057 conn(0x7efc9806aae0 msgr2=0x7efc9806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- 172.21.15.67:0/610053057 shutdown_connections 2024-01-18T00:48:42.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- 172.21.15.67:0/610053057 wait complete. 2024-01-18T00:48:42.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 Processor -- start 2024-01-18T00:48:42.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- start start 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc98147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc980c66d0 0x7efc980ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc981518e0 0x7efc981efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc981575e0 con 0x7efc9806dc40 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98156dd0 con 0x7efc980c66d0 2024-01-18T00:48:42.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.736+0000 7efca0800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc98150140 con 0x7efc981518e0 2024-01-18T00:48:42.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.740+0000 7efc9de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc98147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.740+0000 7efc9de00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc98147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54904/0 (socket says 172.21.15.67:54904) 2024-01-18T00:48:42.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.740+0000 7efc9de00640 1 -- 172.21.15.67:0/1127571140 learned_addr learned my addr 172.21.15.67:0/1127571140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:42.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.740+0000 7efc9d400640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc980c66d0 0x7efc980ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.740+0000 7efc9e800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc981518e0 0x7efc981efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.744+0000 7efc9de00640 1 -- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc981518e0 msgr2=0x7efc981efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.744+0000 7efc9de00640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7efc981518e0 0x7efc981efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.744+0000 7efc9de00640 1 -- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc980c66d0 msgr2=0x7efc980ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.744+0000 7efc9de00640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc980c66d0 0x7efc980ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.744+0000 7efc9de00640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90009a70 con 0x7efc9806dc40 2024-01-18T00:48:42.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.764+0000 7efc9de00640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc98147120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e8a0 tx=0x7efc8800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:42.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88009510 con 0x7efc9806dc40 2024-01-18T00:48:42.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8800c940 con 0x7efc9806dc40 2024-01-18T00:48:42.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8800ccb0 con 0x7efc9806dc40 2024-01-18T00:48:42.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980c1c60 con 0x7efc9806dc40 2024-01-18T00:48:42.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc98157300 con 0x7efc9806dc40 2024-01-18T00:48:42.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.768+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc9806e290 con 0x7efc9806dc40 2024-01-18T00:48:42.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7efc88013470 con 0x7efc9806dc40 2024-01-18T00:48:42.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efc70066890 0x7efc70068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc9d400640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efc70066890 0x7efc70068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc880554b0 con 0x7efc9806dc40 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc9d400640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efc70066890 0x7efc70068d50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc980c1580 tx=0x7efc80007e90 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7efc70070170 0x7efc70072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc70072ce0 con 0x7efc70070170 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc9e800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7efc70070170 0x7efc70072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.792+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc880517f0 con 0x7efc9806dc40 2024-01-18T00:48:42.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.796+0000 7efc9e800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7efc70070170 0x7efc70072610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:42.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.796+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== osd.5 v2:172.21.15.137:6819/748642727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc70072ce0 con 0x7efc70070170 2024-01-18T00:48:42.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.808+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 --> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc9814d850 con 0x7efc70070170 2024-01-18T00:48:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efc96000640 1 -- 172.21.15.67:0/1127571140 <== osd.5 v2:172.21.15.137:6819/748642727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc9814d850 con 0x7efc70070170 2024-01-18T00:48:42.813 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:42.813 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:42.813 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7efc70070170 msgr2=0x7efc70072610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6819/748642727,v1:172.21.15.137:6821/748642727] conn(0x7efc70070170 0x7efc70072610 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efc70066890 msgr2=0x7efc70068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7efc70066890 0x7efc70068d50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc980c1580 tx=0x7efc80007e90 comp rx=0 tx=0).stop 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 msgr2=0x7efc98147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:42.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 --2- 172.21.15.67:0/1127571140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc9806dc40 0x7efc98147120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e8a0 tx=0x7efc8800eca0 comp rx=0 tx=0).stop 2024-01-18T00:48:42.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efc9e800640 1 -- 172.21.15.67:0/1127571140 reap_dead start 2024-01-18T00:48:42.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 shutdown_connections 2024-01-18T00:48:42.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 >> 172.21.15.67:0/1127571140 conn(0x7efc9806aae0 msgr2=0x7efc980cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:42.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 shutdown_connections 2024-01-18T00:48:42.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.812+0000 7efca0800640 1 -- 172.21.15.67:0/1127571140 wait complete. 2024-01-18T00:48:42.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-18T00:48:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.976+0000 7f9216c00640 1 Processor -- start 2024-01-18T00:48:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.976+0000 7f9216c00640 1 -- start start 2024-01-18T00:48:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.980+0000 7f9216c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92101508d0 0x7f921006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.980+0000 7f9216c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100c1450 con 0x7f9210156b80 2024-01-18T00:48:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.980+0000 7f9216c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92100c1730 con 0x7f9210156fe0 2024-01-18T00:48:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:42.980+0000 7f9216c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9210159820 con 0x7f92101508d0 2024-01-18T00:48:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.004+0000 7f9214c00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9210156b80 0x7f9210157ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59840/0 (socket says 172.21.15.67:59840) 2024-01-18T00:48:43.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.004+0000 7f9214c00640 1 -- 172.21.15.67:0/4018349770 learned_addr learned my addr 172.21.15.67:0/4018349770 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.012+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325560843 0 0) 0x7f92100c1450 con 0x7f9210156b80 2024-01-18T00:48:43.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.012+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0005740 con 0x7f9210156b80 2024-01-18T00:48:43.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 13887562 0 0) 0x7f91f0005740 con 0x7f9210156b80 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 >> v2:172.21.15.137:3300/0 conn(0x7f92101508d0 msgr2=0x7f921006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 --2- 172.21.15.67:0/4018349770 >> v2:172.21.15.137:3300/0 conn(0x7f92101508d0 0x7f921006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 >> v1:172.21.15.137:6789/0 conn(0x7f9210156fe0 legacy=0x7f9210156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100c1a10 con 0x7f9210156b80 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f9208001a00 con 0x7f9210156b80 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 >> v1:172.21.15.67:6789/0 conn(0x7f9210156b80 legacy=0x7f9210157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0005be0 0x7f91f0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 0x7f91f0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00074c0 0x7f91f000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210159820 con 0x7f91f00069e0 2024-01-18T00:48:43.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f000e400 con 0x7f91f00074c0 2024-01-18T00:48:43.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.016+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f000e5c0 con 0x7f91f0005be0 2024-01-18T00:48:43.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 0x7f91f0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 -- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0005be0 msgr2=0x7f91f0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f91f0005be0 0x7f91f0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 -- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00074c0 msgr2=0x7f91f000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00074c0 0x7f91f000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f920f400640 1 -- 172.21.15.67:0/4018349770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0005740 con 0x7f91f00069e0 2024-01-18T00:48:43.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.020+0000 7f9214c00640 1 -- 172.21.15.67:0/4018349770 reap_dead start 2024-01-18T00:48:43.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.024+0000 7f920f400640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 0x7f91f0006e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f91f8007fd0 tx=0x7f91f801c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00f425bf361a880 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8005270 con 0x7f91f00069e0 2024-01-18T00:48:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80a7070 con 0x7f91f00069e0 2024-01-18T00:48:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f920ea00640 1 -- 172.21.15.67:0/4018349770 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8003620 con 0x7f91f00069e0 2024-01-18T00:48:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f9216c00640 1 -- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 msgr2=0x7f91f0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f9216c00640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 0x7f91f0006e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f91f8007fd0 tx=0x7f91f801c2c0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f9216c00640 1 -- 172.21.15.67:0/4018349770 shutdown_connections 2024-01-18T00:48:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f9216c00640 1 --2- 172.21.15.67:0/4018349770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91f00069e0 0x7f91f0006e60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.028+0000 7f9216c00640 1 -- 172.21.15.67:0/4018349770 >> 172.21.15.67:0/4018349770 conn(0x7f921006fc50 msgr2=0x7f9210070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- 172.21.15.67:0/4018349770 shutdown_connections 2024-01-18T00:48:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- 172.21.15.67:0/4018349770 wait complete. 2024-01-18T00:48:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 Processor -- start 2024-01-18T00:48:43.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- start start 2024-01-18T00:48:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00069e0 0x7f9210143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92100c4f90 0x7f9210147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100cb740 con 0x7f92100ca6e0 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c4b00 con 0x7f91f00069e0 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f9216c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92100c47d0 con 0x7f92100c4f90 2024-01-18T00:48:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.032+0000 7f920f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54916/0 (socket says 172.21.15.67:54916) 2024-01-18T00:48:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 -- 172.21.15.67:0/1258261780 learned_addr learned my addr 172.21.15.67:0/1258261780 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 -- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92100c4f90 msgr2=0x7f9210147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92100c4f90 0x7f9210147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 -- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00069e0 msgr2=0x7f9210143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00069e0 0x7f9210143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.036+0000 7f920f400640 1 -- 172.21.15.67:0/1258261780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100caea0 con 0x7f92100ca6e0 2024-01-18T00:48:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.040+0000 7f920f400640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91f801c0f0 tx=0x7f91f0007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b1070 con 0x7f92100ca6e0 2024-01-18T00:48:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92100cb180 con 0x7f92100ca6e0 2024-01-18T00:48:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92101f26a0 con 0x7f92100ca6e0 2024-01-18T00:48:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f80a4e90 con 0x7f92100ca6e0 2024-01-18T00:48:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8005270 con 0x7f92100ca6e0 2024-01-18T00:48:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.044+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92100c4940 con 0x7f92100ca6e0 2024-01-18T00:48:43.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.064+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f91f80a9020 con 0x7f92100ca6e0 2024-01-18T00:48:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.064+0000 7f9207e00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 0x7f91e8068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.068+0000 7f920fe00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 0x7f91e8068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.068+0000 7f920fe00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 0x7f91e8068d30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9200006fd0 tx=0x7f9200006d80 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.252+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91f80ef0f0 con 0x7f92100ca6e0 2024-01-18T00:48:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.316+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f91f80ead30 con 0x7f92100ca6e0 2024-01-18T00:48:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f92101579a0 con 0x7f91e8066870 2024-01-18T00:48:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9207e00640 1 -- 172.21.15.67:0/1258261780 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9200009450 con 0x7f91e8066870 2024-01-18T00:48:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 msgr2=0x7f91e8068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 0x7f91e8068d30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9200006fd0 tx=0x7f9200006d80 comp rx=0 tx=0).stop 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 msgr2=0x7f92101f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f91f801c0f0 tx=0x7f91f0007a10 comp rx=0 tx=0).stop 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 shutdown_connections 2024-01-18T00:48:43.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f91e8066870 0x7f91e8068d30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f92100c4f90 0x7f9210147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92100ca6e0 0x7f92101f2160 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 --2- 172.21.15.67:0/1258261780 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91f00069e0 0x7f9210143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 >> 172.21.15.67:0/1258261780 conn(0x7f921006fc50 msgr2=0x7f9210154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 shutdown_connections 2024-01-18T00:48:43.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.480+0000 7f9216c00640 1 -- 172.21.15.67:0/1258261780 wait complete. 2024-01-18T00:48:43.505 INFO:tasks.ceph:Scrubbing osd.6 2024-01-18T00:48:43.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:43.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 Processor -- start 2024-01-18T00:48:43.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 -- start start 2024-01-18T00:48:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c700726a0 0x7f2c700c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c70071960 con 0x7f2c700bffb0 2024-01-18T00:48:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c70156720 con 0x7f2c70150480 2024-01-18T00:48:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c78800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c701572c0 con 0x7f2c700726a0 2024-01-18T00:48:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c75400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2c700bffb0 0x7f2c700cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59842/0 (socket says 172.21.15.67:59842) 2024-01-18T00:48:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.660+0000 7f2c75400640 1 -- 172.21.15.67:0/1278689829 learned_addr learned my addr 172.21.15.67:0/1278689829 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:43.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.664+0000 7f2c76800640 1 --2- 172.21.15.67:0/1278689829 >> v2:172.21.15.137:3300/0 conn(0x7f2c700726a0 0x7f2c700c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.664+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924871906 0 0) 0x7f2c70071960 con 0x7f2c700bffb0 2024-01-18T00:48:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.664+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c50003530 con 0x7f2c700bffb0 2024-01-18T00:48:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409389223 0 0) 0x7f2c50003530 con 0x7f2c700bffb0 2024-01-18T00:48:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 >> v2:172.21.15.137:3300/0 conn(0x7f2c700726a0 msgr2=0x7f2c700c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 --2- 172.21.15.67:0/1278689829 >> v2:172.21.15.137:3300/0 conn(0x7f2c700726a0 0x7f2c700c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 >> v1:172.21.15.137:6789/0 conn(0x7f2c70150480 legacy=0x7f2c70156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70071bb0 con 0x7f2c700bffb0 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f2c58001680 con 0x7f2c700bffb0 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 >> v1:172.21.15.67:6789/0 conn(0x7f2c700bffb0 legacy=0x7f2c700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c50003980 0x7f2c50003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 0x7f2c50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c50005190 0x7f2c5000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701572c0 con 0x7f2c500047d0 2024-01-18T00:48:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5000e2d0 con 0x7f2c50003980 2024-01-18T00:48:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5000e490 con 0x7f2c50005190 2024-01-18T00:48:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c76800640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c50005190 0x7f2c5000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.668+0000 7f2c75400640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 0x7f2c50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c75400640 1 -- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c50005190 msgr2=0x7f2c5000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c75400640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c50005190 0x7f2c5000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c75400640 1 -- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c50003980 msgr2=0x7f2c50003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c75400640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c50003980 0x7f2c50003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c75400640 1 -- 172.21.15.67:0/1278689829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50003530 con 0x7f2c500047d0 2024-01-18T00:48:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.672+0000 7f2c76800640 1 -- 172.21.15.67:0/1278689829 reap_dead start 2024-01-18T00:48:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.676+0000 7f2c75400640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 0x7f2c50004c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c1b0 tx=0x7f2c5801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce761b6a1e604ec server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c580058e0 con 0x7f2c500047d0 2024-01-18T00:48:43.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c58005a40 con 0x7f2c500047d0 2024-01-18T00:48:43.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c74a00640 1 -- 172.21.15.67:0/1278689829 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58005e10 con 0x7f2c500047d0 2024-01-18T00:48:43.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c78800640 1 -- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 msgr2=0x7f2c50004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c78800640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 0x7f2c50004c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800c1b0 tx=0x7f2c5801cb60 comp rx=0 tx=0).stop 2024-01-18T00:48:43.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c78800640 1 -- 172.21.15.67:0/1278689829 shutdown_connections 2024-01-18T00:48:43.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c78800640 1 --2- 172.21.15.67:0/1278689829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c500047d0 0x7f2c50004c50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.680+0000 7f2c78800640 1 -- 172.21.15.67:0/1278689829 >> 172.21.15.67:0/1278689829 conn(0x7f2c7006aae0 msgr2=0x7f2c7006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:43.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- 172.21.15.67:0/1278689829 shutdown_connections 2024-01-18T00:48:43.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- 172.21.15.67:0/1278689829 wait complete. 2024-01-18T00:48:43.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 Processor -- start 2024-01-18T00:48:43.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- start start 2024-01-18T00:48:43.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c500047d0 0x7f2c700c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c700ac8d0 0x7f2c701f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 0x7f2c701f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7014ce30 con 0x7f2c7014eae0 2024-01-18T00:48:43.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7014d060 con 0x7f2c500047d0 2024-01-18T00:48:43.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c78800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700c2840 con 0x7f2c700ac8d0 2024-01-18T00:48:43.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c76800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 0x7f2c701f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c76800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 0x7f2c701f0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54938/0 (socket says 172.21.15.67:54938) 2024-01-18T00:48:43.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.684+0000 7f2c76800640 1 -- 172.21.15.67:0/1493413836 learned_addr learned my addr 172.21.15.67:0/1493413836 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:43.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c75e00640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c500047d0 0x7f2c700c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c75400640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c700ac8d0 0x7f2c701f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c76800640 1 -- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c700ac8d0 msgr2=0x7f2c701f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c76800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2c700ac8d0 0x7f2c701f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c76800640 1 -- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c500047d0 msgr2=0x7f2c700c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c76800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c500047d0 0x7f2c700c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.688+0000 7f2c76800640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7014d300 con 0x7f2c7014eae0 2024-01-18T00:48:43.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.692+0000 7f2c76800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 0x7f2c701f0bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c700c8b30 tx=0x7f2c68010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68010d20 con 0x7f2c7014eae0 2024-01-18T00:48:43.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7014d5e0 con 0x7f2c7014eae0 2024-01-18T00:48:43.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7014dba0 con 0x7f2c7014eae0 2024-01-18T00:48:43.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68010e80 con 0x7f2c7014eae0 2024-01-18T00:48:43.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68021660 con 0x7f2c7014eae0 2024-01-18T00:48:43.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.696+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c40001040 con 0x7f2c7014eae0 2024-01-18T00:48:43.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.716+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2c6802b430 con 0x7f2c7014eae0 2024-01-18T00:48:43.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.720+0000 7f2c6e000640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2c48066840 0x7f2c48068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.720+0000 7f2c75e00640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2c48066840 0x7f2c48068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.720+0000 7f2c75e00640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2c48066840 0x7f2c48068d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2c60001170 tx=0x7f2c60009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c68056b60 con 0x7f2c7014eae0 2024-01-18T00:48:43.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c6e000640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f2c48070020 0x7f2c480724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c48072b90 con 0x7f2c48070020 2024-01-18T00:48:43.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c68052ea0 con 0x7f2c7014eae0 2024-01-18T00:48:43.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c75400640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f2c48070020 0x7f2c480724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.724+0000 7f2c75400640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f2c48070020 0x7f2c480724c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.728+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== osd.6 v2:172.21.15.137:6818/2947557560 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2c48072b90 con 0x7f2c48070020 2024-01-18T00:48:43.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 --> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c40002da0 con 0x7f2c48070020 2024-01-18T00:48:43.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c6e000640 1 -- 172.21.15.67:0/1493413836 <== osd.6 v2:172.21.15.137:6818/2947557560 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2c40002da0 con 0x7f2c48070020 2024-01-18T00:48:43.743 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:43.743 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:43.744 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:43.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f2c48070020 msgr2=0x7f2c480724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6818/2947557560,v1:172.21.15.137:6820/2947557560] conn(0x7f2c48070020 0x7f2c480724c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2c48066840 msgr2=0x7f2c48068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2c48066840 0x7f2c48068d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2c60001170 tx=0x7f2c60009040 comp rx=0 tx=0).stop 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 msgr2=0x7f2c701f0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 --2- 172.21.15.67:0/1493413836 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c7014eae0 0x7f2c701f0bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2c700c8b30 tx=0x7f2c68010530 comp rx=0 tx=0).stop 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c76800640 1 -- 172.21.15.67:0/1493413836 reap_dead start 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 shutdown_connections 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 >> 172.21.15.67:0/1493413836 conn(0x7f2c7006aae0 msgr2=0x7f2c700c1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 shutdown_connections 2024-01-18T00:48:43.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.740+0000 7f2c78800640 1 -- 172.21.15.67:0/1493413836 wait complete. 2024-01-18T00:48:43.763 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-18T00:48:43.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.912+0000 7f7b63000640 1 Processor -- start 2024-01-18T00:48:43.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.912+0000 7f7b63000640 1 -- start start 2024-01-18T00:48:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.912+0000 7f7b63000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.912+0000 7f7b63000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7b5c0c8280 0x7f7b5c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b63000640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0c9660 con 0x7f7b5c150790 2024-01-18T00:48:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b63000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0c8bc0 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b63000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c150b70 con 0x7f7b5c0c8280 2024-01-18T00:48:43.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b53e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b53e00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54940/0 (socket says 172.21.15.67:54940) 2024-01-18T00:48:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b53e00640 1 -- 172.21.15.67:0/2814178419 learned_addr learned my addr 172.21.15.67:0/2814178419 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:43.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.916+0000 7f7b61a00640 1 --2- 172.21.15.67:0/2814178419 >> v2:172.21.15.137:3300/0 conn(0x7f7b5c0c8280 0x7f7b5c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.920+0000 7f7b53e00640 1 -- 172.21.15.67:0/2814178419 >> v2:172.21.15.137:3300/0 conn(0x7f7b5c0c8280 msgr2=0x7f7b5c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:43.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.920+0000 7f7b53e00640 1 --2- 172.21.15.67:0/2814178419 >> v2:172.21.15.137:3300/0 conn(0x7f7b5c0c8280 0x7f7b5c0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.920+0000 7f7b53e00640 1 -- 172.21.15.67:0/2814178419 >> v1:172.21.15.67:6789/0 conn(0x7f7b5c150790 legacy=0x7f7b5c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.920+0000 7f7b53e00640 1 -- 172.21.15.67:0/2814178419 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c0c93a0 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.924+0000 7f7b53e00640 1 --2- 172.21.15.67:0/2814178419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c061a20 tx=0x7f7b4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b53f4c65c87779 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b5b400640 1 -- 172.21.15.67:0/2814178419 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440a89f0 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b5b400640 1 -- 172.21.15.67:0/2814178419 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b440a8b50 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b5b400640 1 -- 172.21.15.67:0/2814178419 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b0440 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 -- 172.21.15.67:0/2814178419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c0c9e60 msgr2=0x7f7b5c06a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 --2- 172.21.15.67:0/2814178419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c061a20 tx=0x7f7b4401ecf0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 -- 172.21.15.67:0/2814178419 shutdown_connections 2024-01-18T00:48:43.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 --2- 172.21.15.67:0/2814178419 >> v2:172.21.15.137:3300/0 conn(0x7f7b5c0c8280 0x7f7b5c0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 --2- 172.21.15.67:0/2814178419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c06a6e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 -- 172.21.15.67:0/2814178419 >> 172.21.15.67:0/2814178419 conn(0x7f7b5c061100 msgr2=0x7f7b5c06e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:43.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 -- 172.21.15.67:0/2814178419 shutdown_connections 2024-01-18T00:48:43.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.928+0000 7f7b63000640 1 -- 172.21.15.67:0/2814178419 wait complete. 2024-01-18T00:48:43.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 Processor -- start 2024-01-18T00:48:43.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 -- start start 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b5c0c8280 0x7f7b5c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c143010 con 0x7f7b5c150790 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c142a50 con 0x7f7b5c0c9e60 2024-01-18T00:48:43.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b63000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c142d30 con 0x7f7b5c0c8280 2024-01-18T00:48:43.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b61a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b61a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54948/0 (socket says 172.21.15.67:54948) 2024-01-18T00:48:43.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b61a00640 1 -- 172.21.15.67:0/595442073 learned_addr learned my addr 172.21.15.67:0/595442073 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:43.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b5be00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b5c0c8280 0x7f7b5c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.932+0000 7f7b53e00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.936+0000 7f7b61a00640 1 -- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b5c0c8280 msgr2=0x7f7b5c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.936+0000 7f7b61a00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b5c0c8280 0x7f7b5c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.936+0000 7f7b61a00640 1 -- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b5c0c9e60 msgr2=0x7f7b5c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.936+0000 7f7b61a00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:43.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.936+0000 7f7b61a00640 1 -- 172.21.15.67:0/595442073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440094d0 con 0x7f7b5c150790 2024-01-18T00:48:43.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.944+0000 7f7b61a00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400efc0 tx=0x7f7b5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54014480 con 0x7f7b5c150790 2024-01-18T00:48:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400f040 con 0x7f7b5c150790 2024-01-18T00:48:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54014820 con 0x7f7b5c150790 2024-01-18T00:48:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c1ef450 con 0x7f7b5c150790 2024-01-18T00:48:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c1efa10 con 0x7f7b5c150790 2024-01-18T00:48:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.948+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c0c1db0 con 0x7f7b5c150790 2024-01-18T00:48:43.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.972+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f7b54014980 con 0x7f7b5c150790 2024-01-18T00:48:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.972+0000 7f7b58c00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 0x7f7b34068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:43.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.972+0000 7f7b5be00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 0x7f7b34068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:43.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:43.972+0000 7f7b5be00640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 0x7f7b34068d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001770 tx=0x7f7b4c009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.220+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b54056340 con 0x7f7b5c150790 2024-01-18T00:48:44.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.220+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f7b54052680 con 0x7f7b5c150790 2024-01-18T00:48:44.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b5c156860 con 0x7f7b34066890 2024-01-18T00:48:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b58c00640 1 -- 172.21.15.67:0/595442073 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b4c0013b0 con 0x7f7b34066890 2024-01-18T00:48:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 msgr2=0x7f7b34068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 0x7f7b34068d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001770 tx=0x7f7b4c009040 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 msgr2=0x7f7b5c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.388+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400efc0 tx=0x7f7b5400c490 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 shutdown_connections 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f7b34066890 0x7f7b34068d50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5c150790 0x7f7b5c1530e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7b5c0c9e60 0x7f7b5c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 --2- 172.21.15.67:0/595442073 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f7b5c0c8280 0x7f7b5c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 >> 172.21.15.67:0/595442073 conn(0x7f7b5c061100 msgr2=0x7f7b5c14e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 shutdown_connections 2024-01-18T00:48:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.392+0000 7f7b63000640 1 -- 172.21.15.67:0/595442073 wait complete. 2024-01-18T00:48:44.413 INFO:tasks.ceph:Scrubbing osd.7 2024-01-18T00:48:44.413 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-18T00:48:44.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 Processor -- start 2024-01-18T00:48:44.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 -- start start 2024-01-18T00:48:44.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 0x7fb0f40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb0f40cd500 0x7fb0f41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f40b1730 con 0x7fb0f41518f0 2024-01-18T00:48:44.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f41582c0 con 0x7fb0f40cd500 2024-01-18T00:48:44.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0fb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f415ad50 con 0x7fb0f40c9070 2024-01-18T00:48:44.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0f8e00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb0f41518f0 0x7fb0f40b1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59854/0 (socket says 172.21.15.67:59854) 2024-01-18T00:48:44.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.556+0000 7fb0f8e00640 1 -- 172.21.15.67:0/1442957548 learned_addr learned my addr 172.21.15.67:0/1442957548 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:44.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.560+0000 7fb0f9800640 1 --2- 172.21.15.67:0/1442957548 >> v2:172.21.15.137:3300/0 conn(0x7fb0f40cd500 0x7fb0f41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.560+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466216652 0 0) 0x7fb0e4001120 con 0x7fb0f41518f0 2024-01-18T00:48:44.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.560+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d4003530 con 0x7fb0f41518f0 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3771117112 0 0) 0x7fb0d4003530 con 0x7fb0f41518f0 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 msgr2=0x7fb0f40ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 0x7fb0f40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 >> v2:172.21.15.137:3300/0 conn(0x7fb0f40cd500 msgr2=0x7fb0f41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 --2- 172.21.15.67:0/1442957548 >> v2:172.21.15.137:3300/0 conn(0x7fb0f40cd500 0x7fb0f41576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f415b030 con 0x7fb0f41518f0 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fb0e4001810 con 0x7fb0f41518f0 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 >> v1:172.21.15.67:6789/0 conn(0x7fb0f41518f0 legacy=0x7fb0f40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 0x7fb0d4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4003f00 0x7fb0d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4004d10 0x7fb0d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41582c0 con 0x7fb0d4003f00 2024-01-18T00:48:44.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f415ad50 con 0x7fb0d4004d10 2024-01-18T00:48:44.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d400bb50 con 0x7fb0f40c9070 2024-01-18T00:48:44.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.564+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4003f00 0x7fb0d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.568+0000 7fb0f3e00640 1 -- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 msgr2=0x7fb0d4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.568+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f40c9070 0x7fb0d4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.568+0000 7fb0f3e00640 1 -- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4004d10 msgr2=0x7fb0d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.568+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4004d10 0x7fb0d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.568+0000 7fb0f3e00640 1 -- 172.21.15.67:0/1442957548 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f415b030 con 0x7fb0d4003f00 2024-01-18T00:48:44.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.572+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4003f00 0x7fb0d40047d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009890 tx=0x7fb0dc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee7dd6f755abdc server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0ab600 con 0x7fb0d4003f00 2024-01-18T00:48:44.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0a7050 con 0x7fb0d4003f00 2024-01-18T00:48:44.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0f3400640 1 -- 172.21.15.67:0/1442957548 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0ab9c0 con 0x7fb0d4003f00 2024-01-18T00:48:44.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 -- 172.21.15.67:0/1442957548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4003f00 msgr2=0x7fb0d40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 --2- 172.21.15.67:0/1442957548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0d4003f00 0x7fb0d40047d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009890 tx=0x7fb0dc01c3a0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0f9800640 1 -- 172.21.15.67:0/1442957548 reap_dead start 2024-01-18T00:48:44.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 -- 172.21.15.67:0/1442957548 shutdown_connections 2024-01-18T00:48:44.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 -- 172.21.15.67:0/1442957548 >> 172.21.15.67:0/1442957548 conn(0x7fb0f4061100 msgr2=0x7fb0f4061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:44.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 -- 172.21.15.67:0/1442957548 shutdown_connections 2024-01-18T00:48:44.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.576+0000 7fb0fb800640 1 -- 172.21.15.67:0/1442957548 wait complete. 2024-01-18T00:48:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 Processor -- start 2024-01-18T00:48:44.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 -- start start 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4003f00 0x7fb0f414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 0x7fb0f40cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f41f2930 0x7fb0f414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40ccd40 con 0x7fb0f40c4430 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40cbd50 con 0x7fb0d4003f00 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0fb800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f414e9c0 con 0x7fb0f41f2930 2024-01-18T00:48:44.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 0x7fb0f40cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0f3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 0x7fb0f40cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54978/0 (socket says 172.21.15.67:54978) 2024-01-18T00:48:44.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0f3e00640 1 -- 172.21.15.67:0/2627070843 learned_addr learned my addr 172.21.15.67:0/2627070843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:44.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.580+0000 7fb0f8e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4003f00 0x7fb0f414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.584+0000 7fb0f3e00640 1 -- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f41f2930 msgr2=0x7fb0f414bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.584+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb0f41f2930 0x7fb0f414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.584+0000 7fb0f3e00640 1 -- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4003f00 msgr2=0x7fb0f414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.584+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0d4003f00 0x7fb0f414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.584+0000 7fb0f3e00640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40ccf70 con 0x7fb0f40c4430 2024-01-18T00:48:44.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.604+0000 7fb0f3e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 0x7fb0f40cc1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c10 tx=0x7fb0d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc004220 con 0x7fb0f40c4430 2024-01-18T00:48:44.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc004380 con 0x7fb0f40c4430 2024-01-18T00:48:44.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0044f0 con 0x7fb0f40c4430 2024-01-18T00:48:44.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f41f33b0 con 0x7fb0f40c4430 2024-01-18T00:48:44.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f40c7f70 con 0x7fb0f40c4430 2024-01-18T00:48:44.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.608+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0f40c3060 con 0x7fb0f40c4430 2024-01-18T00:48:44.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.632+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb0dc0b2040 con 0x7fb0f40c4430 2024-01-18T00:48:44.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.632+0000 7fb0f0c00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0cc0668c0 0x7fb0cc068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.632+0000 7fb0f8e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0cc0668c0 0x7fb0cc068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.632+0000 7fb0f8e00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0cc0668c0 0x7fb0cc068d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4001060 tx=0x7fb0e4001b50 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.632+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0dc0ef140 con 0x7fb0f40c4430 2024-01-18T00:48:44.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f0c00640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7fb0cc070120 0x7fb0cc0725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0cc072c90 con 0x7fb0cc070120 2024-01-18T00:48:44.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0dc0eb480 con 0x7fb0f40c4430 2024-01-18T00:48:44.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f9800640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7fb0cc070120 0x7fb0cc0725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f9800640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7fb0cc070120 0x7fb0cc0725c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.636+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== osd.7 v2:172.21.15.137:6810/2951291350 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb0cc072c90 con 0x7fb0cc070120 2024-01-18T00:48:44.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 --> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0f415bb10 con 0x7fb0cc070120 2024-01-18T00:48:44.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0f0c00640 1 -- 172.21.15.67:0/2627070843 <== osd.7 v2:172.21.15.137:6810/2951291350 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb0ec009c70 con 0x7fb0cc070120 2024-01-18T00:48:44.654 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-01-18T00:48:44.654 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-18T00:48:44.654 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-01-18T00:48:44.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7fb0cc070120 msgr2=0x7fb0cc0725c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6810/2951291350,v1:172.21.15.137:6811/2951291350] conn(0x7fb0cc070120 0x7fb0cc0725c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0cc0668c0 msgr2=0x7fb0cc068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb0cc0668c0 0x7fb0cc068d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4001060 tx=0x7fb0e4001b50 comp rx=0 tx=0).stop 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 msgr2=0x7fb0f40cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 --2- 172.21.15.67:0/2627070843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb0f40c4430 0x7fb0f40cc1e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc000c10 tx=0x7fb0d4005800 comp rx=0 tx=0).stop 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0f9800640 1 -- 172.21.15.67:0/2627070843 reap_dead start 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 shutdown_connections 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 >> 172.21.15.67:0/2627070843 conn(0x7fb0f4061100 msgr2=0x7fb0f4061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 shutdown_connections 2024-01-18T00:48:44.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.652+0000 7fb0fb800640 1 -- 172.21.15.67:0/2627070843 wait complete. 2024-01-18T00:48:44.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-18T00:48:44.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 Processor -- start 2024-01-18T00:48:44.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 -- start start 2024-01-18T00:48:44.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb28014ff10 0x7fb280156590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 0x7fb28006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb280159ad0 con 0x7fb2800c6480 2024-01-18T00:48:44.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb280156ad0 con 0x7fb28014ff10 2024-01-18T00:48:44.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.812+0000 7fb285e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28006cc20 con 0x7fb2800c68c0 2024-01-18T00:48:44.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27e000640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb2800c6480 0x7fb28006d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:59858/0 (socket says 172.21.15.67:59858) 2024-01-18T00:48:44.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27e000640 1 -- 172.21.15.67:0/2676487194 learned_addr learned my addr 172.21.15.67:0/2676487194 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:44.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27f400640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 0x7fb28006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27ea00640 1 --2- 172.21.15.67:0/2676487194 >> v2:172.21.15.137:3300/0 conn(0x7fb28014ff10 0x7fb280156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628780528 0 0) 0x7fb280159ad0 con 0x7fb2800c6480 2024-01-18T00:48:44.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.816+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb260003530 con 0x7fb2800c6480 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361272984 0 0) 0x7fb260003530 con 0x7fb2800c6480 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 msgr2=0x7fb28006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 0x7fb28006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 >> v2:172.21.15.137:3300/0 conn(0x7fb28014ff10 msgr2=0x7fb280156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 --2- 172.21.15.67:0/2676487194 >> v2:172.21.15.137:3300/0 conn(0x7fb28014ff10 0x7fb280156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28006cf00 con 0x7fb2800c6480 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7fb268001680 con 0x7fb2800c6480 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 >> v1:172.21.15.67:6789/0 conn(0x7fb2800c6480 legacy=0x7fb28006d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 0x7fb260003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb260003f50 0x7fb2600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb260005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb280156ad0 con 0x7fb260004d10 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28006cc20 con 0x7fb260003f50 2024-01-18T00:48:44.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.820+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26000dc20 con 0x7fb2800c68c0 2024-01-18T00:48:44.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.824+0000 7fb27f400640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb260005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.828+0000 7fb27f400640 1 -- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 msgr2=0x7fb260003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.828+0000 7fb27f400640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800c68c0 0x7fb260003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.828+0000 7fb27f400640 1 -- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb260003f50 msgr2=0x7fb2600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:44.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.828+0000 7fb27f400640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb260003f50 0x7fb2600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.828+0000 7fb27f400640 1 -- 172.21.15.67:0/2676487194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260003530 con 0x7fb260004d10 2024-01-18T00:48:44.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.832+0000 7fb27f400640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb260005190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb278009fc0 tx=0x7fb27801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b574fa5bcff039ea server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.832+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a5cb0 con 0x7fb260004d10 2024-01-18T00:48:44.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800f040 con 0x7fb260004d10 2024-01-18T00:48:44.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb27d600640 1 -- 172.21.15.67:0/2676487194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780ad680 con 0x7fb260004d10 2024-01-18T00:48:44.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 -- 172.21.15.67:0/2676487194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 msgr2=0x7fb260005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 --2- 172.21.15.67:0/2676487194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb260005190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb278009fc0 tx=0x7fb27801cca0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb27f400640 1 -- 172.21.15.67:0/2676487194 reap_dead start 2024-01-18T00:48:44.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 -- 172.21.15.67:0/2676487194 shutdown_connections 2024-01-18T00:48:44.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 -- 172.21.15.67:0/2676487194 >> 172.21.15.67:0/2676487194 conn(0x7fb2800cb070 msgr2=0x7fb2800cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:44.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 -- 172.21.15.67:0/2676487194 shutdown_connections 2024-01-18T00:48:44.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.836+0000 7fb285e00640 1 -- 172.21.15.67:0/2676487194 wait complete. 2024-01-18T00:48:44.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 Processor -- start 2024-01-18T00:48:44.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 -- start start 2024-01-18T00:48:44.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28014b970 0x7fb2801f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800ca330 0x7fb280142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28014a560 con 0x7fb260004d10 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801f3730 con 0x7fb28014b970 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb285e00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28014bdd0 con 0x7fb2800ca330 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb27ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb27ea00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54994/0 (socket says 172.21.15.67:54994) 2024-01-18T00:48:44.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb27ea00640 1 -- 172.21.15.67:0/2805546596 learned_addr learned my addr 172.21.15.67:0/2805546596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:44.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.840+0000 7fb27f400640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800ca330 0x7fb280142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27e000640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28014b970 0x7fb2801f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27ea00640 1 -- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800ca330 msgr2=0x7fb280142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27ea00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800ca330 0x7fb280142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27ea00640 1 -- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28014b970 msgr2=0x7fb2801f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27ea00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28014b970 0x7fb2801f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:44.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.844+0000 7fb27ea00640 1 -- 172.21.15.67:0/2805546596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28014a000 con 0x7fb260004d10 2024-01-18T00:48:44.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.848+0000 7fb27ea00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb270009fd0 tx=0x7fb27000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:44.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000eea0 con 0x7fb260004d10 2024-01-18T00:48:44.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000c8e0 con 0x7fb260004d10 2024-01-18T00:48:44.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000cc90 con 0x7fb260004d10 2024-01-18T00:48:44.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb280153e60 con 0x7fb260004d10 2024-01-18T00:48:44.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28014ae90 con 0x7fb260004d10 2024-01-18T00:48:44.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.852+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2800746a0 con 0x7fb260004d10 2024-01-18T00:48:44.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.872+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fb270013470 con 0x7fb260004d10 2024-01-18T00:48:44.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.876+0000 7fb277400640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 0x7fb258068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:44.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.876+0000 7fb27e000640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 0x7fb258068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:44.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:44.876+0000 7fb27e000640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 0x7fb258068d30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb2680017f0 tx=0x7fb268009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:45.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.124+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb270055870 con 0x7fb260004d10 2024-01-18T00:48:45.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.124+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fb270051bb0 con 0x7fb260004d10 2024-01-18T00:48:45.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb280159480 con 0x7fb258066870 2024-01-18T00:48:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb277400640 1 -- 172.21.15.67:0/2805546596 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb268007050 con 0x7fb258066870 2024-01-18T00:48:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 msgr2=0x7fb258068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 0x7fb258068d30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb2680017f0 tx=0x7fb268009040 comp rx=0 tx=0).stop 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 msgr2=0x7fb280141860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb270009fd0 tx=0x7fb27000ec50 comp rx=0 tx=0).stop 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 shutdown_connections 2024-01-18T00:48:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fb258066870 0x7fb258068d30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fb2800ca330 0x7fb280142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb28014b970 0x7fb2801f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 --2- 172.21.15.67:0/2805546596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb260004d10 0x7fb280141860 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 >> 172.21.15.67:0/2805546596 conn(0x7fb2800cb070 msgr2=0x7fb28014dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.292+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 shutdown_connections 2024-01-18T00:48:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.296+0000 7fb285e00640 1 -- 172.21.15.67:0/2805546596 wait complete. 2024-01-18T00:48:45.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:48:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 Processor -- start 2024-01-18T00:48:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 -- start start 2024-01-18T00:48:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa788151a90 0x7fa788157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880c7910 con 0x7fa7880c9650 2024-01-18T00:48:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa788158530 con 0x7fa7880c8970 2024-01-18T00:48:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.460+0000 7fa790800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78815b5d0 con 0x7fa788151a90 2024-01-18T00:48:45.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.464+0000 7fa78e800640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa7880c8970 0x7fa7880c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:33978/0 (socket says 172.21.15.67:33978) 2024-01-18T00:48:45.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.464+0000 7fa78e800640 1 -- 172.21.15.67:0/1968913709 learned_addr learned my addr 172.21.15.67:0/1968913709 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:48:45.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.464+0000 7fa78de00640 1 --2- 172.21.15.67:0/1968913709 >> v2:172.21.15.137:3300/0 conn(0x7fa788151a90 0x7fa788157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:45.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.476+0000 7fa78de00640 1 -- 172.21.15.67:0/1968913709 >> v1:172.21.15.137:6789/0 conn(0x7fa7880c8970 legacy=0x7fa7880c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.476+0000 7fa78de00640 1 -- 172.21.15.67:0/1968913709 >> v1:172.21.15.67:6789/0 conn(0x7fa7880c9650 legacy=0x7fa7880c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:48:45.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.476+0000 7fa78de00640 1 -- 172.21.15.67:0/1968913709 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78806efe0 con 0x7fa788151a90 2024-01-18T00:48:45.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.484+0000 7fa78de00640 1 --2- 172.21.15.67:0/1968913709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa788151a90 0x7fa788157ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7780097c0 tx=0x7fa77801ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86525f047a711a20 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:45.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa78ca00640 1 -- 172.21.15.67:0/1968913709 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a8930 con 0x7fa788151a90 2024-01-18T00:48:45.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa78ca00640 1 -- 172.21.15.67:0/1968913709 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780a8a90 con 0x7fa788151a90 2024-01-18T00:48:45.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa78ca00640 1 -- 172.21.15.67:0/1968913709 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a8e20 con 0x7fa788151a90 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- 172.21.15.67:0/1968913709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa788151a90 msgr2=0x7fa788157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 --2- 172.21.15.67:0/1968913709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa788151a90 0x7fa788157ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7780097c0 tx=0x7fa77801ec30 comp rx=0 tx=0).stop 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- 172.21.15.67:0/1968913709 shutdown_connections 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 --2- 172.21.15.67:0/1968913709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa788151a90 0x7fa788157ff0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- 172.21.15.67:0/1968913709 >> 172.21.15.67:0/1968913709 conn(0x7fa78806fc50 msgr2=0x7fa788070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:45.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- 172.21.15.67:0/1968913709 shutdown_connections 2024-01-18T00:48:45.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- 172.21.15.67:0/1968913709 wait complete. 2024-01-18T00:48:45.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 Processor -- start 2024-01-18T00:48:45.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.592+0000 7fa790800640 1 -- start start 2024-01-18T00:48:45.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7880c8970 0x7fa78814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:45.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7880c9650 0x7fa788148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:45.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:45.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880c28b0 con 0x7fa788151a90 2024-01-18T00:48:45.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880c9e10 con 0x7fa7880c9650 2024-01-18T00:48:45.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa790800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881486b0 con 0x7fa7880c8970 2024-01-18T00:48:45.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa78e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:45.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa78e800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55006/0 (socket says 172.21.15.67:55006) 2024-01-18T00:48:45.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.596+0000 7fa78e800640 1 -- 172.21.15.67:0/818928268 learned_addr learned my addr 172.21.15.67:0/818928268 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78d400640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7880c9650 0x7fa788148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78e800640 1 -- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7880c8970 msgr2=0x7fa78814dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78e800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7880c8970 0x7fa78814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78e800640 1 -- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7880c9650 msgr2=0x7fa788148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78e800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7880c9650 0x7fa788148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:45.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.600+0000 7fa78e800640 1 -- 172.21.15.67:0/818928268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778009420 con 0x7fa788151a90 2024-01-18T00:48:45.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.604+0000 7fa78e800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa78000ca80 tx=0x7fa78000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.656+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000ac30 con 0x7fa788151a90 2024-01-18T00:48:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.656+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78000ad90 con 0x7fa788151a90 2024-01-18T00:48:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.656+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780012600 con 0x7fa788151a90 2024-01-18T00:48:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.656+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7880c2b00 con 0x7fa788151a90 2024-01-18T00:48:45.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.656+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7880ca060 con 0x7fa788151a90 2024-01-18T00:48:45.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.660+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880746a0 con 0x7fa788151a90 2024-01-18T00:48:45.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.912+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa780007070 con 0x7fa788151a90 2024-01-18T00:48:45.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.912+0000 7fa786000640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 0x7fa760068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:48:45.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.912+0000 7fa78de00640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 0x7fa760068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:48:45.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.916+0000 7fa78de00640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 0x7fa760068d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7780b2000 tx=0x7fa778004740 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:48:45.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.932+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7800553c0 con 0x7fa788151a90 2024-01-18T00:48:45.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:45.932+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa780051700 con 0x7fa788151a90 2024-01-18T00:48:46.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.092+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7880c7740 con 0x7fa760066890 2024-01-18T00:48:46.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.124+0000 7fa786000640 1 -- 172.21.15.67:0/818928268 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369258 (secure 0 0 0) 0x7fa7880c7740 con 0x7fa760066890 2024-01-18T00:48:46.130 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:48:46.132 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-18T00:48:46.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 msgr2=0x7fa760068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 0x7fa760068d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7780b2000 tx=0x7fa778004740 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 msgr2=0x7fa7880c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa78000ca80 tx=0x7fa78000cf40 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 shutdown_connections 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa760066890 0x7fa760068d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa788151a90 0x7fa7880c4800 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7880c9650 0x7fa788148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 --2- 172.21.15.67:0/818928268 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7880c8970 0x7fa78814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 >> 172.21.15.67:0/818928268 conn(0x7fa78806fc50 msgr2=0x7fa788150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 shutdown_connections 2024-01-18T00:48:46.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:48:46.128+0000 7fa790800640 1 -- 172.21.15.67:0/818928268 wait complete. 2024-01-18T00:48:46.150 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":3294,"stamp":"2024-01-18T00:48:44.745619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198617955,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3114,"num_read_kb":3689626,"num_write":46748,"num_write_kb":4572616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59880,"ondisk_log_size":59880,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1012360,"kb_used_data":179016,"kb_used_omap":12,"kb_used_meta":833267,"kb_avail":753962360,"statfs":{"total":773094113280,"available":772057456640,"internally_reserved":0,"allocated":183312384,"data_stored":398243758,"data_compressed":51491768,"data_compressed_allocated":69574656,"data_compressed_original":286113792,"omap_allocated":12752,"internal_metadata":853265968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13597,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":25,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005498"},"pg_stats":[{"pgid":"2.1f","version":"29'354","reported_seq":435,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:41.051141+0000","last_change":"2024-01-18T00:48:41.051174+0000","last_active":"2024-01-18T00:48:41.051141+0000","last_peered":"2024-01-18T00:48:41.051141+0000","last_clean":"2024-01-18T00:48:41.051141+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-18T00:48:41.051141+0000","last_undegraded":"2024-01-18T00:48:41.051141+0000","last_fullsized":"2024-01-18T00:48:41.051141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'354","last_scrub_stamp":"2024-01-18T00:48:41.051065+0000","last_deep_scrub":"29'354","last_deep_scrub_stamp":"2024-01-18T00:48:41.051065+0000","last_clean_scrub_stamp":"2024-01-18T00:48:41.051065+0000","objects_scrubbed":6,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:32:06.952383+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'196","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.699598+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:33.699598+0000","last_peered":"2024-01-18T00:48:33.699598+0000","last_clean":"2024-01-18T00:48:33.699598+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-18T00:48:33.699598+0000","last_undegraded":"2024-01-18T00:48:33.699598+0000","last_fullsized":"2024-01-18T00:48:33.699598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'802","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.040755+0000","last_change":"2024-01-17T23:00:24.761482+0000","last_active":"2024-01-18T00:48:27.040755+0000","last_peered":"2024-01-18T00:48:27.040755+0000","last_clean":"2024-01-18T00:48:27.040755+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-18T00:48:27.040755+0000","last_undegraded":"2024-01-18T00:48:27.040755+0000","last_fullsized":"2024-01-18T00:48:27.040755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":142138,"num_write":787,"num_write_kb":155519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'554","reported_seq":628,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:41.198565+0000","last_change":"2024-01-17T23:00:17.454960+0000","last_active":"2024-01-18T00:47:41.198565+0000","last_peered":"2024-01-18T00:47:41.198565+0000","last_clean":"2024-01-18T00:47:41.198565+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-18T00:47:41.198565+0000","last_undegraded":"2024-01-18T00:47:41.198565+0000","last_fullsized":"2024-01-18T00:47:41.198565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'170","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.886628+0000","last_change":"2024-01-17T23:00:18.563978+0000","last_active":"2024-01-18T00:48:37.886628+0000","last_peered":"2024-01-18T00:48:37.886628+0000","last_clean":"2024-01-18T00:48:37.886628+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-18T00:48:37.886628+0000","last_undegraded":"2024-01-18T00:48:37.886628+0000","last_fullsized":"2024-01-18T00:48:37.886628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'820","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.292642+0000","last_change":"2024-01-17T23:00:24.760244+0000","last_active":"2024-01-18T00:48:21.292642+0000","last_peered":"2024-01-18T00:48:21.292642+0000","last_clean":"2024-01-18T00:48:21.292642+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-18T00:48:21.292642+0000","last_undegraded":"2024-01-18T00:48:21.292642+0000","last_fullsized":"2024-01-18T00:48:21.292642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:15:40.455754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":112120,"num_write":807,"num_write_kb":168152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1017","reported_seq":1080,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:45.207860+0000","last_change":"2024-01-17T23:00:17.461637+0000","last_active":"2024-01-18T00:46:45.207860+0000","last_peered":"2024-01-18T00:46:45.207860+0000","last_clean":"2024-01-18T00:46:45.207860+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-18T00:46:45.207860+0000","last_undegraded":"2024-01-18T00:46:45.207860+0000","last_fullsized":"2024-01-18T00:46:45.207860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:44.025325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":12756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'185","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.698303+0000","last_change":"2024-01-17T23:00:18.491161+0000","last_active":"2024-01-18T00:48:33.698303+0000","last_peered":"2024-01-18T00:48:33.698303+0000","last_clean":"2024-01-18T00:48:33.698303+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-18T00:48:33.698303+0000","last_undegraded":"2024-01-18T00:48:33.698303+0000","last_fullsized":"2024-01-18T00:48:33.698303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'736","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.474364+0000","last_change":"2024-01-17T23:00:24.767773+0000","last_active":"2024-01-18T00:48:18.474364+0000","last_peered":"2024-01-18T00:48:18.474364+0000","last_clean":"2024-01-18T00:48:18.474364+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-18T00:48:18.474364+0000","last_undegraded":"2024-01-18T00:48:18.474364+0000","last_fullsized":"2024-01-18T00:48:18.474364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:59:06.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":76820,"num_write":722,"num_write_kb":119762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'829","reported_seq":892,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:15.309570+0000","last_change":"2024-01-17T23:00:17.461645+0000","last_active":"2024-01-18T00:47:15.309570+0000","last_peered":"2024-01-18T00:47:15.309570+0000","last_clean":"2024-01-18T00:47:15.309570+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-18T00:47:15.309570+0000","last_undegraded":"2024-01-18T00:47:15.309570+0000","last_fullsized":"2024-01-18T00:47:15.309570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:12.563875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'208","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.704280+0000","last_change":"2024-01-17T23:00:18.491045+0000","last_active":"2024-01-18T00:48:33.704280+0000","last_peered":"2024-01-18T00:48:33.704280+0000","last_clean":"2024-01-18T00:48:33.704280+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-18T00:48:33.704280+0000","last_undegraded":"2024-01-18T00:48:33.704280+0000","last_fullsized":"2024-01-18T00:48:33.704280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'727","reported_seq":813,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.363639+0000","last_change":"2024-01-17T23:00:24.767634+0000","last_active":"2024-01-18T00:48:27.363639+0000","last_peered":"2024-01-18T00:48:27.363639+0000","last_clean":"2024-01-18T00:48:27.363639+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-18T00:48:27.363639+0000","last_undegraded":"2024-01-18T00:48:27.363639+0000","last_fullsized":"2024-01-18T00:48:27.363639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:31:04.029212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":89221,"num_write":717,"num_write_kb":93426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'218","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.575121+0000","last_change":"2024-01-17T23:00:19.910550+0000","last_active":"2024-01-18T00:48:33.575121+0000","last_peered":"2024-01-18T00:48:33.575121+0000","last_clean":"2024-01-18T00:48:33.575121+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-18T00:48:33.575121+0000","last_undegraded":"2024-01-18T00:48:33.575121+0000","last_fullsized":"2024-01-18T00:48:33.575121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:03.386782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'1218","reported_seq":1286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:56.212940+0000","last_change":"2024-01-17T23:00:17.456566+0000","last_active":"2024-01-18T00:46:56.212940+0000","last_peered":"2024-01-18T00:46:56.212940+0000","last_clean":"2024-01-18T00:46:56.212940+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-18T00:46:56.212940+0000","last_undegraded":"2024-01-18T00:46:56.212940+0000","last_fullsized":"2024-01-18T00:46:56.212940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1218,"log_dups_size":0,"ondisk_log_size":1218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:40.758297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'784","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:19.037590+0000","last_change":"2024-01-17T23:00:24.765630+0000","last_active":"2024-01-18T00:48:19.037590+0000","last_peered":"2024-01-18T00:48:19.037590+0000","last_clean":"2024-01-18T00:48:19.037590+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-18T00:48:19.037590+0000","last_undegraded":"2024-01-18T00:48:19.037590+0000","last_fullsized":"2024-01-18T00:48:19.037590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:16:27.717388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":112181,"num_write":768,"num_write_kb":146877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'218","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.056278+0000","last_change":"2024-01-18T00:48:42.056298+0000","last_active":"2024-01-18T00:48:42.056278+0000","last_peered":"2024-01-18T00:48:42.056278+0000","last_clean":"2024-01-18T00:48:42.056278+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-18T00:48:42.056278+0000","last_undegraded":"2024-01-18T00:48:42.056278+0000","last_fullsized":"2024-01-18T00:48:42.056278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-01-18T00:48:42.056223+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-01-18T00:48:42.056223+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.056223+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:26.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1253","reported_seq":1331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:39.928459+0000","last_change":"2024-01-18T00:48:39.928486+0000","last_active":"2024-01-18T00:48:39.928459+0000","last_peered":"2024-01-18T00:48:39.928459+0000","last_clean":"2024-01-18T00:48:39.928459+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-18T00:48:39.928459+0000","last_undegraded":"2024-01-18T00:48:39.928459+0000","last_fullsized":"2024-01-18T00:48:39.928459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1253","last_scrub_stamp":"2024-01-18T00:48:39.928399+0000","last_deep_scrub":"29'1253","last_deep_scrub_stamp":"2024-01-18T00:48:39.928399+0000","last_clean_scrub_stamp":"2024-01-18T00:48:39.928399+0000","objects_scrubbed":3,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:12:02.413836+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'844","reported_seq":945,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.741571+0000","last_change":"2024-01-17T23:00:24.765916+0000","last_active":"2024-01-18T00:48:21.741571+0000","last_peered":"2024-01-18T00:48:21.741571+0000","last_clean":"2024-01-18T00:48:21.741571+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-18T00:48:21.741571+0000","last_undegraded":"2024-01-18T00:48:21.741571+0000","last_fullsized":"2024-01-18T00:48:21.741571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:04:53.082408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":112670,"num_write":833,"num_write_kb":127477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'211","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.799657+0000","last_change":"2024-01-17T23:00:19.816043+0000","last_active":"2024-01-18T00:48:37.799657+0000","last_peered":"2024-01-18T00:48:37.799657+0000","last_clean":"2024-01-18T00:48:37.799657+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-18T00:48:37.799657+0000","last_undegraded":"2024-01-18T00:48:37.799657+0000","last_fullsized":"2024-01-18T00:48:37.799657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'322","reported_seq":393,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.874502+0000","last_change":"2024-01-17T23:00:17.451957+0000","last_active":"2024-01-18T00:48:37.874502+0000","last_peered":"2024-01-18T00:48:37.874502+0000","last_clean":"2024-01-18T00:48:37.874502+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-18T00:48:37.874502+0000","last_undegraded":"2024-01-18T00:48:37.874502+0000","last_fullsized":"2024-01-18T00:48:37.874502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'756","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.929192+0000","last_change":"2024-01-17T23:00:24.777845+0000","last_active":"2024-01-18T00:48:06.929192+0000","last_peered":"2024-01-18T00:48:06.929192+0000","last_clean":"2024-01-18T00:48:06.929192+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-18T00:48:06.929192+0000","last_undegraded":"2024-01-18T00:48:06.929192+0000","last_fullsized":"2024-01-18T00:48:06.929192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":171173,"num_write":745,"num_write_kb":212620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'224","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.678985+0000","last_change":"2024-01-17T23:00:18.368346+0000","last_active":"2024-01-18T00:48:33.678985+0000","last_peered":"2024-01-18T00:48:33.678985+0000","last_clean":"2024-01-18T00:48:33.678985+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-18T00:48:33.678985+0000","last_undegraded":"2024-01-18T00:48:33.678985+0000","last_fullsized":"2024-01-18T00:48:33.678985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:57.766985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'229","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.385190+0000","last_change":"2024-01-17T23:00:17.458516+0000","last_active":"2024-01-18T00:48:31.385190+0000","last_peered":"2024-01-18T00:48:31.385190+0000","last_clean":"2024-01-18T00:48:31.385190+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-18T00:48:31.385190+0000","last_undegraded":"2024-01-18T00:48:31.385190+0000","last_fullsized":"2024-01-18T00:48:31.385190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'704","reported_seq":784,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071298+0000","last_change":"2024-01-17T23:00:24.767139+0000","last_active":"2024-01-18T00:48:27.071298+0000","last_peered":"2024-01-18T00:48:27.071298+0000","last_clean":"2024-01-18T00:48:27.071298+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-18T00:48:27.071298+0000","last_undegraded":"2024-01-18T00:48:27.071298+0000","last_fullsized":"2024-01-18T00:48:27.071298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:33:19.114096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42617,"num_write":681,"num_write_kb":68844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'225","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.886613+0000","last_change":"2024-01-17T23:00:18.560146+0000","last_active":"2024-01-18T00:48:37.886613+0000","last_peered":"2024-01-18T00:48:37.886613+0000","last_clean":"2024-01-18T00:48:37.886613+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-18T00:48:37.886613+0000","last_undegraded":"2024-01-18T00:48:37.886613+0000","last_fullsized":"2024-01-18T00:48:37.886613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'302","reported_seq":372,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:31.431078+0000","last_change":"2024-01-17T23:00:17.452003+0000","last_active":"2024-01-18T00:48:31.431078+0000","last_peered":"2024-01-18T00:48:31.431078+0000","last_clean":"2024-01-18T00:48:31.431078+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-18T00:48:31.431078+0000","last_undegraded":"2024-01-18T00:48:31.431078+0000","last_fullsized":"2024-01-18T00:48:31.431078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:03:37.362691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'837","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050116+0000","last_change":"2024-01-17T23:00:24.765633+0000","last_active":"2024-01-18T00:48:21.050116+0000","last_peered":"2024-01-18T00:48:21.050116+0000","last_clean":"2024-01-18T00:48:21.050116+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-18T00:48:21.050116+0000","last_undegraded":"2024-01-18T00:48:21.050116+0000","last_fullsized":"2024-01-18T00:48:21.050116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:12:01.259436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":234919,"num_write":817,"num_write_kb":206693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'182","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.799714+0000","last_change":"2024-01-17T23:00:20.243490+0000","last_active":"2024-01-18T00:48:37.799714+0000","last_peered":"2024-01-18T00:48:37.799714+0000","last_clean":"2024-01-18T00:48:37.799714+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-18T00:48:37.799714+0000","last_undegraded":"2024-01-18T00:48:37.799714+0000","last_fullsized":"2024-01-18T00:48:37.799714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'1187","reported_seq":1266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.948938+0000","last_change":"2024-01-18T00:48:40.948964+0000","last_active":"2024-01-18T00:48:40.948938+0000","last_peered":"2024-01-18T00:48:40.948938+0000","last_clean":"2024-01-18T00:48:40.948938+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-18T00:48:40.948938+0000","last_undegraded":"2024-01-18T00:48:40.948938+0000","last_fullsized":"2024-01-18T00:48:40.948938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1187","last_scrub_stamp":"2024-01-18T00:48:40.948880+0000","last_deep_scrub":"29'1187","last_deep_scrub_stamp":"2024-01-18T00:48:40.948880+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.948880+0000","objects_scrubbed":2,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:59:21.685236+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3147,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'823","reported_seq":937,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.286058+0000","last_change":"2024-01-17T23:00:24.765778+0000","last_active":"2024-01-18T00:48:21.286058+0000","last_peered":"2024-01-18T00:48:21.286058+0000","last_clean":"2024-01-18T00:48:21.286058+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-18T00:48:21.286058+0000","last_undegraded":"2024-01-18T00:48:21.286058+0000","last_fullsized":"2024-01-18T00:48:21.286058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":136936,"num_write":807,"num_write_kb":135857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'203","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.874537+0000","last_change":"2024-01-17T23:00:19.815627+0000","last_active":"2024-01-18T00:48:37.874537+0000","last_peered":"2024-01-18T00:48:37.874537+0000","last_clean":"2024-01-18T00:48:37.874537+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-18T00:48:37.874537+0000","last_undegraded":"2024-01-18T00:48:37.874537+0000","last_fullsized":"2024-01-18T00:48:37.874537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'794","reported_seq":865,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:12.091765+0000","last_change":"2024-01-17T23:00:17.458869+0000","last_active":"2024-01-18T00:47:12.091765+0000","last_peered":"2024-01-18T00:47:12.091765+0000","last_clean":"2024-01-18T00:47:12.091765+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-18T00:47:12.091765+0000","last_undegraded":"2024-01-18T00:47:12.091765+0000","last_fullsized":"2024-01-18T00:47:12.091765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:17.372129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'751","reported_seq":848,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.091970+0000","last_change":"2024-01-17T23:00:24.772783+0000","last_active":"2024-01-18T00:48:27.091970+0000","last_peered":"2024-01-18T00:48:27.091970+0000","last_clean":"2024-01-18T00:48:27.091970+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-18T00:48:27.091970+0000","last_undegraded":"2024-01-18T00:48:27.091970+0000","last_fullsized":"2024-01-18T00:48:27.091970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":97762,"num_write":737,"num_write_kb":97911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'220","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.707686+0000","last_change":"2024-01-17T23:00:18.565865+0000","last_active":"2024-01-18T00:48:33.707686+0000","last_peered":"2024-01-18T00:48:33.707686+0000","last_clean":"2024-01-18T00:48:33.707686+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-18T00:48:33.707686+0000","last_undegraded":"2024-01-18T00:48:33.707686+0000","last_fullsized":"2024-01-18T00:48:33.707686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'268","reported_seq":341,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.874551+0000","last_change":"2024-01-17T23:00:17.453718+0000","last_active":"2024-01-18T00:48:37.874551+0000","last_peered":"2024-01-18T00:48:37.874551+0000","last_clean":"2024-01-18T00:48:37.874551+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-18T00:48:37.874551+0000","last_undegraded":"2024-01-18T00:48:37.874551+0000","last_fullsized":"2024-01-18T00:48:37.874551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'803","reported_seq":918,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.473199+0000","last_change":"2024-01-17T23:00:24.773797+0000","last_active":"2024-01-18T00:48:27.473199+0000","last_peered":"2024-01-18T00:48:27.473199+0000","last_clean":"2024-01-18T00:48:27.473199+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-18T00:48:27.473199+0000","last_undegraded":"2024-01-18T00:48:27.473199+0000","last_fullsized":"2024-01-18T00:48:27.473199+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":142135,"num_write":790,"num_write_kb":151473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'205","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.686107+0000","last_change":"2024-01-17T23:00:18.558972+0000","last_active":"2024-01-18T00:48:33.686107+0000","last_peered":"2024-01-18T00:48:33.686107+0000","last_clean":"2024-01-18T00:48:33.686107+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-18T00:48:33.686107+0000","last_undegraded":"2024-01-18T00:48:33.686107+0000","last_fullsized":"2024-01-18T00:48:33.686107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:53:36.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'959","reported_seq":1031,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:32.787358+0000","last_change":"2024-01-17T23:00:17.455663+0000","last_active":"2024-01-18T00:46:32.787358+0000","last_peered":"2024-01-18T00:46:32.787358+0000","last_clean":"2024-01-18T00:46:32.787358+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-18T00:46:32.787358+0000","last_undegraded":"2024-01-18T00:46:32.787358+0000","last_fullsized":"2024-01-18T00:46:32.787358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:11.141306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'706","reported_seq":807,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:06.959813+0000","last_change":"2024-01-17T23:00:24.763236+0000","last_active":"2024-01-18T00:48:06.959813+0000","last_peered":"2024-01-18T00:48:06.959813+0000","last_clean":"2024-01-18T00:48:06.959813+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-18T00:48:06.959813+0000","last_undegraded":"2024-01-18T00:48:06.959813+0000","last_fullsized":"2024-01-18T00:48:06.959813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":104293,"num_write":696,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'201","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.718036+0000","last_change":"2024-01-17T23:00:19.817471+0000","last_active":"2024-01-18T00:48:33.718036+0000","last_peered":"2024-01-18T00:48:33.718036+0000","last_clean":"2024-01-18T00:48:33.718036+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-18T00:48:33.718036+0000","last_undegraded":"2024-01-18T00:48:33.718036+0000","last_fullsized":"2024-01-18T00:48:33.718036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1851","reported_seq":3710,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:36.357399+0000","last_change":"2024-01-17T23:00:17.326890+0000","last_active":"2024-01-18T00:48:36.357399+0000","last_peered":"2024-01-18T00:48:36.357399+0000","last_clean":"2024-01-18T00:48:36.357399+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:36.357399+0000","last_undegraded":"2024-01-18T00:48:36.357399+0000","last_fullsized":"2024-01-18T00:48:36.357399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1851,"log_dups_size":0,"ondisk_log_size":1851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1786,"num_read_kb":2854,"num_write":1793,"num_write_kb":2858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'717","reported_seq":800,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.306970+0000","last_change":"2024-01-17T23:00:34.460033+0000","last_active":"2024-01-18T00:48:27.306970+0000","last_peered":"2024-01-18T00:48:27.306970+0000","last_clean":"2024-01-18T00:48:27.306970+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-18T00:48:27.306970+0000","last_undegraded":"2024-01-18T00:48:27.306970+0000","last_fullsized":"2024-01-18T00:48:27.306970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54940,"num_write":709,"num_write_kb":85564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'199","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:39.071147+0000","last_change":"2024-01-18T00:48:39.071168+0000","last_active":"2024-01-18T00:48:39.071147+0000","last_peered":"2024-01-18T00:48:39.071147+0000","last_clean":"2024-01-18T00:48:39.071147+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-18T00:48:39.071147+0000","last_undegraded":"2024-01-18T00:48:39.071147+0000","last_fullsized":"2024-01-18T00:48:39.071147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-01-18T00:48:39.071066+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-01-18T00:48:39.071066+0000","last_clean_scrub_stamp":"2024-01-18T00:48:39.071066+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:35:24.417318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'549","reported_seq":622,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:00.161781+0000","last_change":"2024-01-17T23:00:17.454125+0000","last_active":"2024-01-18T00:48:00.161781+0000","last_peered":"2024-01-18T00:48:00.161781+0000","last_clean":"2024-01-18T00:48:00.161781+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-18T00:48:00.161781+0000","last_undegraded":"2024-01-18T00:48:00.161781+0000","last_fullsized":"2024-01-18T00:48:00.161781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:32.394996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":12520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'927","reported_seq":1064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:07.141752+0000","last_change":"2024-01-17T23:00:24.778897+0000","last_active":"2024-01-18T00:48:07.141752+0000","last_peered":"2024-01-18T00:48:07.141752+0000","last_clean":"2024-01-18T00:48:07.141752+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-18T00:48:07.141752+0000","last_undegraded":"2024-01-18T00:48:07.141752+0000","last_fullsized":"2024-01-18T00:48:07.141752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":233359,"num_write":916,"num_write_kb":280898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'196","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.799681+0000","last_change":"2024-01-17T23:00:19.650370+0000","last_active":"2024-01-18T00:48:37.799681+0000","last_peered":"2024-01-18T00:48:37.799681+0000","last_clean":"2024-01-18T00:48:37.799681+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-18T00:48:37.799681+0000","last_undegraded":"2024-01-18T00:48:37.799681+0000","last_fullsized":"2024-01-18T00:48:37.799681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'291","reported_seq":363,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.467610+0000","last_change":"2024-01-17T23:00:17.367124+0000","last_active":"2024-01-18T00:48:27.467610+0000","last_peered":"2024-01-18T00:48:27.467610+0000","last_clean":"2024-01-18T00:48:27.467610+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-18T00:48:27.467610+0000","last_undegraded":"2024-01-18T00:48:27.467610+0000","last_fullsized":"2024-01-18T00:48:27.467610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:43.574120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'161","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:22.833997+0000","last_change":"2024-01-17T22:59:44.582957+0000","last_active":"2024-01-18T00:46:22.833997+0000","last_peered":"2024-01-18T00:46:22.833997+0000","last_clean":"2024-01-18T00:46:22.833997+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-18T00:46:22.833997+0000","last_undegraded":"2024-01-18T00:46:22.833997+0000","last_fullsized":"2024-01-18T00:46:22.833997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T22:59:42.792711+0000","last_clean_scrub_stamp":"2024-01-17T22:59:42.792711+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:08:21.786827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'848","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.361087+0000","last_change":"2024-01-17T23:00:24.756371+0000","last_active":"2024-01-18T00:48:18.361087+0000","last_peered":"2024-01-18T00:48:18.361087+0000","last_clean":"2024-01-18T00:48:18.361087+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-18T00:48:18.361087+0000","last_undegraded":"2024-01-18T00:48:18.361087+0000","last_fullsized":"2024-01-18T00:48:18.361087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:27.631802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":221922,"num_write":836,"num_write_kb":231792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'205","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.731092+0000","last_change":"2024-01-17T23:00:18.505231+0000","last_active":"2024-01-18T00:48:33.731092+0000","last_peered":"2024-01-18T00:48:33.731092+0000","last_clean":"2024-01-18T00:48:33.731092+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-18T00:48:33.731092+0000","last_undegraded":"2024-01-18T00:48:33.731092+0000","last_fullsized":"2024-01-18T00:48:33.731092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'352","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:16.355577+0000","last_change":"2024-01-17T23:00:17.365414+0000","last_active":"2024-01-18T00:48:16.355577+0000","last_peered":"2024-01-18T00:48:16.355577+0000","last_clean":"2024-01-18T00:48:16.355577+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-18T00:48:16.355577+0000","last_undegraded":"2024-01-18T00:48:16.355577+0000","last_fullsized":"2024-01-18T00:48:16.355577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'833","reported_seq":960,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.050673+0000","last_change":"2024-01-17T23:00:24.766949+0000","last_active":"2024-01-18T00:48:21.050673+0000","last_peered":"2024-01-18T00:48:21.050673+0000","last_clean":"2024-01-18T00:48:21.050673+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-18T00:48:21.050673+0000","last_undegraded":"2024-01-18T00:48:21.050673+0000","last_fullsized":"2024-01-18T00:48:21.050673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:52.227012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":185672,"num_write":820,"num_write_kb":193922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'221","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.701988+0000","last_change":"2024-01-17T23:00:18.565127+0000","last_active":"2024-01-18T00:48:33.701988+0000","last_peered":"2024-01-18T00:48:33.701988+0000","last_clean":"2024-01-18T00:48:33.701988+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-18T00:48:33.701988+0000","last_undegraded":"2024-01-18T00:48:33.701988+0000","last_fullsized":"2024-01-18T00:48:33.701988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:08:13.778596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'245","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:41.960530+0000","last_change":"2024-01-18T00:48:41.960555+0000","last_active":"2024-01-18T00:48:41.960530+0000","last_peered":"2024-01-18T00:48:41.960530+0000","last_clean":"2024-01-18T00:48:41.960530+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-18T00:48:41.960530+0000","last_undegraded":"2024-01-18T00:48:41.960530+0000","last_fullsized":"2024-01-18T00:48:41.960530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'245","last_scrub_stamp":"2024-01-18T00:48:41.960468+0000","last_deep_scrub":"29'245","last_deep_scrub_stamp":"2024-01-18T00:48:41.960468+0000","last_clean_scrub_stamp":"2024-01-18T00:48:41.960468+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:44:01.156348+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'771","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.885720+0000","last_change":"2024-01-17T23:00:24.779915+0000","last_active":"2024-01-18T00:48:27.885720+0000","last_peered":"2024-01-18T00:48:27.885720+0000","last_clean":"2024-01-18T00:48:27.885720+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-18T00:48:27.885720+0000","last_undegraded":"2024-01-18T00:48:27.885720+0000","last_fullsized":"2024-01-18T00:48:27.885720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":76462,"num_write":751,"num_write_kb":105973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'186","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.735312+0000","last_change":"2024-01-17T23:00:18.502797+0000","last_active":"2024-01-18T00:48:33.735312+0000","last_peered":"2024-01-18T00:48:33.735312+0000","last_clean":"2024-01-18T00:48:33.735312+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-18T00:48:33.735312+0000","last_undegraded":"2024-01-18T00:48:33.735312+0000","last_fullsized":"2024-01-18T00:48:33.735312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:44.174826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'810","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.538687+0000","last_change":"2024-01-18T00:48:40.538716+0000","last_active":"2024-01-18T00:48:40.538687+0000","last_peered":"2024-01-18T00:48:40.538687+0000","last_clean":"2024-01-18T00:48:40.538687+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:40.538687+0000","last_undegraded":"2024-01-18T00:48:40.538687+0000","last_fullsized":"2024-01-18T00:48:40.538687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'810","last_scrub_stamp":"2024-01-18T00:48:40.538630+0000","last_deep_scrub":"29'810","last_deep_scrub_stamp":"2024-01-18T00:48:40.538630+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.538630+0000","objects_scrubbed":2,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:42.829599+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'771","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.498847+0000","last_change":"2024-01-17T23:00:24.774698+0000","last_active":"2024-01-18T00:48:21.498847+0000","last_peered":"2024-01-18T00:48:21.498847+0000","last_clean":"2024-01-18T00:48:21.498847+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-18T00:48:21.498847+0000","last_undegraded":"2024-01-18T00:48:21.498847+0000","last_fullsized":"2024-01-18T00:48:21.498847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:34:46.908585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79513,"num_write":758,"num_write_kb":101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'185","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.730000+0000","last_change":"2024-01-17T23:00:18.507331+0000","last_active":"2024-01-18T00:48:33.730000+0000","last_peered":"2024-01-18T00:48:33.730000+0000","last_clean":"2024-01-18T00:48:33.730000+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-18T00:48:33.730000+0000","last_undegraded":"2024-01-18T00:48:33.730000+0000","last_fullsized":"2024-01-18T00:48:33.730000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'898","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:50.856896+0000","last_change":"2024-01-17T23:00:17.455671+0000","last_active":"2024-01-18T00:47:50.856896+0000","last_peered":"2024-01-18T00:47:50.856896+0000","last_clean":"2024-01-18T00:47:50.856896+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-18T00:47:50.856896+0000","last_undegraded":"2024-01-18T00:47:50.856896+0000","last_fullsized":"2024-01-18T00:47:50.856896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:48:55.693874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'794","reported_seq":897,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071253+0000","last_change":"2024-01-17T23:00:24.764965+0000","last_active":"2024-01-18T00:48:27.071253+0000","last_peered":"2024-01-18T00:48:27.071253+0000","last_clean":"2024-01-18T00:48:27.071253+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-18T00:48:27.071253+0000","last_undegraded":"2024-01-18T00:48:27.071253+0000","last_fullsized":"2024-01-18T00:48:27.071253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:55:37.704752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":97239,"num_write":779,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'235","reported_seq":299,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.730911+0000","last_change":"2024-01-17T23:00:18.502962+0000","last_active":"2024-01-18T00:48:33.730911+0000","last_peered":"2024-01-18T00:48:33.730911+0000","last_clean":"2024-01-18T00:48:33.730911+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-18T00:48:33.730911+0000","last_undegraded":"2024-01-18T00:48:33.730911+0000","last_fullsized":"2024-01-18T00:48:33.730911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:41:53.048398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'683","reported_seq":750,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:34.290269+0000","last_change":"2024-01-17T23:00:17.442109+0000","last_active":"2024-01-18T00:48:34.290269+0000","last_peered":"2024-01-18T00:48:34.290269+0000","last_clean":"2024-01-18T00:48:34.290269+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-18T00:48:34.290269+0000","last_undegraded":"2024-01-18T00:48:34.290269+0000","last_fullsized":"2024-01-18T00:48:34.290269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":8522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'857","reported_seq":994,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.240790+0000","last_change":"2024-01-17T23:00:24.770962+0000","last_active":"2024-01-18T00:48:27.240790+0000","last_peered":"2024-01-18T00:48:27.240790+0000","last_clean":"2024-01-18T00:48:27.240790+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-18T00:48:27.240790+0000","last_undegraded":"2024-01-18T00:48:27.240790+0000","last_fullsized":"2024-01-18T00:48:27.240790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":269459,"num_write":851,"num_write_kb":222567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'221","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.574309+0000","last_change":"2024-01-17T23:00:20.214719+0000","last_active":"2024-01-18T00:48:33.574309+0000","last_peered":"2024-01-18T00:48:33.574309+0000","last_clean":"2024-01-18T00:48:33.574309+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-18T00:48:33.574309+0000","last_undegraded":"2024-01-18T00:48:33.574309+0000","last_fullsized":"2024-01-18T00:48:33.574309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:10:44.788842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'61","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:37.846275+0000","last_change":"2024-01-17T23:00:17.372236+0000","last_active":"2024-01-18T00:47:37.846275+0000","last_peered":"2024-01-18T00:47:37.846275+0000","last_clean":"2024-01-18T00:47:37.846275+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-18T00:47:37.846275+0000","last_undegraded":"2024-01-18T00:47:37.846275+0000","last_fullsized":"2024-01-18T00:47:37.846275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:17:11.518196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'837","reported_seq":931,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.748071+0000","last_change":"2024-01-17T23:00:24.769010+0000","last_active":"2024-01-18T00:48:18.748071+0000","last_peered":"2024-01-18T00:48:18.748071+0000","last_clean":"2024-01-18T00:48:18.748071+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-18T00:48:18.748071+0000","last_undegraded":"2024-01-18T00:48:18.748071+0000","last_fullsized":"2024-01-18T00:48:18.748071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":113711,"num_write":815,"num_write_kb":156781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'196","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.730194+0000","last_change":"2024-01-17T23:00:18.503773+0000","last_active":"2024-01-18T00:48:33.730194+0000","last_peered":"2024-01-18T00:48:33.730194+0000","last_clean":"2024-01-18T00:48:33.730194+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-18T00:48:33.730194+0000","last_undegraded":"2024-01-18T00:48:33.730194+0000","last_fullsized":"2024-01-18T00:48:33.730194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":122,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.433017+0000","last_change":"2024-01-17T23:00:17.369249+0000","last_active":"2024-01-18T00:48:11.433017+0000","last_peered":"2024-01-18T00:48:11.433017+0000","last_clean":"2024-01-18T00:48:11.433017+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-18T00:48:11.433017+0000","last_undegraded":"2024-01-18T00:48:11.433017+0000","last_fullsized":"2024-01-18T00:48:11.433017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:59:12.031443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'693","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.043914+0000","last_change":"2024-01-17T23:00:24.768525+0000","last_active":"2024-01-18T00:48:27.043914+0000","last_peered":"2024-01-18T00:48:27.043914+0000","last_clean":"2024-01-18T00:48:27.043914+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-18T00:48:27.043914+0000","last_undegraded":"2024-01-18T00:48:27.043914+0000","last_fullsized":"2024-01-18T00:48:27.043914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":99783,"num_write":680,"num_write_kb":117554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'204","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.611047+0000","last_change":"2024-01-17T23:00:18.565228+0000","last_active":"2024-01-18T00:48:33.611047+0000","last_peered":"2024-01-18T00:48:33.611047+0000","last_clean":"2024-01-18T00:48:33.611047+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-18T00:48:33.611047+0000","last_undegraded":"2024-01-18T00:48:33.611047+0000","last_fullsized":"2024-01-18T00:48:33.611047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'386","reported_seq":461,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.078738+0000","last_change":"2024-01-18T00:48:40.078766+0000","last_active":"2024-01-18T00:48:40.078738+0000","last_peered":"2024-01-18T00:48:40.078738+0000","last_clean":"2024-01-18T00:48:40.078738+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-18T00:48:40.078738+0000","last_undegraded":"2024-01-18T00:48:40.078738+0000","last_fullsized":"2024-01-18T00:48:40.078738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'386","last_scrub_stamp":"2024-01-18T00:48:40.078681+0000","last_deep_scrub":"29'386","last_deep_scrub_stamp":"2024-01-18T00:48:40.078681+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.078681+0000","objects_scrubbed":6,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:22:31.242350+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":8330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'671","reported_seq":735,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.871825+0000","last_change":"2024-01-17T23:00:24.770444+0000","last_active":"2024-01-18T00:48:11.871825+0000","last_peered":"2024-01-18T00:48:11.871825+0000","last_clean":"2024-01-18T00:48:11.871825+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-18T00:48:11.871825+0000","last_undegraded":"2024-01-18T00:48:11.871825+0000","last_fullsized":"2024-01-18T00:48:11.871825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:14:08.094039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10831,"num_write":657,"num_write_kb":42746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.732636+0000","last_change":"2024-01-17T23:00:18.560210+0000","last_active":"2024-01-18T00:48:33.732636+0000","last_peered":"2024-01-18T00:48:33.732636+0000","last_clean":"2024-01-18T00:48:33.732636+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-18T00:48:33.732636+0000","last_undegraded":"2024-01-18T00:48:33.732636+0000","last_fullsized":"2024-01-18T00:48:33.732636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:10.574606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1378","reported_seq":1444,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.273547+0000","last_change":"2024-01-17T23:00:17.369921+0000","last_active":"2024-01-18T00:48:21.273547+0000","last_peered":"2024-01-18T00:48:21.273547+0000","last_clean":"2024-01-18T00:48:21.273547+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-18T00:48:21.273547+0000","last_undegraded":"2024-01-18T00:48:21.273547+0000","last_fullsized":"2024-01-18T00:48:21.273547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:17:40.573099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'774","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.471777+0000","last_change":"2024-01-17T23:00:34.689012+0000","last_active":"2024-01-18T00:48:27.471777+0000","last_peered":"2024-01-18T00:48:27.471777+0000","last_clean":"2024-01-18T00:48:27.471777+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-18T00:48:27.471777+0000","last_undegraded":"2024-01-18T00:48:27.471777+0000","last_fullsized":"2024-01-18T00:48:27.471777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:11:30.284290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":74308,"num_write":753,"num_write_kb":109365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"29'200","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.686608+0000","last_change":"2024-01-17T23:00:18.499532+0000","last_active":"2024-01-18T00:48:33.686608+0000","last_peered":"2024-01-18T00:48:33.686608+0000","last_clean":"2024-01-18T00:48:33.686608+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-18T00:48:33.686608+0000","last_undegraded":"2024-01-18T00:48:33.686608+0000","last_fullsized":"2024-01-18T00:48:33.686608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:54:25.985446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1524","reported_seq":1589,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:34.298484+0000","last_change":"2024-01-17T23:00:17.454836+0000","last_active":"2024-01-18T00:48:34.298484+0000","last_peered":"2024-01-18T00:48:34.298484+0000","last_clean":"2024-01-18T00:48:34.298484+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-18T00:48:34.298484+0000","last_undegraded":"2024-01-18T00:48:34.298484+0000","last_fullsized":"2024-01-18T00:48:34.298484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1524,"log_dups_size":0,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1467,"num_write_kb":5420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'735","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.071188+0000","last_change":"2024-01-17T23:00:24.765193+0000","last_active":"2024-01-18T00:48:27.071188+0000","last_peered":"2024-01-18T00:48:27.071188+0000","last_clean":"2024-01-18T00:48:27.071188+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-18T00:48:27.071188+0000","last_undegraded":"2024-01-18T00:48:27.071188+0000","last_fullsized":"2024-01-18T00:48:27.071188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:26:15.070369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70860,"num_write":724,"num_write_kb":90941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'207","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.573899+0000","last_change":"2024-01-17T23:00:18.561495+0000","last_active":"2024-01-18T00:48:33.573899+0000","last_peered":"2024-01-18T00:48:33.573899+0000","last_clean":"2024-01-18T00:48:33.573899+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-18T00:48:33.573899+0000","last_undegraded":"2024-01-18T00:48:33.573899+0000","last_fullsized":"2024-01-18T00:48:33.573899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'160","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:00.227109+0000","last_change":"2024-01-17T23:00:17.370233+0000","last_active":"2024-01-18T00:47:00.227109+0000","last_peered":"2024-01-18T00:47:00.227109+0000","last_clean":"2024-01-18T00:47:00.227109+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-18T00:47:00.227109+0000","last_undegraded":"2024-01-18T00:47:00.227109+0000","last_fullsized":"2024-01-18T00:47:00.227109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:14:02.172061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'831","reported_seq":928,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.465621+0000","last_change":"2024-01-17T23:00:24.774255+0000","last_active":"2024-01-18T00:48:27.465621+0000","last_peered":"2024-01-18T00:48:27.465621+0000","last_clean":"2024-01-18T00:48:27.465621+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-18T00:48:27.465621+0000","last_undegraded":"2024-01-18T00:48:27.465621+0000","last_fullsized":"2024-01-18T00:48:27.465621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":102827,"num_write":809,"num_write_kb":147366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'212","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.693072+0000","last_change":"2024-01-17T23:00:18.495701+0000","last_active":"2024-01-18T00:48:33.693072+0000","last_peered":"2024-01-18T00:48:33.693072+0000","last_clean":"2024-01-18T00:48:33.693072+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-18T00:48:33.693072+0000","last_undegraded":"2024-01-18T00:48:33.693072+0000","last_fullsized":"2024-01-18T00:48:33.693072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:44:46.123115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'43","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:56.007118+0000","last_change":"2024-01-17T23:00:17.374688+0000","last_active":"2024-01-18T00:47:56.007118+0000","last_peered":"2024-01-18T00:47:56.007118+0000","last_clean":"2024-01-18T00:47:56.007118+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-18T00:47:56.007118+0000","last_undegraded":"2024-01-18T00:47:56.007118+0000","last_fullsized":"2024-01-18T00:47:56.007118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:59:33.789276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'822","reported_seq":914,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.283132+0000","last_change":"2024-01-17T23:00:24.768315+0000","last_active":"2024-01-18T00:48:27.283132+0000","last_peered":"2024-01-18T00:48:27.283132+0000","last_clean":"2024-01-18T00:48:27.283132+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-18T00:48:27.283132+0000","last_undegraded":"2024-01-18T00:48:27.283132+0000","last_fullsized":"2024-01-18T00:48:27.283132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":80488,"num_write":796,"num_write_kb":101657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'736","reported_seq":828,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:21.061973+0000","last_change":"2024-01-17T23:00:24.778662+0000","last_active":"2024-01-18T00:48:21.061973+0000","last_peered":"2024-01-18T00:48:21.061973+0000","last_clean":"2024-01-18T00:48:21.061973+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-18T00:48:21.061973+0000","last_undegraded":"2024-01-18T00:48:21.061973+0000","last_fullsized":"2024-01-18T00:48:21.061973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":63205,"num_write":717,"num_write_kb":100634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'215","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.722630+0000","last_change":"2024-01-17T23:00:19.816516+0000","last_active":"2024-01-18T00:48:33.722630+0000","last_peered":"2024-01-18T00:48:33.722630+0000","last_clean":"2024-01-18T00:48:33.722630+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-18T00:48:33.722630+0000","last_undegraded":"2024-01-18T00:48:33.722630+0000","last_fullsized":"2024-01-18T00:48:33.722630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1198","reported_seq":1262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:46:37.788151+0000","last_change":"2024-01-17T23:00:17.367002+0000","last_active":"2024-01-18T00:46:37.788151+0000","last_peered":"2024-01-18T00:46:37.788151+0000","last_clean":"2024-01-18T00:46:37.788151+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-18T00:46:37.788151+0000","last_undegraded":"2024-01-18T00:46:37.788151+0000","last_fullsized":"2024-01-18T00:46:37.788151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:03:53.693810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'702","reported_seq":800,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:18.513650+0000","last_change":"2024-01-17T23:00:24.763261+0000","last_active":"2024-01-18T00:48:18.513650+0000","last_peered":"2024-01-18T00:48:18.513650+0000","last_clean":"2024-01-18T00:48:18.513650+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-18T00:48:18.513650+0000","last_undegraded":"2024-01-18T00:48:18.513650+0000","last_fullsized":"2024-01-18T00:48:18.513650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:54.734467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":94856,"num_write":687,"num_write_kb":72747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'234","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.703483+0000","last_change":"2024-01-17T23:00:20.213247+0000","last_active":"2024-01-18T00:48:33.703483+0000","last_peered":"2024-01-18T00:48:33.703483+0000","last_clean":"2024-01-18T00:48:33.703483+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-18T00:48:33.703483+0000","last_undegraded":"2024-01-18T00:48:33.703483+0000","last_fullsized":"2024-01-18T00:48:33.703483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'180","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:47:12.790342+0000","last_change":"2024-01-17T23:00:17.369139+0000","last_active":"2024-01-18T00:47:12.790342+0000","last_peered":"2024-01-18T00:47:12.790342+0000","last_clean":"2024-01-18T00:47:12.790342+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-18T00:47:12.790342+0000","last_undegraded":"2024-01-18T00:47:12.790342+0000","last_fullsized":"2024-01-18T00:47:12.790342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1537","reported_seq":1600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:36.295035+0000","last_change":"2024-01-17T23:00:17.370057+0000","last_active":"2024-01-18T00:48:36.295035+0000","last_peered":"2024-01-18T00:48:36.295035+0000","last_clean":"2024-01-18T00:48:36.295035+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-18T00:48:36.295035+0000","last_undegraded":"2024-01-18T00:48:36.295035+0000","last_fullsized":"2024-01-18T00:48:36.295035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":1537,"log_dups_size":0,"ondisk_log_size":1537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:40:34.725835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16109257,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":16502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'179","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.568524+0000","last_change":"2024-01-17T23:00:18.560879+0000","last_active":"2024-01-18T00:48:33.568524+0000","last_peered":"2024-01-18T00:48:33.568524+0000","last_clean":"2024-01-18T00:48:33.568524+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-18T00:48:33.568524+0000","last_undegraded":"2024-01-18T00:48:33.568524+0000","last_fullsized":"2024-01-18T00:48:33.568524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'748","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:11.828189+0000","last_change":"2024-01-17T23:00:34.461070+0000","last_active":"2024-01-18T00:48:11.828189+0000","last_peered":"2024-01-18T00:48:11.828189+0000","last_clean":"2024-01-18T00:48:11.828189+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-18T00:48:11.828189+0000","last_undegraded":"2024-01-18T00:48:11.828189+0000","last_fullsized":"2024-01-18T00:48:11.828189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":128829,"num_write":735,"num_write_kb":187979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'217","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.273957+0000","last_change":"2024-01-17T23:00:17.456823+0000","last_active":"2024-01-18T00:48:33.273957+0000","last_peered":"2024-01-18T00:48:33.273957+0000","last_clean":"2024-01-18T00:48:33.273957+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-18T00:48:33.273957+0000","last_undegraded":"2024-01-18T00:48:33.273957+0000","last_fullsized":"2024-01-18T00:48:33.273957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:15.973940+0000","last_clean_scrub_stamp":"2024-01-17T23:00:15.973940+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'196","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.686612+0000","last_change":"2024-01-17T23:00:18.358957+0000","last_active":"2024-01-18T00:48:33.686612+0000","last_peered":"2024-01-18T00:48:33.686612+0000","last_clean":"2024-01-18T00:48:33.686612+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-18T00:48:33.686612+0000","last_undegraded":"2024-01-18T00:48:33.686612+0000","last_fullsized":"2024-01-18T00:48:33.686612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:48:23.951029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'730","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:27.120949+0000","last_change":"2024-01-17T23:00:24.774088+0000","last_active":"2024-01-18T00:48:27.120949+0000","last_peered":"2024-01-18T00:48:27.120949+0000","last_clean":"2024-01-18T00:48:27.120949+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-18T00:48:27.120949+0000","last_undegraded":"2024-01-18T00:48:27.120949+0000","last_fullsized":"2024-01-18T00:48:27.120949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:23.292558+0000","last_clean_scrub_stamp":"2024-01-17T23:00:23.292558+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":53396,"num_write":716,"num_write_kb":86798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'217","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.578900+0000","last_change":"2024-01-17T23:00:20.215376+0000","last_active":"2024-01-18T00:48:33.578900+0000","last_peered":"2024-01-18T00:48:33.578900+0000","last_clean":"2024-01-18T00:48:33.578900+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-18T00:48:33.578900+0000","last_undegraded":"2024-01-18T00:48:33.578900+0000","last_fullsized":"2024-01-18T00:48:33.578900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:32:12.356027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'221","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.474240+0000","last_change":"2024-01-17T23:00:18.486099+0000","last_active":"2024-01-18T00:48:40.474240+0000","last_peered":"2024-01-18T00:48:40.474240+0000","last_clean":"2024-01-18T00:48:40.474240+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-18T00:48:40.474240+0000","last_undegraded":"2024-01-18T00:48:40.474240+0000","last_fullsized":"2024-01-18T00:48:40.474240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'227","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.694001+0000","last_change":"2024-01-17T23:00:18.563545+0000","last_active":"2024-01-18T00:48:33.694001+0000","last_peered":"2024-01-18T00:48:33.694001+0000","last_clean":"2024-01-18T00:48:33.694001+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-18T00:48:33.694001+0000","last_undegraded":"2024-01-18T00:48:33.694001+0000","last_fullsized":"2024-01-18T00:48:33.694001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:24:42.735123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'198","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.611063+0000","last_change":"2024-01-17T23:00:18.558716+0000","last_active":"2024-01-18T00:48:33.611063+0000","last_peered":"2024-01-18T00:48:33.611063+0000","last_clean":"2024-01-18T00:48:33.611063+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-18T00:48:33.611063+0000","last_undegraded":"2024-01-18T00:48:33.611063+0000","last_fullsized":"2024-01-18T00:48:33.611063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'184","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.725084+0000","last_change":"2024-01-17T23:00:34.116804+0000","last_active":"2024-01-18T00:48:33.725084+0000","last_peered":"2024-01-18T00:48:33.725084+0000","last_clean":"2024-01-18T00:48:33.725084+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-18T00:48:33.725084+0000","last_undegraded":"2024-01-18T00:48:33.725084+0000","last_fullsized":"2024-01-18T00:48:33.725084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'201","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.874562+0000","last_change":"2024-01-17T23:00:19.816646+0000","last_active":"2024-01-18T00:48:37.874562+0000","last_peered":"2024-01-18T00:48:37.874562+0000","last_clean":"2024-01-18T00:48:37.874562+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-18T00:48:37.874562+0000","last_undegraded":"2024-01-18T00:48:37.874562+0000","last_fullsized":"2024-01-18T00:48:37.874562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'239","reported_seq":307,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.573540+0000","last_change":"2024-01-17T23:00:20.245391+0000","last_active":"2024-01-18T00:48:33.573540+0000","last_peered":"2024-01-18T00:48:33.573540+0000","last_clean":"2024-01-18T00:48:33.573540+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-18T00:48:33.573540+0000","last_undegraded":"2024-01-18T00:48:33.573540+0000","last_fullsized":"2024-01-18T00:48:33.573540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'202","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.799702+0000","last_change":"2024-01-17T23:00:19.908996+0000","last_active":"2024-01-18T00:48:37.799702+0000","last_peered":"2024-01-18T00:48:37.799702+0000","last_clean":"2024-01-18T00:48:37.799702+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-18T00:48:37.799702+0000","last_undegraded":"2024-01-18T00:48:37.799702+0000","last_fullsized":"2024-01-18T00:48:37.799702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'211","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.527708+0000","last_change":"2024-01-17T23:00:34.196932+0000","last_active":"2024-01-18T00:48:33.527708+0000","last_peered":"2024-01-18T00:48:33.527708+0000","last_clean":"2024-01-18T00:48:33.527708+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-18T00:48:33.527708+0000","last_undegraded":"2024-01-18T00:48:33.527708+0000","last_fullsized":"2024-01-18T00:48:33.527708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"29'200","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.700646+0000","last_change":"2024-01-17T23:00:19.910218+0000","last_active":"2024-01-18T00:48:33.700646+0000","last_peered":"2024-01-18T00:48:33.700646+0000","last_clean":"2024-01-18T00:48:33.700646+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-18T00:48:33.700646+0000","last_undegraded":"2024-01-18T00:48:33.700646+0000","last_fullsized":"2024-01-18T00:48:33.700646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'201","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.691049+0000","last_change":"2024-01-17T23:00:18.493837+0000","last_active":"2024-01-18T00:48:33.691049+0000","last_peered":"2024-01-18T00:48:33.691049+0000","last_clean":"2024-01-18T00:48:33.691049+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-18T00:48:33.691049+0000","last_undegraded":"2024-01-18T00:48:33.691049+0000","last_fullsized":"2024-01-18T00:48:33.691049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-18T23:35:13.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'202","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.609216+0000","last_change":"2024-01-17T23:00:18.559511+0000","last_active":"2024-01-18T00:48:33.609216+0000","last_peered":"2024-01-18T00:48:33.609216+0000","last_clean":"2024-01-18T00:48:33.609216+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-18T00:48:33.609216+0000","last_undegraded":"2024-01-18T00:48:33.609216+0000","last_fullsized":"2024-01-18T00:48:33.609216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'225","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.572321+0000","last_change":"2024-01-17T23:00:19.915593+0000","last_active":"2024-01-18T00:48:33.572321+0000","last_peered":"2024-01-18T00:48:33.572321+0000","last_clean":"2024-01-18T00:48:33.572321+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-18T00:48:33.572321+0000","last_undegraded":"2024-01-18T00:48:33.572321+0000","last_fullsized":"2024-01-18T00:48:33.572321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'206","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.730878+0000","last_change":"2024-01-17T23:00:18.502827+0000","last_active":"2024-01-18T00:48:33.730878+0000","last_peered":"2024-01-18T00:48:33.730878+0000","last_clean":"2024-01-18T00:48:33.730878+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-18T00:48:33.730878+0000","last_undegraded":"2024-01-18T00:48:33.730878+0000","last_fullsized":"2024-01-18T00:48:33.730878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:57:48.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'196","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.529532+0000","last_change":"2024-01-17T23:00:18.561153+0000","last_active":"2024-01-18T00:48:33.529532+0000","last_peered":"2024-01-18T00:48:33.529532+0000","last_clean":"2024-01-18T00:48:33.529532+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-18T00:48:33.529532+0000","last_undegraded":"2024-01-18T00:48:33.529532+0000","last_fullsized":"2024-01-18T00:48:33.529532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'207","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.690072+0000","last_change":"2024-01-17T23:00:18.499096+0000","last_active":"2024-01-18T00:48:33.690072+0000","last_peered":"2024-01-18T00:48:33.690072+0000","last_clean":"2024-01-18T00:48:33.690072+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-18T00:48:33.690072+0000","last_undegraded":"2024-01-18T00:48:33.690072+0000","last_fullsized":"2024-01-18T00:48:33.690072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:16:21.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'213","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.691616+0000","last_change":"2024-01-17T23:00:18.559016+0000","last_active":"2024-01-18T00:48:33.691616+0000","last_peered":"2024-01-18T00:48:33.691616+0000","last_clean":"2024-01-18T00:48:33.691616+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-18T00:48:33.691616+0000","last_undegraded":"2024-01-18T00:48:33.691616+0000","last_fullsized":"2024-01-18T00:48:33.691616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:10:41.973018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'214","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.729367+0000","last_change":"2024-01-17T23:00:19.911487+0000","last_active":"2024-01-18T00:48:33.729367+0000","last_peered":"2024-01-18T00:48:33.729367+0000","last_clean":"2024-01-18T00:48:33.729367+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-18T00:48:33.729367+0000","last_undegraded":"2024-01-18T00:48:33.729367+0000","last_fullsized":"2024-01-18T00:48:33.729367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'216","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.610990+0000","last_change":"2024-01-17T23:00:18.560249+0000","last_active":"2024-01-18T00:48:33.610990+0000","last_peered":"2024-01-18T00:48:33.610990+0000","last_clean":"2024-01-18T00:48:33.610990+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-18T00:48:33.610990+0000","last_undegraded":"2024-01-18T00:48:33.610990+0000","last_fullsized":"2024-01-18T00:48:33.610990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'201","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.703931+0000","last_change":"2024-01-17T23:00:19.747509+0000","last_active":"2024-01-18T00:48:33.703931+0000","last_peered":"2024-01-18T00:48:33.703931+0000","last_clean":"2024-01-18T00:48:33.703931+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-18T00:48:33.703931+0000","last_undegraded":"2024-01-18T00:48:33.703931+0000","last_fullsized":"2024-01-18T00:48:33.703931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'175","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.684820+0000","last_change":"2024-01-17T23:00:18.560727+0000","last_active":"2024-01-18T00:48:33.684820+0000","last_peered":"2024-01-18T00:48:33.684820+0000","last_clean":"2024-01-18T00:48:33.684820+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-18T00:48:33.684820+0000","last_undegraded":"2024-01-18T00:48:33.684820+0000","last_fullsized":"2024-01-18T00:48:33.684820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:39:58.130487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'174","reported_seq":236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.574569+0000","last_change":"2024-01-17T23:00:19.749934+0000","last_active":"2024-01-18T00:48:33.574569+0000","last_peered":"2024-01-18T00:48:33.574569+0000","last_clean":"2024-01-18T00:48:33.574569+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-18T00:48:33.574569+0000","last_undegraded":"2024-01-18T00:48:33.574569+0000","last_fullsized":"2024-01-18T00:48:33.574569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:54:33.609718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'211","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.576131+0000","last_change":"2024-01-17T23:00:19.748725+0000","last_active":"2024-01-18T00:48:33.576131+0000","last_peered":"2024-01-18T00:48:33.576131+0000","last_clean":"2024-01-18T00:48:33.576131+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-18T00:48:33.576131+0000","last_undegraded":"2024-01-18T00:48:33.576131+0000","last_fullsized":"2024-01-18T00:48:33.576131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:18.586850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'219","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.735477+0000","last_change":"2024-01-17T23:00:18.505110+0000","last_active":"2024-01-18T00:48:33.735477+0000","last_peered":"2024-01-18T00:48:33.735477+0000","last_clean":"2024-01-18T00:48:33.735477+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-18T00:48:33.735477+0000","last_undegraded":"2024-01-18T00:48:33.735477+0000","last_fullsized":"2024-01-18T00:48:33.735477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:17:16.205530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'198","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.704499+0000","last_change":"2024-01-17T23:00:19.654324+0000","last_active":"2024-01-18T00:48:33.704499+0000","last_peered":"2024-01-18T00:48:33.704499+0000","last_clean":"2024-01-18T00:48:33.704499+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-18T00:48:33.704499+0000","last_undegraded":"2024-01-18T00:48:33.704499+0000","last_fullsized":"2024-01-18T00:48:33.704499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'203","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.517510+0000","last_change":"2024-01-17T23:00:34.459845+0000","last_active":"2024-01-18T00:48:33.517510+0000","last_peered":"2024-01-18T00:48:33.517510+0000","last_clean":"2024-01-18T00:48:33.517510+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-18T00:48:33.517510+0000","last_undegraded":"2024-01-18T00:48:33.517510+0000","last_fullsized":"2024-01-18T00:48:33.517510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"29'195","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.530177+0000","last_change":"2024-01-17T23:00:34.458704+0000","last_active":"2024-01-18T00:48:33.530177+0000","last_peered":"2024-01-18T00:48:33.530177+0000","last_clean":"2024-01-18T00:48:33.530177+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-18T00:48:33.530177+0000","last_undegraded":"2024-01-18T00:48:33.530177+0000","last_fullsized":"2024-01-18T00:48:33.530177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'207","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.730868+0000","last_change":"2024-01-17T23:00:18.502669+0000","last_active":"2024-01-18T00:48:33.730868+0000","last_peered":"2024-01-18T00:48:33.730868+0000","last_clean":"2024-01-18T00:48:33.730868+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-18T00:48:33.730868+0000","last_undegraded":"2024-01-18T00:48:33.730868+0000","last_fullsized":"2024-01-18T00:48:33.730868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:26:17.271875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'198","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.703854+0000","last_change":"2024-01-17T23:00:18.564370+0000","last_active":"2024-01-18T00:48:33.703854+0000","last_peered":"2024-01-18T00:48:33.703854+0000","last_clean":"2024-01-18T00:48:33.703854+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-18T00:48:33.703854+0000","last_undegraded":"2024-01-18T00:48:33.703854+0000","last_fullsized":"2024-01-18T00:48:33.703854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:16:45.240047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'195","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.016524+0000","last_change":"2024-01-18T00:48:42.016546+0000","last_active":"2024-01-18T00:48:42.016524+0000","last_peered":"2024-01-18T00:48:42.016524+0000","last_clean":"2024-01-18T00:48:42.016524+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-18T00:48:42.016524+0000","last_undegraded":"2024-01-18T00:48:42.016524+0000","last_fullsized":"2024-01-18T00:48:42.016524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-01-18T00:48:42.016460+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-01-18T00:48:42.016460+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.016460+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:51:15.773297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'200","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:37.874577+0000","last_change":"2024-01-17T23:00:20.211951+0000","last_active":"2024-01-18T00:48:37.874577+0000","last_peered":"2024-01-18T00:48:37.874577+0000","last_clean":"2024-01-18T00:48:37.874577+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-18T00:48:37.874577+0000","last_undegraded":"2024-01-18T00:48:37.874577+0000","last_fullsized":"2024-01-18T00:48:37.874577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'204","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:33.738037+0000","last_change":"2024-01-17T23:00:18.563220+0000","last_active":"2024-01-18T00:48:33.738037+0000","last_peered":"2024-01-18T00:48:33.738037+0000","last_clean":"2024-01-18T00:48:33.738037+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-18T00:48:33.738037+0000","last_undegraded":"2024-01-18T00:48:33.738037+0000","last_fullsized":"2024-01-18T00:48:33.738037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-17T23:00:17.188661+0000","last_clean_scrub_stamp":"2024-01-17T23:00:17.188661+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:54.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":3686645,"num_write":24416,"num_write_kb":4363145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24890,"ondisk_log_size":24890,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13124,"ondisk_log_size":13124,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198027587,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1786,"num_read_kb":2854,"num_write":22123,"num_write_kb":206009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180731904,"data_stored":396055174,"data_compressed":51429318,"data_compressed_allocated":69492736,"data_compressed_original":284966912,"omap_allocated":0,"internal_metadata":0},"log_size":21705,"ondisk_log_size":21705,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62450,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510750,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139320,"kb_used_data":31856,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94232520,"statfs":{"total":96636764160,"available":96494100480,"internally_reserved":0,"allocated":32620544,"data_stored":76215532,"data_compressed":10068524,"data_compressed_allocated":13414400,"data_compressed_original":57212928,"omap_allocated":1590,"internal_metadata":110033354},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.89000000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35399999999999998},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84999999999999998,"15min":0.85499999999999998},"min":{"1min":0.59599999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3260000000000001,"5min":1.377,"15min":1.377},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.34599999999999997},"max":{"1min":1.508,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.61899999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.306,"5min":1.468,"15min":1.4830000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.86499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":1.2410000000000001,"15min":1.3120000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.997,"15min":0.97599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45900000000000002},"max":{"1min":1.389,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93100000000000005,"15min":0.92900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.44900000000000001},"max":{"1min":1.304,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.0669999999999999,"15min":1.0409999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.639,"5min":1.996,"15min":1.996},"last":1.091}]},{"osd":4,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.99399999999999999,"15min":0.98199999999999998},"min":{"1min":0.59099999999999997,"5min":0.52300000000000002,"15min":0.41499999999999998},"max":{"1min":1.54,"5min":1.7470000000000001,"15min":1.77},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.0269999999999999},"min":{"1min":0.77400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.415,"5min":1.5489999999999999,"15min":1.6499999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.161,"15min":1.109},"min":{"1min":0.70999999999999996,"5min":0.59499999999999997,"15min":0.44700000000000001},"max":{"1min":1.702,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.145,"15min":1.111},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.41899999999999998},"max":{"1min":1.7929999999999999,"5min":1.8500000000000001,"15min":1.994},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.157,"15min":1.161},"min":{"1min":0.64500000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.891},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.161,"15min":1.1559999999999999},"min":{"1min":0.72299999999999998,"5min":0.66400000000000003,"15min":0.44900000000000001},"max":{"1min":1.488,"5min":1.6739999999999999,"15min":1.746},"last":1.1220000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510751,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138804,"kb_used_data":23020,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94233036,"statfs":{"total":96636764160,"available":96494628864,"internally_reserved":0,"allocated":23572480,"data_stored":53985719,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":1594,"internal_metadata":118553030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.36299999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.427},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.41199999999999998},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.6379999999999999},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.86499999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47699999999999998},"max":{"1min":1.264,"5min":1.357,"15min":1.607},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.40899999999999997},"max":{"1min":1.3600000000000001,"5min":1.466,"15min":1.466},"last":1.169}]},{"osd":2,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.501},"max":{"1min":1.272,"5min":1.756,"15min":1.756},"last":1.087},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0049999999999999,"15min":1.0409999999999999},"min":{"1min":0.66400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.4209999999999998},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.53400000000000003},"max":{"1min":1.347,"5min":1.347,"15min":2.3180000000000001},"last":1.026},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4359999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2989999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0900000000000001,"15min":1.0469999999999999},"min":{"1min":0.53800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4770000000000001,"5min":1.964,"15min":1.964},"last":1.391},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.40799999999999997},"max":{"1min":1.353,"5min":2.1339999999999999,"15min":2.3439999999999999},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0489999999999999,"15min":1.0669999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.3879999999999999,"5min":1.585,"15min":2.4849999999999999},"last":1.254},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":1.161},"min":{"1min":0.82899999999999996,"5min":0.56200000000000006,"15min":0.55700000000000005},"max":{"1min":1.6100000000000001,"5min":2.0609999999999999,"15min":2.1400000000000001},"last":1.53}]},{"osd":7,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.099},"min":{"1min":0.66400000000000003,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":1.7430000000000001,"5min":1.837,"15min":1.8959999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.2030000000000001},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.41799999999999998},"max":{"1min":1.831,"5min":1.8819999999999999,"15min":2.5979999999999999},"last":1.454}]}]},{"osd":5,"up_from":15,"seq":64424510751,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123756,"kb_used_data":20452,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94248084,"statfs":{"total":96636764160,"available":96510038016,"internally_reserved":0,"allocated":20942848,"data_stored":42070399,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":1.4379999999999999,"5min":1.482,"15min":1.482},"last":1.101}]},{"osd":1,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88,"15min":0.85899999999999999},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.1950000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.95299999999999996,"15min":0.92800000000000005},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.629,"5min":0.495,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.502,"15min":1.5429999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.93100000000000005,"15min":0.91900000000000004},"min":{"1min":0.62,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3959999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.002,"15min":1.002},"min":{"1min":0.67200000000000004,"5min":0.56799999999999995,"15min":0.51900000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0580000000000001,"15min":1.0369999999999999},"min":{"1min":0.75700000000000001,"5min":0.63400000000000001,"15min":0.624},"max":{"1min":1.556,"5min":1.5620000000000001,"15min":1.6679999999999999},"last":1.0489999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0269999999999999,"15min":0.997},"min":{"1min":0.64100000000000001,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.5129999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.085,"15min":1.101},"min":{"1min":0.52500000000000002,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.125}]},{"osd":6,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1080000000000001,"15min":1.119},"min":{"1min":0.68799999999999994,"5min":0.53400000000000003,"15min":0.51700000000000002},"max":{"1min":1.536,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.133,"15min":1.123},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.39000000000000001},"max":{"1min":1.609,"5min":2.032,"15min":2.032},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2150000000000001,"15min":1.2030000000000001},"min":{"1min":0.93100000000000005,"5min":0.58699999999999997,"15min":0.35099999999999998},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.177},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.86599999999999999,"5min":0.61399999999999999,"15min":0.56599999999999995},"max":{"1min":1.657,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1950000000000001}]}]},{"osd":3,"up_from":15,"seq":64424510751,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142796,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94229044,"statfs":{"total":96636764160,"available":96490541056,"internally_reserved":0,"allocated":21958656,"data_stored":43628986,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":0.78300000000000003,"15min":0.94199999999999995},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83799999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34399999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.498},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.91100000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.587},"last":0.628},{"interface":"front","average":{"1min":0.877,"5min":0.82499999999999996,"15min":0.80000000000000004},"min":{"1min":0.72499999999999998,"5min":0.52700000000000002,"15min":0.48999999999999999},"max":{"1min":1.1399999999999999,"5min":1.296,"15min":1.296},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.48099999999999998},"max":{"1min":1.141,"5min":1.2789999999999999,"15min":1.3080000000000001},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.46999999999999997},"max":{"1min":1.028,"5min":1.1599999999999999,"15min":1.1879999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.22,"15min":1.3109999999999999},"last":0.752}]},{"osd":7,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.497},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.5620000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85499999999999998,"15min":0.85799999999999998},"min":{"1min":0.69899999999999995,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.256},"last":0.98899999999999999}]}]},{"osd":1,"up_from":15,"seq":64424510753,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141028,"kb_used_data":23836,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94230812,"statfs":{"total":96636764160,"available":96492351488,"internally_reserved":0,"allocated":24408064,"data_stored":54652877,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.439},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":1.2749999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":1.0329999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.83799999999999997},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":1.375},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.075},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.63100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.1759999999999999,"15min":1.3220000000000001},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.2629999999999999,"15min":1.5660000000000001},"last":1.272},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.2190000000000001,"15min":1.222},"last":1.044}]},{"osd":6,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1839999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.111},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.83299999999999996},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.497},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.202,"5min":1.298,"15min":1.4239999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.69699999999999995,"5min":0.59699999999999998,"15min":0.53200000000000003},"max":{"1min":1.0660000000000001,"5min":1.339,"15min":1.341},"last":0.94499999999999995}]}]},{"osd":0,"up_from":15,"seq":64424510751,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108120,"kb_used_data":18704,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263720,"statfs":{"total":96636764160,"available":96526049280,"internally_reserved":0,"allocated":19152896,"data_stored":46854353,"data_compressed":6403410,"data_compressed_allocated":8425472,"data_compressed_original":36327424,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.28899999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.79400000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48599999999999999,"15min":0.495},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70899999999999996,"5min":0.752,"15min":1.0369999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51000000000000001,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.79500000000000004,"15min":0.81599999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.44,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":1.2350000000000001},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":1.1759999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.77300000000000002,"5min":0.90100000000000002,"15min":0.93300000000000005},"last":0.496}]},{"osd":4,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.44600000000000001},"max":{"1min":0.96699999999999997,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.56499999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.133,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":1.01,"5min":1.083,"15min":1.2869999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":1.1619999999999999,"5min":1.335,"15min":1.335},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.80400000000000005,"15min":0.82999999999999996},"min":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.52100000000000002},"max":{"1min":1.1619999999999999,"5min":1.377,"15min":1.5649999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.69999999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0349999999999999,"5min":1.2190000000000001,"15min":1.266},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 18 00:47:57 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85799999999999998,"15min":0.85499999999999998},"min":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1659999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.72099999999999997,"5min":0.58599999999999997,"15min":0.50600000000000001},"max":{"1min":1.3859999999999999,"5min":1.411,"15min":1.411},"last":0.98899999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543456,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139428,"kb_used_data":27804,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94232412,"statfs":{"total":96636764160,"available":96493989888,"internally_reserved":0,"allocated":28471296,"data_stored":58179387,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.86799999999999999,"15min":0.874},"min":{"1min":0.503,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.286,"5min":1.488,"15min":1.488},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93600000000000005,"15min":0.91700000000000004},"min":{"1min":0.55700000000000005,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.363,"5min":1.506,"15min":1.506},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0049999999999999,"15min":0.95999999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44600000000000001},"max":{"1min":1.3660000000000001,"5min":1.522,"15min":1.5329999999999999},"last":0.752},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.88800000000000001,"15min":0.872},"min":{"1min":0.42799999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2290000000000001,"5min":1.6200000000000001,"15min":1.7589999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.54800000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.353,"5min":1.5429999999999999,"15min":1.587},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0629999999999999,"15min":1.018},"min":{"1min":0.65200000000000002,"5min":0.56699999999999995,"15min":0.52500000000000002},"max":{"1min":1.2549999999999999,"5min":1.5940000000000001,"15min":1.639},"last":0.871}]},{"osd":3,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.405,"5min":1.423,"15min":1.8240000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.044,"15min":1.03},"min":{"1min":0.70899999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.423,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.0569999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46700000000000003},"max":{"1min":1.476,"5min":1.76,"15min":1.76},"last":1.093},{"interface":"front","average":{"1min":1.022,"5min":1.0649999999999999,"15min":1.042},"min":{"1min":0.68899999999999995,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":1.7849999999999999,"5min":1.8240000000000001,"15min":2.1960000000000002},"last":1.119}]},{"osd":6,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.7210000000000001,"5min":1.992,"15min":1.992},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.206,"15min":1.1879999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":1.631,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.542}]},{"osd":7,"last update":"Thu Jan 18 00:47:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1439999999999999,"15min":1.137},"min":{"1min":0.627,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8580000000000001,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.212},{"interface":"front","average":{"1min":1.266,"5min":1.224,"15min":1.2270000000000001},"min":{"1min":0.80400000000000005,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.5089999999999999,"5min":1.9279999999999999,"15min":2.0110000000000001},"last":1.1579999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543455,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79108,"kb_used_data":11900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94292732,"statfs":{"total":96636764160,"available":96555757568,"internally_reserved":0,"allocated":12185600,"data_stored":22656505,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":0.877},"last":0.438}]},{"osd":1,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.76300000000000001,"15min":0.82399999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.87},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.052,"5min":1.359,"15min":1.359},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.46300000000000002},"max":{"1min":0.96799999999999997,"5min":1.0900000000000001,"15min":1.3140000000000001},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":1.087,"5min":1.3100000000000001,"15min":1.3420000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.81899999999999995},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.998,"5min":1.196,"15min":1.3480000000000001},"last":1.069}]},{"osd":6,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.52500000000000002},"max":{"1min":1.079,"5min":1.254,"15min":1.476},"last":1.121},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.56399999999999995,"15min":0.45100000000000001},"max":{"1min":1,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.016}]},{"osd":7,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86099999999999999,"15min":0.85999999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.48299999999999998},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.085}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18784256,"data_stored":46138004,"data_compressed":6372185,"data_compressed_allocated":8384512,"data_compressed_original":35753984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24100864,"data_stored":54526896,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":22530524,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":43503005,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28164096,"data_stored":58053406,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":41944418,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23265280,"data_stored":53859738,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":75499183,"data_compressed":10037299,"data_compressed_allocated":13373440,"data_compressed_original":56639488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:48:46.159 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.159 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.159 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.159 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.160 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.161 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.162 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.163 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-17T22:59:42.792711+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=22, tm_min=59, tm_sec=42, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.164 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.165 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.166 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.167 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-17T23:00:15.973940+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=15, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.168 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-17T23:00:23.292558+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=23, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.169 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.170 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.171 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.172 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.172 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.172 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-17T23:00:17.188661+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=17, tm_hour=23, tm_min=0, tm_sec=17, tm_wday=2, tm_yday=17, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=18, tm_hour=0, tm_min=48, tm_sec=36, tm_wday=3, tm_yday=18, tm_isdst=0) 2024-01-18T00:48:46.172 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-18T00:49:03.166 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:49:51.385 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.171 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:49:51.390 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.207 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:49:51.518 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.209 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:49:51.519 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.212 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:49:51.522 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.216 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:49:51.527 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.253 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:49:51.472 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.388 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:49:51.698 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:03.390 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:49:51.701 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:06.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-18T00:49:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 Processor -- start 2024-01-18T00:49:06.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 -- start start 2024-01-18T00:49:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20941517e0 0x7f20940c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2094157c30 0x7f20940cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20940c2540 con 0x7f20940cce40 2024-01-18T00:49:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940c30c0 con 0x7f2094157c30 2024-01-18T00:49:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f209b400640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2094158320 con 0x7f20941517e0 2024-01-18T00:49:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f2099400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2094157c30 0x7f20940cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f2099400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2094157c30 0x7f20940cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42644/0 (socket says 172.21.15.67:42644) 2024-01-18T00:49:06.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.312+0000 7f2099400640 1 -- 172.21.15.67:0/2401361493 learned_addr learned my addr 172.21.15.67:0/2401361493 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:06.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.316+0000 7f2098a00640 1 --2- 172.21.15.67:0/2401361493 >> v2:172.21.15.137:3300/0 conn(0x7f20941517e0 0x7f20940c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.316+0000 7f2099400640 1 -- 172.21.15.67:0/2401361493 >> v2:172.21.15.137:3300/0 conn(0x7f20941517e0 msgr2=0x7f20940c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.316+0000 7f2099400640 1 --2- 172.21.15.67:0/2401361493 >> v2:172.21.15.137:3300/0 conn(0x7f20941517e0 0x7f20940c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.316+0000 7f2099400640 1 -- 172.21.15.67:0/2401361493 >> v1:172.21.15.137:6789/0 conn(0x7f20940cce40 legacy=0x7f2094157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.316+0000 7f2099400640 1 -- 172.21.15.67:0/2401361493 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20940c2790 con 0x7f2094157c30 2024-01-18T00:49:06.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.320+0000 7f2099400640 1 --2- 172.21.15.67:0/2401361493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094157c30 0x7f20940cd260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f20940c7a40 tx=0x7f208c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f724c49344e93f server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:06.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f2093400640 1 -- 172.21.15.67:0/2401361493 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0af400 con 0x7f2094157c30 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f2093400640 1 -- 172.21.15.67:0/2401361493 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0ab050 con 0x7f2094157c30 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f2093400640 1 -- 172.21.15.67:0/2401361493 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0af780 con 0x7f2094157c30 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 -- 172.21.15.67:0/2401361493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094157c30 msgr2=0x7f20940cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 --2- 172.21.15.67:0/2401361493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094157c30 0x7f20940cd260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f20940c7a40 tx=0x7f208c01f1c0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 -- 172.21.15.67:0/2401361493 shutdown_connections 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 --2- 172.21.15.67:0/2401361493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2094157c30 0x7f20940cd260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 --2- 172.21.15.67:0/2401361493 >> v2:172.21.15.137:3300/0 conn(0x7f20941517e0 0x7f20940c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 -- 172.21.15.67:0/2401361493 >> 172.21.15.67:0/2401361493 conn(0x7f2094061100 msgr2=0x7f2094061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:06.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 -- 172.21.15.67:0/2401361493 shutdown_connections 2024-01-18T00:49:06.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.324+0000 7f209b400640 1 -- 172.21.15.67:0/2401361493 wait complete. 2024-01-18T00:49:06.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 Processor -- start 2024-01-18T00:49:06.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 -- start start 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20941517e0 0x7f20940b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2094157c30 0x7f2094146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20941ef1b0 con 0x7f20940cce40 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209414c4e0 con 0x7f20941517e0 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f209b400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209414c780 con 0x7f2094157c30 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f2098a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f2098a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42648/0 (socket says 172.21.15.67:42648) 2024-01-18T00:49:06.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f2098a00640 1 -- 172.21.15.67:0/2868552340 learned_addr learned my addr 172.21.15.67:0/2868552340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:06.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f2093e00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20941517e0 0x7f20940b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.328+0000 7f2099400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2094157c30 0x7f2094146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.332+0000 7f2098a00640 1 -- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2094157c30 msgr2=0x7f2094146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.332+0000 7f2098a00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2094157c30 0x7f2094146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.332+0000 7f2098a00640 1 -- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20941517e0 msgr2=0x7f20940b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.332+0000 7f2098a00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20941517e0 0x7f20940b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.332+0000 7f2098a00640 1 -- 172.21.15.67:0/2868552340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009b30 con 0x7f20940cce40 2024-01-18T00:49:06.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.336+0000 7f2098a00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f208400c7f0 tx=0x7f208400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:06.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084004220 con 0x7f20940cce40 2024-01-18T00:49:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20840043a0 con 0x7f20940cce40 2024-01-18T00:49:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084004510 con 0x7f20940cce40 2024-01-18T00:49:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209414ca60 con 0x7f20940cce40 2024-01-18T00:49:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20941e4860 con 0x7f20940cce40 2024-01-18T00:49:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.340+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2094067c90 con 0x7f20940cce40 2024-01-18T00:49:06.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.360+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f2084003a70 con 0x7f20940cce40 2024-01-18T00:49:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.360+0000 7f2090c00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 0x7f206c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.360+0000 7f2093e00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 0x7f206c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.364+0000 7f2093e00640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 0x7f206c068d50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f209415b980 tx=0x7f207c009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.364+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2084055410 con 0x7f20940cce40 2024-01-18T00:49:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.604+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f2084051750 con 0x7f20940cce40 2024-01-18T00:49:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.780+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 --> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20940ccb00 con 0x7f206c066890 2024-01-18T00:49:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.808+0000 7f2090c00640 1 -- 172.21.15.67:0/2868552340 <== mgr.4116 v2:172.21.15.137:6800/942351233 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372161 (secure 0 0 0) 0x7f20940ccb00 con 0x7f206c066890 2024-01-18T00:49:06.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:49:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 msgr2=0x7f206c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 0x7f206c068d50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f209415b980 tx=0x7f207c009040 comp rx=0 tx=0).stop 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 msgr2=0x7f2094147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f208400c7f0 tx=0x7f208400ccb0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 shutdown_connections 2024-01-18T00:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f206c066890 0x7f206c068d50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f2094157c30 0x7f2094146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20941517e0 0x7f20940b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 --2- 172.21.15.67:0/2868552340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20940cce40 0x7f2094147690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.812+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 >> 172.21.15.67:0/2868552340 conn(0x7f2094061100 msgr2=0x7f2094150060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.816+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 shutdown_connections 2024-01-18T00:49:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:06.816+0000 7f209b400640 1 -- 172.21.15.67:0/2868552340 wait complete. 2024-01-18T00:49:06.839 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":3305,"stamp":"2024-01-18T00:49:06.756274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":198617955,"num_objects":109,"num_object_clones":0,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":3114,"num_read_kb":3689626,"num_write":46748,"num_write_kb":4572616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59959,"ondisk_log_size":59959,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1016520,"kb_used_data":179016,"kb_used_omap":12,"kb_used_meta":837427,"kb_avail":753958200,"statfs":{"total":773094113280,"available":772053196800,"internally_reserved":0,"allocated":183312384,"data_stored":398243758,"data_compressed":51491768,"data_compressed_allocated":69574656,"data_compressed_original":286113792,"omap_allocated":12752,"internal_metadata":857525808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005892"},"pg_stats":[{"pgid":"2.1f","version":"29'354","reported_seq":435,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:41.051141+0000","last_change":"2024-01-18T00:48:41.051174+0000","last_active":"2024-01-18T00:48:41.051141+0000","last_peered":"2024-01-18T00:48:41.051141+0000","last_clean":"2024-01-18T00:48:41.051141+0000","last_became_active":"2024-01-17T23:00:17.463438+0000","last_became_peered":"2024-01-17T23:00:17.463438+0000","last_unstale":"2024-01-18T00:48:41.051141+0000","last_undegraded":"2024-01-18T00:48:41.051141+0000","last_fullsized":"2024-01-18T00:48:41.051141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'354","last_scrub_stamp":"2024-01-18T00:48:41.051065+0000","last_deep_scrub":"29'354","last_deep_scrub_stamp":"2024-01-18T00:48:41.051065+0000","last_clean_scrub_stamp":"2024-01-18T00:48:41.051065+0000","objects_scrubbed":6,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:32:06.952383+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'196","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.028932+0000","last_change":"2024-01-18T00:48:51.028932+0000","last_active":"2024-01-18T00:48:51.028932+0000","last_peered":"2024-01-18T00:48:51.028932+0000","last_clean":"2024-01-18T00:48:51.028932+0000","last_became_active":"2024-01-17T23:00:19.747247+0000","last_became_peered":"2024-01-17T23:00:19.747247+0000","last_unstale":"2024-01-18T00:48:51.028932+0000","last_undegraded":"2024-01-18T00:48:51.028932+0000","last_fullsized":"2024-01-18T00:48:51.028932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-01-18T00:48:51.028852+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-01-18T00:48:51.028852+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.028852+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:49:16.476984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'802","reported_seq":915,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.073010+0000","last_change":"2024-01-18T00:48:55.073032+0000","last_active":"2024-01-18T00:48:55.073010+0000","last_peered":"2024-01-18T00:48:55.073010+0000","last_clean":"2024-01-18T00:48:55.073010+0000","last_became_active":"2024-01-17T23:00:24.761086+0000","last_became_peered":"2024-01-17T23:00:24.761086+0000","last_unstale":"2024-01-18T00:48:55.073010+0000","last_undegraded":"2024-01-18T00:48:55.073010+0000","last_fullsized":"2024-01-18T00:48:55.073010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'802","last_scrub_stamp":"2024-01-18T00:48:55.072936+0000","last_deep_scrub":"29'802","last_deep_scrub_stamp":"2024-01-18T00:48:55.072936+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.072936+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:59.967768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":142138,"num_write":787,"num_write_kb":155519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'556","reported_seq":639,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.086312+0000","last_change":"2024-01-18T00:48:47.086312+0000","last_active":"2024-01-18T00:48:47.086312+0000","last_peered":"2024-01-18T00:48:47.086312+0000","last_clean":"2024-01-18T00:48:47.086312+0000","last_became_active":"2024-01-17T23:00:17.454681+0000","last_became_peered":"2024-01-17T23:00:17.454681+0000","last_unstale":"2024-01-18T00:48:47.086312+0000","last_undegraded":"2024-01-18T00:48:47.086312+0000","last_fullsized":"2024-01-18T00:48:47.086312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'556","last_scrub_stamp":"2024-01-18T00:48:47.086229+0000","last_deep_scrub":"29'556","last_deep_scrub_stamp":"2024-01-18T00:48:47.086229+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.086229+0000","objects_scrubbed":2,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:25.006495+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":8428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'170","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.088997+0000","last_change":"2024-01-18T00:48:49.089017+0000","last_active":"2024-01-18T00:48:49.088997+0000","last_peered":"2024-01-18T00:48:49.088997+0000","last_clean":"2024-01-18T00:48:49.088997+0000","last_became_active":"2024-01-17T23:00:18.563789+0000","last_became_peered":"2024-01-17T23:00:18.563789+0000","last_unstale":"2024-01-18T00:48:49.088997+0000","last_undegraded":"2024-01-18T00:48:49.088997+0000","last_fullsized":"2024-01-18T00:48:49.088997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'170","last_scrub_stamp":"2024-01-18T00:48:49.088942+0000","last_deep_scrub":"29'170","last_deep_scrub_stamp":"2024-01-18T00:48:49.088942+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.088942+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:59:41.304822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'820","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.860014+0000","last_change":"2024-01-18T00:48:48.860085+0000","last_active":"2024-01-18T00:48:48.860014+0000","last_peered":"2024-01-18T00:48:48.860014+0000","last_clean":"2024-01-18T00:48:48.860014+0000","last_became_active":"2024-01-17T23:00:24.755634+0000","last_became_peered":"2024-01-17T23:00:24.755634+0000","last_unstale":"2024-01-18T00:48:48.860014+0000","last_undegraded":"2024-01-18T00:48:48.860014+0000","last_fullsized":"2024-01-18T00:48:48.860014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'820","last_scrub_stamp":"2024-01-18T00:48:48.859831+0000","last_deep_scrub":"29'820","last_deep_scrub_stamp":"2024-01-18T00:48:48.859831+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.859831+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:16:14.613405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":112120,"num_write":807,"num_write_kb":168152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1022","reported_seq":1094,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.284363+0000","last_change":"2024-01-18T00:48:52.284441+0000","last_active":"2024-01-18T00:48:52.284363+0000","last_peered":"2024-01-18T00:48:52.284363+0000","last_clean":"2024-01-18T00:48:52.284363+0000","last_became_active":"2024-01-17T23:00:17.460986+0000","last_became_peered":"2024-01-17T23:00:17.460986+0000","last_unstale":"2024-01-18T00:48:52.284363+0000","last_undegraded":"2024-01-18T00:48:52.284363+0000","last_fullsized":"2024-01-18T00:48:52.284363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1022","last_scrub_stamp":"2024-01-18T00:48:52.284210+0000","last_deep_scrub":"29'1022","last_deep_scrub_stamp":"2024-01-18T00:48:52.284210+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.284210+0000","objects_scrubbed":5,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:52:52.957434+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":12756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'185","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.041245+0000","last_change":"2024-01-18T00:48:52.041372+0000","last_active":"2024-01-18T00:48:52.041245+0000","last_peered":"2024-01-18T00:48:52.041245+0000","last_clean":"2024-01-18T00:48:52.041245+0000","last_became_active":"2024-01-17T23:00:18.490446+0000","last_became_peered":"2024-01-17T23:00:18.490446+0000","last_unstale":"2024-01-18T00:48:52.041245+0000","last_undegraded":"2024-01-18T00:48:52.041245+0000","last_fullsized":"2024-01-18T00:48:52.041245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-01-18T00:48:52.040977+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-01-18T00:48:52.040977+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.040977+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:18:27.067833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'736","reported_seq":825,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.921605+0000","last_change":"2024-01-18T00:48:56.921672+0000","last_active":"2024-01-18T00:48:56.921605+0000","last_peered":"2024-01-18T00:48:56.921605+0000","last_clean":"2024-01-18T00:48:56.921605+0000","last_became_active":"2024-01-17T23:00:24.757126+0000","last_became_peered":"2024-01-17T23:00:24.757126+0000","last_unstale":"2024-01-18T00:48:56.921605+0000","last_undegraded":"2024-01-18T00:48:56.921605+0000","last_fullsized":"2024-01-18T00:48:56.921605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'736","last_scrub_stamp":"2024-01-18T00:48:56.921431+0000","last_deep_scrub":"29'736","last_deep_scrub_stamp":"2024-01-18T00:48:56.921431+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.921431+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:03:27.252731+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":76820,"num_write":722,"num_write_kb":119762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'831","reported_seq":903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.212451+0000","last_change":"2024-01-18T00:48:53.212515+0000","last_active":"2024-01-18T00:48:53.212451+0000","last_peered":"2024-01-18T00:48:53.212451+0000","last_clean":"2024-01-18T00:48:53.212451+0000","last_became_active":"2024-01-17T23:00:17.460994+0000","last_became_peered":"2024-01-17T23:00:17.460994+0000","last_unstale":"2024-01-18T00:48:53.212451+0000","last_undegraded":"2024-01-18T00:48:53.212451+0000","last_fullsized":"2024-01-18T00:48:53.212451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'831","last_scrub_stamp":"2024-01-18T00:48:53.212322+0000","last_deep_scrub":"29'831","last_deep_scrub_stamp":"2024-01-18T00:48:53.212322+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.212322+0000","objects_scrubbed":2,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:18.622718+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":4469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'208","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.063853+0000","last_change":"2024-01-18T00:48:51.063910+0000","last_active":"2024-01-18T00:48:51.063853+0000","last_peered":"2024-01-18T00:48:51.063853+0000","last_clean":"2024-01-18T00:48:51.063853+0000","last_became_active":"2024-01-17T23:00:18.490588+0000","last_became_peered":"2024-01-17T23:00:18.490588+0000","last_unstale":"2024-01-18T00:48:51.063853+0000","last_undegraded":"2024-01-18T00:48:51.063853+0000","last_fullsized":"2024-01-18T00:48:51.063853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-01-18T00:48:51.063688+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-01-18T00:48:51.063688+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.063688+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:11:38.508892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'727","reported_seq":822,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.947904+0000","last_change":"2024-01-18T00:48:55.947966+0000","last_active":"2024-01-18T00:48:55.947904+0000","last_peered":"2024-01-18T00:48:55.947904+0000","last_clean":"2024-01-18T00:48:55.947904+0000","last_became_active":"2024-01-17T23:00:24.767162+0000","last_became_peered":"2024-01-17T23:00:24.767162+0000","last_unstale":"2024-01-18T00:48:55.947904+0000","last_undegraded":"2024-01-18T00:48:55.947904+0000","last_fullsized":"2024-01-18T00:48:55.947904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'727","last_scrub_stamp":"2024-01-18T00:48:55.947721+0000","last_deep_scrub":"29'727","last_deep_scrub_stamp":"2024-01-18T00:48:55.947721+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.947721+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:12:46.062366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":89221,"num_write":717,"num_write_kb":93426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'218","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.185957+0000","last_change":"2024-01-18T00:48:52.186085+0000","last_active":"2024-01-18T00:48:52.185957+0000","last_peered":"2024-01-18T00:48:52.185957+0000","last_clean":"2024-01-18T00:48:52.185957+0000","last_became_active":"2024-01-17T23:00:19.910206+0000","last_became_peered":"2024-01-17T23:00:19.910206+0000","last_unstale":"2024-01-18T00:48:52.185957+0000","last_undegraded":"2024-01-18T00:48:52.185957+0000","last_fullsized":"2024-01-18T00:48:52.185957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-01-18T00:48:52.185754+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-01-18T00:48:52.185754+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.185754+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:37:14.264062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'1223","reported_seq":1300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.258990+0000","last_change":"2024-01-18T00:48:49.259053+0000","last_active":"2024-01-18T00:48:49.258990+0000","last_peered":"2024-01-18T00:48:49.258990+0000","last_clean":"2024-01-18T00:48:49.258990+0000","last_became_active":"2024-01-17T23:00:17.455900+0000","last_became_peered":"2024-01-17T23:00:17.455900+0000","last_unstale":"2024-01-18T00:48:49.258990+0000","last_undegraded":"2024-01-18T00:48:49.258990+0000","last_fullsized":"2024-01-18T00:48:49.258990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1223","last_scrub_stamp":"2024-01-18T00:48:49.258858+0000","last_deep_scrub":"29'1223","last_deep_scrub_stamp":"2024-01-18T00:48:49.258858+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.258858+0000","objects_scrubbed":5,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:48:15.405457+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":12830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'784","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.900765+0000","last_change":"2024-01-18T00:48:51.900831+0000","last_active":"2024-01-18T00:48:51.900765+0000","last_peered":"2024-01-18T00:48:51.900765+0000","last_clean":"2024-01-18T00:48:51.900765+0000","last_became_active":"2024-01-17T23:00:24.764204+0000","last_became_peered":"2024-01-17T23:00:24.764204+0000","last_unstale":"2024-01-18T00:48:51.900765+0000","last_undegraded":"2024-01-18T00:48:51.900765+0000","last_fullsized":"2024-01-18T00:48:51.900765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'784","last_scrub_stamp":"2024-01-18T00:48:51.900599+0000","last_deep_scrub":"29'784","last_deep_scrub_stamp":"2024-01-18T00:48:51.900599+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.900599+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:17:39.112668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":112181,"num_write":768,"num_write_kb":146877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'218","reported_seq":293,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.056278+0000","last_change":"2024-01-18T00:48:42.056298+0000","last_active":"2024-01-18T00:48:42.056278+0000","last_peered":"2024-01-18T00:48:42.056278+0000","last_clean":"2024-01-18T00:48:42.056278+0000","last_became_active":"2024-01-17T23:00:20.211738+0000","last_became_peered":"2024-01-17T23:00:20.211738+0000","last_unstale":"2024-01-18T00:48:42.056278+0000","last_undegraded":"2024-01-18T00:48:42.056278+0000","last_fullsized":"2024-01-18T00:48:42.056278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-01-18T00:48:42.056223+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-01-18T00:48:42.056223+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.056223+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:26.462274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1253","reported_seq":1331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:39.928459+0000","last_change":"2024-01-18T00:48:39.928486+0000","last_active":"2024-01-18T00:48:39.928459+0000","last_peered":"2024-01-18T00:48:39.928459+0000","last_clean":"2024-01-18T00:48:39.928459+0000","last_became_active":"2024-01-17T23:00:17.443400+0000","last_became_peered":"2024-01-17T23:00:17.443400+0000","last_unstale":"2024-01-18T00:48:39.928459+0000","last_undegraded":"2024-01-18T00:48:39.928459+0000","last_fullsized":"2024-01-18T00:48:39.928459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1253","last_scrub_stamp":"2024-01-18T00:48:39.928399+0000","last_deep_scrub":"29'1253","last_deep_scrub_stamp":"2024-01-18T00:48:39.928399+0000","last_clean_scrub_stamp":"2024-01-18T00:48:39.928399+0000","objects_scrubbed":3,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:12:02.413836+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":8782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'844","reported_seq":954,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.905502+0000","last_change":"2024-01-18T00:48:52.905566+0000","last_active":"2024-01-18T00:48:52.905502+0000","last_peered":"2024-01-18T00:48:52.905502+0000","last_clean":"2024-01-18T00:48:52.905502+0000","last_became_active":"2024-01-17T23:00:24.757869+0000","last_became_peered":"2024-01-17T23:00:24.757869+0000","last_unstale":"2024-01-18T00:48:52.905502+0000","last_undegraded":"2024-01-18T00:48:52.905502+0000","last_fullsized":"2024-01-18T00:48:52.905502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'844","last_scrub_stamp":"2024-01-18T00:48:52.905321+0000","last_deep_scrub":"29'844","last_deep_scrub_stamp":"2024-01-18T00:48:52.905321+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.905321+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:33:26.520515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":112670,"num_write":833,"num_write_kb":127477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'211","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.072806+0000","last_change":"2024-01-18T00:48:53.072826+0000","last_active":"2024-01-18T00:48:53.072806+0000","last_peered":"2024-01-18T00:48:53.072806+0000","last_clean":"2024-01-18T00:48:53.072806+0000","last_became_active":"2024-01-17T23:00:19.815762+0000","last_became_peered":"2024-01-17T23:00:19.815762+0000","last_unstale":"2024-01-18T00:48:53.072806+0000","last_undegraded":"2024-01-18T00:48:53.072806+0000","last_fullsized":"2024-01-18T00:48:53.072806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-01-18T00:48:53.072741+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-01-18T00:48:53.072741+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.072741+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:12:07.995176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'325","reported_seq":404,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.917912+0000","last_change":"2024-01-18T00:48:42.918027+0000","last_active":"2024-01-18T00:48:42.917912+0000","last_peered":"2024-01-18T00:48:42.917912+0000","last_clean":"2024-01-18T00:48:42.917912+0000","last_became_active":"2024-01-17T23:00:17.451042+0000","last_became_peered":"2024-01-17T23:00:17.451042+0000","last_unstale":"2024-01-18T00:48:42.917912+0000","last_undegraded":"2024-01-18T00:48:42.917912+0000","last_fullsized":"2024-01-18T00:48:42.917912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'325","last_scrub_stamp":"2024-01-18T00:48:42.917767+0000","last_deep_scrub":"29'325","last_deep_scrub_stamp":"2024-01-18T00:48:42.917767+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.917767+0000","objects_scrubbed":3,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:48:09.064367+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'756","reported_seq":876,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.898332+0000","last_change":"2024-01-18T00:48:53.898332+0000","last_active":"2024-01-18T00:48:53.898332+0000","last_peered":"2024-01-18T00:48:53.898332+0000","last_clean":"2024-01-18T00:48:53.898332+0000","last_became_active":"2024-01-17T23:00:24.772719+0000","last_became_peered":"2024-01-17T23:00:24.772719+0000","last_unstale":"2024-01-18T00:48:53.898332+0000","last_undegraded":"2024-01-18T00:48:53.898332+0000","last_fullsized":"2024-01-18T00:48:53.898332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'756","last_scrub_stamp":"2024-01-18T00:48:53.898237+0000","last_deep_scrub":"29'756","last_deep_scrub_stamp":"2024-01-18T00:48:53.898237+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.898237+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:10:37.666556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":171173,"num_write":745,"num_write_kb":212620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'224","reported_seq":301,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.814593+0000","last_change":"2024-01-18T00:48:44.814709+0000","last_active":"2024-01-18T00:48:44.814593+0000","last_peered":"2024-01-18T00:48:44.814593+0000","last_clean":"2024-01-18T00:48:44.814593+0000","last_became_active":"2024-01-17T23:00:18.367642+0000","last_became_peered":"2024-01-17T23:00:18.367642+0000","last_unstale":"2024-01-18T00:48:44.814593+0000","last_undegraded":"2024-01-18T00:48:44.814593+0000","last_fullsized":"2024-01-18T00:48:44.814593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'224","last_scrub_stamp":"2024-01-18T00:48:44.814336+0000","last_deep_scrub":"29'224","last_deep_scrub_stamp":"2024-01-18T00:48:44.814336+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.814336+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:54:53.249968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'231","reported_seq":310,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.228684+0000","last_change":"2024-01-18T00:48:50.228749+0000","last_active":"2024-01-18T00:48:50.228684+0000","last_peered":"2024-01-18T00:48:50.228684+0000","last_clean":"2024-01-18T00:48:50.228684+0000","last_became_active":"2024-01-17T23:00:17.457816+0000","last_became_peered":"2024-01-17T23:00:17.457816+0000","last_unstale":"2024-01-18T00:48:50.228684+0000","last_undegraded":"2024-01-18T00:48:50.228684+0000","last_fullsized":"2024-01-18T00:48:50.228684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'231","last_scrub_stamp":"2024-01-18T00:48:50.228539+0000","last_deep_scrub":"29'231","last_deep_scrub_stamp":"2024-01-18T00:48:50.228539+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.228539+0000","objects_scrubbed":2,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:40:45.767189+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'704","reported_seq":793,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.923476+0000","last_change":"2024-01-18T00:48:54.923544+0000","last_active":"2024-01-18T00:48:54.923476+0000","last_peered":"2024-01-18T00:48:54.923476+0000","last_clean":"2024-01-18T00:48:54.923476+0000","last_became_active":"2024-01-17T23:00:24.763705+0000","last_became_peered":"2024-01-17T23:00:24.763705+0000","last_unstale":"2024-01-18T00:48:54.923476+0000","last_undegraded":"2024-01-18T00:48:54.923476+0000","last_fullsized":"2024-01-18T00:48:54.923476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'704","last_scrub_stamp":"2024-01-18T00:48:54.923302+0000","last_deep_scrub":"29'704","last_deep_scrub_stamp":"2024-01-18T00:48:54.923302+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.923302+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:07:24.003139+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42617,"num_write":681,"num_write_kb":68844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'225","reported_seq":302,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.047391+0000","last_change":"2024-01-18T00:48:45.047412+0000","last_active":"2024-01-18T00:48:45.047391+0000","last_peered":"2024-01-18T00:48:45.047391+0000","last_clean":"2024-01-18T00:48:45.047391+0000","last_became_active":"2024-01-17T23:00:18.559897+0000","last_became_peered":"2024-01-17T23:00:18.559897+0000","last_unstale":"2024-01-18T00:48:45.047391+0000","last_undegraded":"2024-01-18T00:48:45.047391+0000","last_fullsized":"2024-01-18T00:48:45.047391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'225","last_scrub_stamp":"2024-01-18T00:48:45.047329+0000","last_deep_scrub":"29'225","last_deep_scrub_stamp":"2024-01-18T00:48:45.047329+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.047329+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:29.453380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'305","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.236985+0000","last_change":"2024-01-18T00:48:49.237057+0000","last_active":"2024-01-18T00:48:49.236985+0000","last_peered":"2024-01-18T00:48:49.236985+0000","last_clean":"2024-01-18T00:48:49.236985+0000","last_became_active":"2024-01-17T23:00:17.451185+0000","last_became_peered":"2024-01-17T23:00:17.451185+0000","last_unstale":"2024-01-18T00:48:49.236985+0000","last_undegraded":"2024-01-18T00:48:49.236985+0000","last_fullsized":"2024-01-18T00:48:49.236985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'305","last_scrub_stamp":"2024-01-18T00:48:49.236815+0000","last_deep_scrub":"29'305","last_deep_scrub_stamp":"2024-01-18T00:48:49.236815+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.236815+0000","objects_scrubbed":3,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:21:51.600621+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'837","reported_seq":987,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.885583+0000","last_change":"2024-01-18T00:48:53.885651+0000","last_active":"2024-01-18T00:48:53.885583+0000","last_peered":"2024-01-18T00:48:53.885583+0000","last_clean":"2024-01-18T00:48:53.885583+0000","last_became_active":"2024-01-17T23:00:24.764021+0000","last_became_peered":"2024-01-17T23:00:24.764021+0000","last_unstale":"2024-01-18T00:48:53.885583+0000","last_undegraded":"2024-01-18T00:48:53.885583+0000","last_fullsized":"2024-01-18T00:48:53.885583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2024-01-18T00:48:53.885399+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2024-01-18T00:48:53.885399+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.885399+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:32:36.244074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":234919,"num_write":817,"num_write_kb":206693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'182","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.075546+0000","last_change":"2024-01-18T00:48:54.075584+0000","last_active":"2024-01-18T00:48:54.075546+0000","last_peered":"2024-01-18T00:48:54.075546+0000","last_clean":"2024-01-18T00:48:54.075546+0000","last_became_active":"2024-01-17T23:00:20.243246+0000","last_became_peered":"2024-01-17T23:00:20.243246+0000","last_unstale":"2024-01-18T00:48:54.075546+0000","last_undegraded":"2024-01-18T00:48:54.075546+0000","last_fullsized":"2024-01-18T00:48:54.075546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2024-01-18T00:48:54.075475+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2024-01-18T00:48:54.075475+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.075475+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:38:14.564277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'1187","reported_seq":1266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.948938+0000","last_change":"2024-01-18T00:48:40.948964+0000","last_active":"2024-01-18T00:48:40.948938+0000","last_peered":"2024-01-18T00:48:40.948938+0000","last_clean":"2024-01-18T00:48:40.948938+0000","last_became_active":"2024-01-17T23:00:17.445003+0000","last_became_peered":"2024-01-17T23:00:17.445003+0000","last_unstale":"2024-01-18T00:48:40.948938+0000","last_undegraded":"2024-01-18T00:48:40.948938+0000","last_fullsized":"2024-01-18T00:48:40.948938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1187","last_scrub_stamp":"2024-01-18T00:48:40.948880+0000","last_deep_scrub":"29'1187","last_deep_scrub_stamp":"2024-01-18T00:48:40.948880+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.948880+0000","objects_scrubbed":2,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:59:21.685236+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3147,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'823","reported_seq":946,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.034587+0000","last_change":"2024-01-18T00:48:56.034587+0000","last_active":"2024-01-18T00:48:56.034587+0000","last_peered":"2024-01-18T00:48:56.034587+0000","last_clean":"2024-01-18T00:48:56.034587+0000","last_became_active":"2024-01-17T23:00:24.765406+0000","last_became_peered":"2024-01-17T23:00:24.765406+0000","last_unstale":"2024-01-18T00:48:56.034587+0000","last_undegraded":"2024-01-18T00:48:56.034587+0000","last_fullsized":"2024-01-18T00:48:56.034587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'823","last_scrub_stamp":"2024-01-18T00:48:56.034499+0000","last_deep_scrub":"29'823","last_deep_scrub_stamp":"2024-01-18T00:48:56.034499+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.034499+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:10:39.802818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":136936,"num_write":807,"num_write_kb":135857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'203","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.957783+0000","last_change":"2024-01-18T00:48:45.957820+0000","last_active":"2024-01-18T00:48:45.957783+0000","last_peered":"2024-01-18T00:48:45.957783+0000","last_clean":"2024-01-18T00:48:45.957783+0000","last_became_active":"2024-01-17T23:00:19.815320+0000","last_became_peered":"2024-01-17T23:00:19.815320+0000","last_unstale":"2024-01-18T00:48:45.957783+0000","last_undegraded":"2024-01-18T00:48:45.957783+0000","last_fullsized":"2024-01-18T00:48:45.957783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-01-18T00:48:45.957701+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-01-18T00:48:45.957701+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.957701+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:52:46.630924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'797","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.216248+0000","last_change":"2024-01-18T00:48:51.216314+0000","last_active":"2024-01-18T00:48:51.216248+0000","last_peered":"2024-01-18T00:48:51.216248+0000","last_clean":"2024-01-18T00:48:51.216248+0000","last_became_active":"2024-01-17T23:00:17.458172+0000","last_became_peered":"2024-01-17T23:00:17.458172+0000","last_unstale":"2024-01-18T00:48:51.216248+0000","last_undegraded":"2024-01-18T00:48:51.216248+0000","last_fullsized":"2024-01-18T00:48:51.216248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'797","last_scrub_stamp":"2024-01-18T00:48:51.216105+0000","last_deep_scrub":"29'797","last_deep_scrub_stamp":"2024-01-18T00:48:51.216105+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.216105+0000","objects_scrubbed":3,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:59:43.431985+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'751","reported_seq":857,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.114697+0000","last_change":"2024-01-18T00:48:52.114738+0000","last_active":"2024-01-18T00:48:52.114697+0000","last_peered":"2024-01-18T00:48:52.114697+0000","last_clean":"2024-01-18T00:48:52.114697+0000","last_became_active":"2024-01-17T23:00:24.772312+0000","last_became_peered":"2024-01-17T23:00:24.772312+0000","last_unstale":"2024-01-18T00:48:52.114697+0000","last_undegraded":"2024-01-18T00:48:52.114697+0000","last_fullsized":"2024-01-18T00:48:52.114697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'751","last_scrub_stamp":"2024-01-18T00:48:52.114623+0000","last_deep_scrub":"29'751","last_deep_scrub_stamp":"2024-01-18T00:48:52.114623+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.114623+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:10:51.972597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":97762,"num_write":737,"num_write_kb":97911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'220","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:58.029529+0000","last_change":"2024-01-18T00:48:58.029594+0000","last_active":"2024-01-18T00:48:58.029529+0000","last_peered":"2024-01-18T00:48:58.029529+0000","last_clean":"2024-01-18T00:48:58.029529+0000","last_became_active":"2024-01-17T23:00:18.564877+0000","last_became_peered":"2024-01-17T23:00:18.564877+0000","last_unstale":"2024-01-18T00:48:58.029529+0000","last_undegraded":"2024-01-18T00:48:58.029529+0000","last_fullsized":"2024-01-18T00:48:58.029529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'220","last_scrub_stamp":"2024-01-18T00:48:58.029347+0000","last_deep_scrub":"29'220","last_deep_scrub_stamp":"2024-01-18T00:48:58.029347+0000","last_clean_scrub_stamp":"2024-01-18T00:48:58.029347+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:34.534085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'269","reported_seq":350,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:43.920294+0000","last_change":"2024-01-18T00:48:43.920320+0000","last_active":"2024-01-18T00:48:43.920294+0000","last_peered":"2024-01-18T00:48:43.920294+0000","last_clean":"2024-01-18T00:48:43.920294+0000","last_became_active":"2024-01-17T23:00:17.453425+0000","last_became_peered":"2024-01-17T23:00:17.453425+0000","last_unstale":"2024-01-18T00:48:43.920294+0000","last_undegraded":"2024-01-18T00:48:43.920294+0000","last_fullsized":"2024-01-18T00:48:43.920294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'269","last_scrub_stamp":"2024-01-18T00:48:43.920234+0000","last_deep_scrub":"29'269","last_deep_scrub_stamp":"2024-01-18T00:48:43.920234+0000","last_clean_scrub_stamp":"2024-01-18T00:48:43.920234+0000","objects_scrubbed":1,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:40:39.458884+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'803","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.936829+0000","last_change":"2024-01-18T00:48:52.936851+0000","last_active":"2024-01-18T00:48:52.936829+0000","last_peered":"2024-01-18T00:48:52.936829+0000","last_clean":"2024-01-18T00:48:52.936829+0000","last_became_active":"2024-01-17T23:00:24.773356+0000","last_became_peered":"2024-01-17T23:00:24.773356+0000","last_unstale":"2024-01-18T00:48:52.936829+0000","last_undegraded":"2024-01-18T00:48:52.936829+0000","last_fullsized":"2024-01-18T00:48:52.936829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'803","last_scrub_stamp":"2024-01-18T00:48:52.936765+0000","last_deep_scrub":"29'803","last_deep_scrub_stamp":"2024-01-18T00:48:52.936765+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.936765+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:29:57.831598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":142135,"num_write":790,"num_write_kb":151473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'205","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.853675+0000","last_change":"2024-01-18T00:48:46.853737+0000","last_active":"2024-01-18T00:48:46.853675+0000","last_peered":"2024-01-18T00:48:46.853675+0000","last_clean":"2024-01-18T00:48:46.853675+0000","last_became_active":"2024-01-17T23:00:18.558206+0000","last_became_peered":"2024-01-17T23:00:18.558206+0000","last_unstale":"2024-01-18T00:48:46.853675+0000","last_undegraded":"2024-01-18T00:48:46.853675+0000","last_fullsized":"2024-01-18T00:48:46.853675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-01-18T00:48:46.853509+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-01-18T00:48:46.853509+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.853509+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:39:42.884680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'961","reported_seq":1042,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.123064+0000","last_change":"2024-01-18T00:48:50.123132+0000","last_active":"2024-01-18T00:48:50.123064+0000","last_peered":"2024-01-18T00:48:50.123064+0000","last_clean":"2024-01-18T00:48:50.123064+0000","last_became_active":"2024-01-17T23:00:17.452008+0000","last_became_peered":"2024-01-17T23:00:17.452008+0000","last_unstale":"2024-01-18T00:48:50.123064+0000","last_undegraded":"2024-01-18T00:48:50.123064+0000","last_fullsized":"2024-01-18T00:48:50.123064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'961","last_scrub_stamp":"2024-01-18T00:48:50.122905+0000","last_deep_scrub":"29'961","last_deep_scrub_stamp":"2024-01-18T00:48:50.122905+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.122905+0000","objects_scrubbed":2,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:52:50.796129+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":8584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'706","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.945428+0000","last_change":"2024-01-18T00:48:51.945450+0000","last_active":"2024-01-18T00:48:51.945428+0000","last_peered":"2024-01-18T00:48:51.945428+0000","last_clean":"2024-01-18T00:48:51.945428+0000","last_became_active":"2024-01-17T23:00:24.762959+0000","last_became_peered":"2024-01-17T23:00:24.762959+0000","last_unstale":"2024-01-18T00:48:51.945428+0000","last_undegraded":"2024-01-18T00:48:51.945428+0000","last_fullsized":"2024-01-18T00:48:51.945428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'706","last_scrub_stamp":"2024-01-18T00:48:51.945354+0000","last_deep_scrub":"29'706","last_deep_scrub_stamp":"2024-01-18T00:48:51.945354+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.945354+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:38:12.434155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":104293,"num_write":696,"num_write_kb":118416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'201","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.933195+0000","last_change":"2024-01-18T00:48:48.933195+0000","last_active":"2024-01-18T00:48:48.933195+0000","last_peered":"2024-01-18T00:48:48.933195+0000","last_clean":"2024-01-18T00:48:48.933195+0000","last_became_active":"2024-01-17T23:00:19.817215+0000","last_became_peered":"2024-01-17T23:00:19.817215+0000","last_unstale":"2024-01-18T00:48:48.933195+0000","last_undegraded":"2024-01-18T00:48:48.933195+0000","last_fullsized":"2024-01-18T00:48:48.933195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-01-18T00:48:48.933114+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-01-18T00:48:48.933114+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.933114+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:49:14.381246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1852","reported_seq":3719,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:41.505238+0000","last_change":"2024-01-18T00:48:41.505265+0000","last_active":"2024-01-18T00:48:41.505238+0000","last_peered":"2024-01-18T00:48:41.505238+0000","last_clean":"2024-01-18T00:48:41.505238+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:41.505238+0000","last_undegraded":"2024-01-18T00:48:41.505238+0000","last_fullsized":"2024-01-18T00:48:41.505238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1852","last_scrub_stamp":"2024-01-18T00:48:41.505175+0000","last_deep_scrub":"29'1852","last_deep_scrub_stamp":"2024-01-18T00:48:41.505175+0000","last_clean_scrub_stamp":"2024-01-18T00:48:41.505175+0000","objects_scrubbed":3,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:09:57.878138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1558276,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1786,"num_read_kb":2854,"num_write":1793,"num_write_kb":2858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'717","reported_seq":809,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.585395+0000","last_change":"2024-01-18T00:48:49.585395+0000","last_active":"2024-01-18T00:48:49.585395+0000","last_peered":"2024-01-18T00:48:49.585395+0000","last_clean":"2024-01-18T00:48:49.585395+0000","last_became_active":"2024-01-17T23:00:34.459693+0000","last_became_peered":"2024-01-17T23:00:34.459693+0000","last_unstale":"2024-01-18T00:48:49.585395+0000","last_undegraded":"2024-01-18T00:48:49.585395+0000","last_fullsized":"2024-01-18T00:48:49.585395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'717","last_scrub_stamp":"2024-01-18T00:48:49.585304+0000","last_deep_scrub":"29'717","last_deep_scrub_stamp":"2024-01-18T00:48:49.585304+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.585304+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:28:43.328586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":54940,"num_write":709,"num_write_kb":85564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'199","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:39.071147+0000","last_change":"2024-01-18T00:48:39.071168+0000","last_active":"2024-01-18T00:48:39.071147+0000","last_peered":"2024-01-18T00:48:39.071147+0000","last_clean":"2024-01-18T00:48:39.071147+0000","last_became_active":"2024-01-17T23:00:18.560643+0000","last_became_peered":"2024-01-17T23:00:18.560643+0000","last_unstale":"2024-01-18T00:48:39.071147+0000","last_undegraded":"2024-01-18T00:48:39.071147+0000","last_fullsized":"2024-01-18T00:48:39.071147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-01-18T00:48:39.071066+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-01-18T00:48:39.071066+0000","last_clean_scrub_stamp":"2024-01-18T00:48:39.071066+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:35:24.417318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'553","reported_seq":636,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.259811+0000","last_change":"2024-01-18T00:48:48.259811+0000","last_active":"2024-01-18T00:48:48.259811+0000","last_peered":"2024-01-18T00:48:48.259811+0000","last_clean":"2024-01-18T00:48:48.259811+0000","last_became_active":"2024-01-17T23:00:17.452522+0000","last_became_peered":"2024-01-17T23:00:17.452522+0000","last_unstale":"2024-01-18T00:48:48.259811+0000","last_undegraded":"2024-01-18T00:48:48.259811+0000","last_fullsized":"2024-01-18T00:48:48.259811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'553","last_scrub_stamp":"2024-01-18T00:48:48.259574+0000","last_deep_scrub":"29'553","last_deep_scrub_stamp":"2024-01-18T00:48:48.259574+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.259574+0000","objects_scrubbed":4,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:21:50.623380+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":486,"num_write_kb":12520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'927","reported_seq":1073,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.186003+0000","last_change":"2024-01-18T00:48:54.186045+0000","last_active":"2024-01-18T00:48:54.186003+0000","last_peered":"2024-01-18T00:48:54.186003+0000","last_clean":"2024-01-18T00:48:54.186003+0000","last_became_active":"2024-01-17T23:00:24.778311+0000","last_became_peered":"2024-01-17T23:00:24.778311+0000","last_unstale":"2024-01-18T00:48:54.186003+0000","last_undegraded":"2024-01-18T00:48:54.186003+0000","last_fullsized":"2024-01-18T00:48:54.186003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'927","last_scrub_stamp":"2024-01-18T00:48:54.185891+0000","last_deep_scrub":"29'927","last_deep_scrub_stamp":"2024-01-18T00:48:54.185891+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.185891+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:06:52.338711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":233359,"num_write":916,"num_write_kb":280898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'196","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.057114+0000","last_change":"2024-01-18T00:48:49.057134+0000","last_active":"2024-01-18T00:48:49.057114+0000","last_peered":"2024-01-18T00:48:49.057114+0000","last_clean":"2024-01-18T00:48:49.057114+0000","last_became_active":"2024-01-17T23:00:19.650191+0000","last_became_peered":"2024-01-17T23:00:19.650191+0000","last_unstale":"2024-01-18T00:48:49.057114+0000","last_undegraded":"2024-01-18T00:48:49.057114+0000","last_fullsized":"2024-01-18T00:48:49.057114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-01-18T00:48:49.057056+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-01-18T00:48:49.057056+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.057056+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:10:48.915031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'295","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.115436+0000","last_change":"2024-01-18T00:48:47.115511+0000","last_active":"2024-01-18T00:48:47.115436+0000","last_peered":"2024-01-18T00:48:47.115436+0000","last_clean":"2024-01-18T00:48:47.115436+0000","last_became_active":"2024-01-17T23:00:17.366708+0000","last_became_peered":"2024-01-17T23:00:17.366708+0000","last_unstale":"2024-01-18T00:48:47.115436+0000","last_undegraded":"2024-01-18T00:48:47.115436+0000","last_fullsized":"2024-01-18T00:48:47.115436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'295","last_scrub_stamp":"2024-01-18T00:48:47.115222+0000","last_deep_scrub":"29'295","last_deep_scrub_stamp":"2024-01-18T00:48:47.115222+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.115222+0000","objects_scrubbed":4,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:48:13.261822+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'163","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.174550+0000","last_change":"2024-01-18T00:48:47.174615+0000","last_active":"2024-01-18T00:48:47.174550+0000","last_peered":"2024-01-18T00:48:47.174550+0000","last_clean":"2024-01-18T00:48:47.174550+0000","last_became_active":"2024-01-17T22:59:44.582644+0000","last_became_peered":"2024-01-17T22:59:44.582644+0000","last_unstale":"2024-01-18T00:48:47.174550+0000","last_undegraded":"2024-01-18T00:48:47.174550+0000","last_fullsized":"2024-01-18T00:48:47.174550+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'163","last_scrub_stamp":"2024-01-18T00:48:47.174382+0000","last_deep_scrub":"29'163","last_deep_scrub_stamp":"2024-01-18T00:48:47.174382+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.174382+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:31.580433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'848","reported_seq":985,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:57.131713+0000","last_change":"2024-01-18T00:48:57.131776+0000","last_active":"2024-01-18T00:48:57.131713+0000","last_peered":"2024-01-18T00:48:57.131713+0000","last_clean":"2024-01-18T00:48:57.131713+0000","last_became_active":"2024-01-17T23:00:24.755374+0000","last_became_peered":"2024-01-17T23:00:24.755374+0000","last_unstale":"2024-01-18T00:48:57.131713+0000","last_undegraded":"2024-01-18T00:48:57.131713+0000","last_fullsized":"2024-01-18T00:48:57.131713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'848","last_scrub_stamp":"2024-01-18T00:48:57.131503+0000","last_deep_scrub":"29'848","last_deep_scrub_stamp":"2024-01-18T00:48:57.131503+0000","last_clean_scrub_stamp":"2024-01-18T00:48:57.131503+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:06:55.284323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":221922,"num_write":836,"num_write_kb":231792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'205","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:59.224135+0000","last_change":"2024-01-18T00:48:59.224248+0000","last_active":"2024-01-18T00:48:59.224135+0000","last_peered":"2024-01-18T00:48:59.224135+0000","last_clean":"2024-01-18T00:48:59.224135+0000","last_became_active":"2024-01-17T23:00:18.504515+0000","last_became_peered":"2024-01-17T23:00:18.504515+0000","last_unstale":"2024-01-18T00:48:59.224135+0000","last_undegraded":"2024-01-18T00:48:59.224135+0000","last_fullsized":"2024-01-18T00:48:59.224135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-01-18T00:48:59.223950+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-01-18T00:48:59.223950+0000","last_clean_scrub_stamp":"2024-01-18T00:48:59.223950+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:20:35.728688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'355","reported_seq":432,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.517228+0000","last_change":"2024-01-18T00:48:42.517253+0000","last_active":"2024-01-18T00:48:42.517228+0000","last_peered":"2024-01-18T00:48:42.517228+0000","last_clean":"2024-01-18T00:48:42.517228+0000","last_became_active":"2024-01-17T23:00:17.365099+0000","last_became_peered":"2024-01-17T23:00:17.365099+0000","last_unstale":"2024-01-18T00:48:42.517228+0000","last_undegraded":"2024-01-18T00:48:42.517228+0000","last_fullsized":"2024-01-18T00:48:42.517228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'355","last_scrub_stamp":"2024-01-18T00:48:42.517174+0000","last_deep_scrub":"29'355","last_deep_scrub_stamp":"2024-01-18T00:48:42.517174+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.517174+0000","objects_scrubbed":3,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:30:31.047281+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'833","reported_seq":969,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:59.164537+0000","last_change":"2024-01-18T00:48:59.164660+0000","last_active":"2024-01-18T00:48:59.164537+0000","last_peered":"2024-01-18T00:48:59.164537+0000","last_clean":"2024-01-18T00:48:59.164537+0000","last_became_active":"2024-01-17T23:00:24.766593+0000","last_became_peered":"2024-01-17T23:00:24.766593+0000","last_unstale":"2024-01-18T00:48:59.164537+0000","last_undegraded":"2024-01-18T00:48:59.164537+0000","last_fullsized":"2024-01-18T00:48:59.164537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'833","last_scrub_stamp":"2024-01-18T00:48:59.164325+0000","last_deep_scrub":"29'833","last_deep_scrub_stamp":"2024-01-18T00:48:59.164325+0000","last_clean_scrub_stamp":"2024-01-18T00:48:59.164325+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:14:57.167710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":185672,"num_write":820,"num_write_kb":193922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'221","reported_seq":296,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.998898+0000","last_change":"2024-01-18T00:48:56.998956+0000","last_active":"2024-01-18T00:48:56.998898+0000","last_peered":"2024-01-18T00:48:56.998898+0000","last_clean":"2024-01-18T00:48:56.998898+0000","last_became_active":"2024-01-17T23:00:18.563594+0000","last_became_peered":"2024-01-17T23:00:18.563594+0000","last_unstale":"2024-01-18T00:48:56.998898+0000","last_undegraded":"2024-01-18T00:48:56.998898+0000","last_fullsized":"2024-01-18T00:48:56.998898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-01-18T00:48:56.998744+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-01-18T00:48:56.998744+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.998744+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:57.666881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'245","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:41.960530+0000","last_change":"2024-01-18T00:48:41.960555+0000","last_active":"2024-01-18T00:48:41.960530+0000","last_peered":"2024-01-18T00:48:41.960530+0000","last_clean":"2024-01-18T00:48:41.960530+0000","last_became_active":"2024-01-17T23:00:17.445976+0000","last_became_peered":"2024-01-17T23:00:17.445976+0000","last_unstale":"2024-01-18T00:48:41.960530+0000","last_undegraded":"2024-01-18T00:48:41.960530+0000","last_fullsized":"2024-01-18T00:48:41.960530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'245","last_scrub_stamp":"2024-01-18T00:48:41.960468+0000","last_deep_scrub":"29'245","last_deep_scrub_stamp":"2024-01-18T00:48:41.960468+0000","last_clean_scrub_stamp":"2024-01-18T00:48:41.960468+0000","objects_scrubbed":2,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:44:01.156348+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":189,"num_write_kb":4175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'771","reported_seq":868,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.182479+0000","last_change":"2024-01-18T00:48:55.182501+0000","last_active":"2024-01-18T00:48:55.182479+0000","last_peered":"2024-01-18T00:48:55.182479+0000","last_clean":"2024-01-18T00:48:55.182479+0000","last_became_active":"2024-01-17T23:00:24.779433+0000","last_became_peered":"2024-01-17T23:00:24.779433+0000","last_unstale":"2024-01-18T00:48:55.182479+0000","last_undegraded":"2024-01-18T00:48:55.182479+0000","last_fullsized":"2024-01-18T00:48:55.182479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'771","last_scrub_stamp":"2024-01-18T00:48:55.182409+0000","last_deep_scrub":"29'771","last_deep_scrub_stamp":"2024-01-18T00:48:55.182409+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.182409+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:32:46.531879+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":76462,"num_write":751,"num_write_kb":105973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'186","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.186236+0000","last_change":"2024-01-18T00:48:46.186236+0000","last_active":"2024-01-18T00:48:46.186236+0000","last_peered":"2024-01-18T00:48:46.186236+0000","last_clean":"2024-01-18T00:48:46.186236+0000","last_became_active":"2024-01-17T23:00:18.502242+0000","last_became_peered":"2024-01-17T23:00:18.502242+0000","last_unstale":"2024-01-18T00:48:46.186236+0000","last_undegraded":"2024-01-18T00:48:46.186236+0000","last_fullsized":"2024-01-18T00:48:46.186236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'186","last_scrub_stamp":"2024-01-18T00:48:46.185957+0000","last_deep_scrub":"29'186","last_deep_scrub_stamp":"2024-01-18T00:48:46.185957+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.185957+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:12:08.671393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'810","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.538687+0000","last_change":"2024-01-18T00:48:40.538716+0000","last_active":"2024-01-18T00:48:40.538687+0000","last_peered":"2024-01-18T00:48:40.538687+0000","last_clean":"2024-01-18T00:48:40.538687+0000","last_became_active":"2024-01-17T23:00:17.326373+0000","last_became_peered":"2024-01-17T23:00:17.326373+0000","last_unstale":"2024-01-18T00:48:40.538687+0000","last_undegraded":"2024-01-18T00:48:40.538687+0000","last_fullsized":"2024-01-18T00:48:40.538687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'810","last_scrub_stamp":"2024-01-18T00:48:40.538630+0000","last_deep_scrub":"29'810","last_deep_scrub_stamp":"2024-01-18T00:48:40.538630+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.538630+0000","objects_scrubbed":2,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:50:42.829599+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'771","reported_seq":869,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:00.057163+0000","last_change":"2024-01-18T00:49:00.057225+0000","last_active":"2024-01-18T00:49:00.057163+0000","last_peered":"2024-01-18T00:49:00.057163+0000","last_clean":"2024-01-18T00:49:00.057163+0000","last_became_active":"2024-01-17T23:00:24.774235+0000","last_became_peered":"2024-01-17T23:00:24.774235+0000","last_unstale":"2024-01-18T00:49:00.057163+0000","last_undegraded":"2024-01-18T00:49:00.057163+0000","last_fullsized":"2024-01-18T00:49:00.057163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'771","last_scrub_stamp":"2024-01-18T00:49:00.056996+0000","last_deep_scrub":"29'771","last_deep_scrub_stamp":"2024-01-18T00:49:00.056996+0000","last_clean_scrub_stamp":"2024-01-18T00:49:00.056996+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:44.745787+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":79513,"num_write":758,"num_write_kb":101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'185","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:00.271201+0000","last_change":"2024-01-18T00:49:00.271259+0000","last_active":"2024-01-18T00:49:00.271201+0000","last_peered":"2024-01-18T00:49:00.271201+0000","last_clean":"2024-01-18T00:49:00.271201+0000","last_became_active":"2024-01-17T23:00:18.506552+0000","last_became_peered":"2024-01-17T23:00:18.506552+0000","last_unstale":"2024-01-18T00:49:00.271201+0000","last_undegraded":"2024-01-18T00:49:00.271201+0000","last_fullsized":"2024-01-18T00:49:00.271201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'185","last_scrub_stamp":"2024-01-18T00:49:00.271024+0000","last_deep_scrub":"29'185","last_deep_scrub_stamp":"2024-01-18T00:49:00.271024+0000","last_clean_scrub_stamp":"2024-01-18T00:49:00.271024+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:55.971643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'900","reported_seq":977,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.797713+0000","last_change":"2024-01-18T00:48:42.797713+0000","last_active":"2024-01-18T00:48:42.797713+0000","last_peered":"2024-01-18T00:48:42.797713+0000","last_clean":"2024-01-18T00:48:42.797713+0000","last_became_active":"2024-01-17T23:00:17.454828+0000","last_became_peered":"2024-01-17T23:00:17.454828+0000","last_unstale":"2024-01-18T00:48:42.797713+0000","last_undegraded":"2024-01-18T00:48:42.797713+0000","last_fullsized":"2024-01-18T00:48:42.797713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'900","last_scrub_stamp":"2024-01-18T00:48:42.797479+0000","last_deep_scrub":"29'900","last_deep_scrub_stamp":"2024-01-18T00:48:42.797479+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.797479+0000","objects_scrubbed":3,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:33:21.964987+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":4520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'794","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.874758+0000","last_change":"2024-01-18T00:48:49.874884+0000","last_active":"2024-01-18T00:48:49.874758+0000","last_peered":"2024-01-18T00:48:49.874758+0000","last_clean":"2024-01-18T00:48:49.874758+0000","last_became_active":"2024-01-17T23:00:24.763974+0000","last_became_peered":"2024-01-17T23:00:24.763974+0000","last_unstale":"2024-01-18T00:48:49.874758+0000","last_undegraded":"2024-01-18T00:48:49.874758+0000","last_fullsized":"2024-01-18T00:48:49.874758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'794","last_scrub_stamp":"2024-01-18T00:48:49.874501+0000","last_deep_scrub":"29'794","last_deep_scrub_stamp":"2024-01-18T00:48:49.874501+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.874501+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:08:19.382199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":97239,"num_write":779,"num_write_kb":123325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'235","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.232481+0000","last_change":"2024-01-18T00:48:56.232540+0000","last_active":"2024-01-18T00:48:56.232481+0000","last_peered":"2024-01-18T00:48:56.232481+0000","last_clean":"2024-01-18T00:48:56.232481+0000","last_became_active":"2024-01-17T23:00:18.502139+0000","last_became_peered":"2024-01-17T23:00:18.502139+0000","last_unstale":"2024-01-18T00:48:56.232481+0000","last_undegraded":"2024-01-18T00:48:56.232481+0000","last_fullsized":"2024-01-18T00:48:56.232481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'235","last_scrub_stamp":"2024-01-18T00:48:56.232309+0000","last_deep_scrub":"29'235","last_deep_scrub_stamp":"2024-01-18T00:48:56.232309+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.232309+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:12:20.478857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'693","reported_seq":768,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:43.557670+0000","last_change":"2024-01-18T00:48:43.557706+0000","last_active":"2024-01-18T00:48:43.557670+0000","last_peered":"2024-01-18T00:48:43.557670+0000","last_clean":"2024-01-18T00:48:43.557670+0000","last_became_active":"2024-01-17T23:00:17.441805+0000","last_became_peered":"2024-01-17T23:00:17.441805+0000","last_unstale":"2024-01-18T00:48:43.557670+0000","last_undegraded":"2024-01-18T00:48:43.557670+0000","last_fullsized":"2024-01-18T00:48:43.557670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'693","last_scrub_stamp":"2024-01-18T00:48:43.557606+0000","last_deep_scrub":"29'693","last_deep_scrub_stamp":"2024-01-18T00:48:43.557606+0000","last_clean_scrub_stamp":"2024-01-18T00:48:43.557606+0000","objects_scrubbed":10,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:40:50.492143+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":8522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'857","reported_seq":1002,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.156443+0000","last_change":"2024-01-18T00:48:51.156465+0000","last_active":"2024-01-18T00:48:51.156443+0000","last_peered":"2024-01-18T00:48:51.156443+0000","last_clean":"2024-01-18T00:48:51.156443+0000","last_became_active":"2024-01-17T23:00:24.770602+0000","last_became_peered":"2024-01-17T23:00:24.770602+0000","last_unstale":"2024-01-18T00:48:51.156443+0000","last_undegraded":"2024-01-18T00:48:51.156443+0000","last_fullsized":"2024-01-18T00:48:51.156443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'857","last_scrub_stamp":"2024-01-18T00:48:51.156366+0000","last_deep_scrub":"29'857","last_deep_scrub_stamp":"2024-01-18T00:48:51.156366+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.156366+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:16.566762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":269459,"num_write":851,"num_write_kb":222567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'221","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.109178+0000","last_change":"2024-01-18T00:48:54.109235+0000","last_active":"2024-01-18T00:48:54.109178+0000","last_peered":"2024-01-18T00:48:54.109178+0000","last_clean":"2024-01-18T00:48:54.109178+0000","last_became_active":"2024-01-17T23:00:20.214392+0000","last_became_peered":"2024-01-17T23:00:20.214392+0000","last_unstale":"2024-01-18T00:48:54.109178+0000","last_undegraded":"2024-01-18T00:48:54.109178+0000","last_fullsized":"2024-01-18T00:48:54.109178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-01-18T00:48:54.109003+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-01-18T00:48:54.109003+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.109003+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:11:41.554207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'62","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.151989+0000","last_change":"2024-01-18T00:48:47.152056+0000","last_active":"2024-01-18T00:48:47.151989+0000","last_peered":"2024-01-18T00:48:47.151989+0000","last_clean":"2024-01-18T00:48:47.151989+0000","last_became_active":"2024-01-17T23:00:17.371523+0000","last_became_peered":"2024-01-17T23:00:17.371523+0000","last_unstale":"2024-01-18T00:48:47.151989+0000","last_undegraded":"2024-01-18T00:48:47.151989+0000","last_fullsized":"2024-01-18T00:48:47.151989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'62","last_scrub_stamp":"2024-01-18T00:48:47.151827+0000","last_deep_scrub":"29'62","last_deep_scrub_stamp":"2024-01-18T00:48:47.151827+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.151827+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:12:09.637263+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'837","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:59.061729+0000","last_change":"2024-01-18T00:48:59.061751+0000","last_active":"2024-01-18T00:48:59.061729+0000","last_peered":"2024-01-18T00:48:59.061729+0000","last_clean":"2024-01-18T00:48:59.061729+0000","last_became_active":"2024-01-17T23:00:24.768774+0000","last_became_peered":"2024-01-17T23:00:24.768774+0000","last_unstale":"2024-01-18T00:48:59.061729+0000","last_undegraded":"2024-01-18T00:48:59.061729+0000","last_fullsized":"2024-01-18T00:48:59.061729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2024-01-18T00:48:59.061658+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2024-01-18T00:48:59.061658+0000","last_clean_scrub_stamp":"2024-01-18T00:48:59.061658+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:10:23.831630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":113711,"num_write":815,"num_write_kb":156781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'196","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:57.270278+0000","last_change":"2024-01-18T00:48:57.270334+0000","last_active":"2024-01-18T00:48:57.270278+0000","last_peered":"2024-01-18T00:48:57.270278+0000","last_clean":"2024-01-18T00:48:57.270278+0000","last_became_active":"2024-01-17T23:00:18.503318+0000","last_became_peered":"2024-01-17T23:00:18.503318+0000","last_unstale":"2024-01-18T00:48:57.270278+0000","last_undegraded":"2024-01-18T00:48:57.270278+0000","last_fullsized":"2024-01-18T00:48:57.270278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-01-18T00:48:57.270108+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-01-18T00:48:57.270108+0000","last_clean_scrub_stamp":"2024-01-18T00:48:57.270108+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:23:27.881850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'57","reported_seq":132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.082457+0000","last_change":"2024-01-18T00:48:48.082519+0000","last_active":"2024-01-18T00:48:48.082457+0000","last_peered":"2024-01-18T00:48:48.082457+0000","last_clean":"2024-01-18T00:48:48.082457+0000","last_became_active":"2024-01-17T23:00:17.368588+0000","last_became_peered":"2024-01-17T23:00:17.368588+0000","last_unstale":"2024-01-18T00:48:48.082457+0000","last_undegraded":"2024-01-18T00:48:48.082457+0000","last_fullsized":"2024-01-18T00:48:48.082457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'57","last_scrub_stamp":"2024-01-18T00:48:48.082297+0000","last_deep_scrub":"29'57","last_deep_scrub_stamp":"2024-01-18T00:48:48.082297+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.082297+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:58:35.947597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'693","reported_seq":793,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:58.065676+0000","last_change":"2024-01-18T00:48:58.065698+0000","last_active":"2024-01-18T00:48:58.065676+0000","last_peered":"2024-01-18T00:48:58.065676+0000","last_clean":"2024-01-18T00:48:58.065676+0000","last_became_active":"2024-01-17T23:00:24.768060+0000","last_became_peered":"2024-01-17T23:00:24.768060+0000","last_unstale":"2024-01-18T00:48:58.065676+0000","last_undegraded":"2024-01-18T00:48:58.065676+0000","last_fullsized":"2024-01-18T00:48:58.065676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'693","last_scrub_stamp":"2024-01-18T00:48:58.065609+0000","last_deep_scrub":"29'693","last_deep_scrub_stamp":"2024-01-18T00:48:58.065609+0000","last_clean_scrub_stamp":"2024-01-18T00:48:58.065609+0000","objects_scrubbed":0,"log_size":693,"log_dups_size":0,"ondisk_log_size":693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:07:15.451476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":99783,"num_write":680,"num_write_kb":117554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'204","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.120151+0000","last_change":"2024-01-18T00:48:50.120189+0000","last_active":"2024-01-18T00:48:50.120151+0000","last_peered":"2024-01-18T00:48:50.120151+0000","last_clean":"2024-01-18T00:48:50.120151+0000","last_became_active":"2024-01-17T23:00:18.564969+0000","last_became_peered":"2024-01-17T23:00:18.564969+0000","last_unstale":"2024-01-18T00:48:50.120151+0000","last_undegraded":"2024-01-18T00:48:50.120151+0000","last_fullsized":"2024-01-18T00:48:50.120151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-01-18T00:48:50.120035+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-01-18T00:48:50.120035+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.120035+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:02:28.040301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'386","reported_seq":461,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:40.078738+0000","last_change":"2024-01-18T00:48:40.078766+0000","last_active":"2024-01-18T00:48:40.078738+0000","last_peered":"2024-01-18T00:48:40.078738+0000","last_clean":"2024-01-18T00:48:40.078738+0000","last_became_active":"2024-01-17T23:00:17.456888+0000","last_became_peered":"2024-01-17T23:00:17.456888+0000","last_unstale":"2024-01-18T00:48:40.078738+0000","last_undegraded":"2024-01-18T00:48:40.078738+0000","last_fullsized":"2024-01-18T00:48:40.078738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'386","last_scrub_stamp":"2024-01-18T00:48:40.078681+0000","last_deep_scrub":"29'386","last_deep_scrub_stamp":"2024-01-18T00:48:40.078681+0000","last_clean_scrub_stamp":"2024-01-18T00:48:40.078681+0000","objects_scrubbed":6,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:22:31.242350+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":8330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'671","reported_seq":744,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:59.068573+0000","last_change":"2024-01-18T00:48:59.068639+0000","last_active":"2024-01-18T00:48:59.068573+0000","last_peered":"2024-01-18T00:48:59.068573+0000","last_clean":"2024-01-18T00:48:59.068573+0000","last_became_active":"2024-01-17T23:00:24.769900+0000","last_became_peered":"2024-01-17T23:00:24.769900+0000","last_unstale":"2024-01-18T00:48:59.068573+0000","last_undegraded":"2024-01-18T00:48:59.068573+0000","last_fullsized":"2024-01-18T00:48:59.068573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'671","last_scrub_stamp":"2024-01-18T00:48:59.068403+0000","last_deep_scrub":"29'671","last_deep_scrub_stamp":"2024-01-18T00:48:59.068403+0000","last_clean_scrub_stamp":"2024-01-18T00:48:59.068403+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:15:54.769021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10831,"num_write":657,"num_write_kb":42746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'207","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:01.286178+0000","last_change":"2024-01-18T00:49:01.286178+0000","last_active":"2024-01-18T00:49:01.286178+0000","last_peered":"2024-01-18T00:49:01.286178+0000","last_clean":"2024-01-18T00:49:01.286178+0000","last_became_active":"2024-01-17T23:00:18.559812+0000","last_became_peered":"2024-01-17T23:00:18.559812+0000","last_unstale":"2024-01-18T00:49:01.286178+0000","last_undegraded":"2024-01-18T00:49:01.286178+0000","last_fullsized":"2024-01-18T00:49:01.286178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-01-18T00:49:01.285960+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-01-18T00:49:01.285960+0000","last_clean_scrub_stamp":"2024-01-18T00:49:01.285960+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:49:45.974750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'1384","reported_seq":1459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.240512+0000","last_change":"2024-01-18T00:48:45.240588+0000","last_active":"2024-01-18T00:48:45.240512+0000","last_peered":"2024-01-18T00:48:45.240512+0000","last_clean":"2024-01-18T00:48:45.240512+0000","last_became_active":"2024-01-17T23:00:17.368092+0000","last_became_peered":"2024-01-17T23:00:17.368092+0000","last_unstale":"2024-01-18T00:48:45.240512+0000","last_undegraded":"2024-01-18T00:48:45.240512+0000","last_fullsized":"2024-01-18T00:48:45.240512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1384","last_scrub_stamp":"2024-01-18T00:48:45.240356+0000","last_deep_scrub":"29'1384","last_deep_scrub_stamp":"2024-01-18T00:48:45.240356+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.240356+0000","objects_scrubbed":7,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:05:17.699278+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'774","reported_seq":860,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:01.017257+0000","last_change":"2024-01-18T00:49:01.017323+0000","last_active":"2024-01-18T00:49:01.017257+0000","last_peered":"2024-01-18T00:49:01.017257+0000","last_clean":"2024-01-18T00:49:01.017257+0000","last_became_active":"2024-01-17T23:00:34.687787+0000","last_became_peered":"2024-01-17T23:00:34.687787+0000","last_unstale":"2024-01-18T00:49:01.017257+0000","last_undegraded":"2024-01-18T00:49:01.017257+0000","last_fullsized":"2024-01-18T00:49:01.017257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'774","last_scrub_stamp":"2024-01-18T00:49:01.017093+0000","last_deep_scrub":"29'774","last_deep_scrub_stamp":"2024-01-18T00:49:01.017093+0000","last_clean_scrub_stamp":"2024-01-18T00:49:01.017093+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:13:01.022853+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":74308,"num_write":753,"num_write_kb":109365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,0],"acting":[5,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"29'200","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.811424+0000","last_change":"2024-01-18T00:48:45.811535+0000","last_active":"2024-01-18T00:48:45.811424+0000","last_peered":"2024-01-18T00:48:45.811424+0000","last_clean":"2024-01-18T00:48:45.811424+0000","last_became_active":"2024-01-17T23:00:18.498761+0000","last_became_peered":"2024-01-17T23:00:18.498761+0000","last_unstale":"2024-01-18T00:48:45.811424+0000","last_undegraded":"2024-01-18T00:48:45.811424+0000","last_fullsized":"2024-01-18T00:48:45.811424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-01-18T00:48:45.811163+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-01-18T00:48:45.811163+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.811163+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:34:04.250412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'1527","reported_seq":1601,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.941342+0000","last_change":"2024-01-18T00:48:44.941342+0000","last_active":"2024-01-18T00:48:44.941342+0000","last_peered":"2024-01-18T00:48:44.941342+0000","last_clean":"2024-01-18T00:48:44.941342+0000","last_became_active":"2024-01-17T23:00:17.454509+0000","last_became_peered":"2024-01-17T23:00:17.454509+0000","last_unstale":"2024-01-18T00:48:44.941342+0000","last_undegraded":"2024-01-18T00:48:44.941342+0000","last_fullsized":"2024-01-18T00:48:44.941342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1527","last_scrub_stamp":"2024-01-18T00:48:44.941251+0000","last_deep_scrub":"29'1527","last_deep_scrub_stamp":"2024-01-18T00:48:44.941251+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.941251+0000","objects_scrubbed":4,"log_size":1527,"log_dups_size":0,"ondisk_log_size":1527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:59:37.157132+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1467,"num_write_kb":5420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'735","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.890974+0000","last_change":"2024-01-18T00:48:50.891036+0000","last_active":"2024-01-18T00:48:50.890974+0000","last_peered":"2024-01-18T00:48:50.890974+0000","last_clean":"2024-01-18T00:48:50.890974+0000","last_became_active":"2024-01-17T23:00:24.758087+0000","last_became_peered":"2024-01-17T23:00:24.758087+0000","last_unstale":"2024-01-18T00:48:50.890974+0000","last_undegraded":"2024-01-18T00:48:50.890974+0000","last_fullsized":"2024-01-18T00:48:50.890974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'735","last_scrub_stamp":"2024-01-18T00:48:50.890799+0000","last_deep_scrub":"29'735","last_deep_scrub_stamp":"2024-01-18T00:48:50.890799+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.890799+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:49:04.913397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":70860,"num_write":724,"num_write_kb":90941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'207","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.125860+0000","last_change":"2024-01-18T00:48:48.125860+0000","last_active":"2024-01-18T00:48:48.125860+0000","last_peered":"2024-01-18T00:48:48.125860+0000","last_clean":"2024-01-18T00:48:48.125860+0000","last_became_active":"2024-01-17T23:00:18.561318+0000","last_became_peered":"2024-01-17T23:00:18.561318+0000","last_unstale":"2024-01-18T00:48:48.125860+0000","last_undegraded":"2024-01-18T00:48:48.125860+0000","last_fullsized":"2024-01-18T00:48:48.125860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-01-18T00:48:48.125776+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-01-18T00:48:48.125776+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.125776+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:40:43.664426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'162","reported_seq":236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.070791+0000","last_change":"2024-01-18T00:48:49.070791+0000","last_active":"2024-01-18T00:48:49.070791+0000","last_peered":"2024-01-18T00:48:49.070791+0000","last_clean":"2024-01-18T00:48:49.070791+0000","last_became_active":"2024-01-17T23:00:17.369598+0000","last_became_peered":"2024-01-17T23:00:17.369598+0000","last_unstale":"2024-01-18T00:48:49.070791+0000","last_undegraded":"2024-01-18T00:48:49.070791+0000","last_fullsized":"2024-01-18T00:48:49.070791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'162","last_scrub_stamp":"2024-01-18T00:48:49.070558+0000","last_deep_scrub":"29'162","last_deep_scrub_stamp":"2024-01-18T00:48:49.070558+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.070558+0000","objects_scrubbed":2,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:59:41.286438+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":4146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'831","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:00.984239+0000","last_change":"2024-01-18T00:49:00.984260+0000","last_active":"2024-01-18T00:49:00.984239+0000","last_peered":"2024-01-18T00:49:00.984239+0000","last_clean":"2024-01-18T00:49:00.984239+0000","last_became_active":"2024-01-17T23:00:24.773712+0000","last_became_peered":"2024-01-17T23:00:24.773712+0000","last_unstale":"2024-01-18T00:49:00.984239+0000","last_undegraded":"2024-01-18T00:49:00.984239+0000","last_fullsized":"2024-01-18T00:49:00.984239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'831","last_scrub_stamp":"2024-01-18T00:49:00.984168+0000","last_deep_scrub":"29'831","last_deep_scrub_stamp":"2024-01-18T00:49:00.984168+0000","last_clean_scrub_stamp":"2024-01-18T00:49:00.984168+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:08:49.151836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":102827,"num_write":809,"num_write_kb":147366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'212","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.020443+0000","last_change":"2024-01-18T00:48:45.020443+0000","last_active":"2024-01-18T00:48:45.020443+0000","last_peered":"2024-01-18T00:48:45.020443+0000","last_clean":"2024-01-18T00:48:45.020443+0000","last_became_active":"2024-01-17T23:00:18.495345+0000","last_became_peered":"2024-01-17T23:00:18.495345+0000","last_unstale":"2024-01-18T00:48:45.020443+0000","last_undegraded":"2024-01-18T00:48:45.020443+0000","last_fullsized":"2024-01-18T00:48:45.020443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-01-18T00:48:45.020130+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-01-18T00:48:45.020130+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.020130+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:40:29.426180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'44","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.176696+0000","last_change":"2024-01-18T00:48:48.176696+0000","last_active":"2024-01-18T00:48:48.176696+0000","last_peered":"2024-01-18T00:48:48.176696+0000","last_clean":"2024-01-18T00:48:48.176696+0000","last_became_active":"2024-01-17T23:00:17.374121+0000","last_became_peered":"2024-01-17T23:00:17.374121+0000","last_unstale":"2024-01-18T00:48:48.176696+0000","last_undegraded":"2024-01-18T00:48:48.176696+0000","last_fullsized":"2024-01-18T00:48:48.176696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2024-01-18T00:48:48.176471+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2024-01-18T00:48:48.176471+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.176471+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:59:28.912827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'822","reported_seq":922,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:57.029734+0000","last_change":"2024-01-18T00:48:57.029755+0000","last_active":"2024-01-18T00:48:57.029734+0000","last_peered":"2024-01-18T00:48:57.029734+0000","last_clean":"2024-01-18T00:48:57.029734+0000","last_became_active":"2024-01-17T23:00:24.768020+0000","last_became_peered":"2024-01-17T23:00:24.768020+0000","last_unstale":"2024-01-18T00:48:57.029734+0000","last_undegraded":"2024-01-18T00:48:57.029734+0000","last_fullsized":"2024-01-18T00:48:57.029734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'822","last_scrub_stamp":"2024-01-18T00:48:57.029673+0000","last_deep_scrub":"29'822","last_deep_scrub_stamp":"2024-01-18T00:48:57.029673+0000","last_clean_scrub_stamp":"2024-01-18T00:48:57.029673+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:12:57.035433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":80488,"num_write":796,"num_write_kb":101657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'736","reported_seq":837,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.148833+0000","last_change":"2024-01-18T00:48:53.148833+0000","last_active":"2024-01-18T00:48:53.148833+0000","last_peered":"2024-01-18T00:48:53.148833+0000","last_clean":"2024-01-18T00:48:53.148833+0000","last_became_active":"2024-01-17T23:00:24.777774+0000","last_became_peered":"2024-01-17T23:00:24.777774+0000","last_unstale":"2024-01-18T00:48:53.148833+0000","last_undegraded":"2024-01-18T00:48:53.148833+0000","last_fullsized":"2024-01-18T00:48:53.148833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'736","last_scrub_stamp":"2024-01-18T00:48:53.148740+0000","last_deep_scrub":"29'736","last_deep_scrub_stamp":"2024-01-18T00:48:53.148740+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.148740+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:07:38.922593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":63205,"num_write":717,"num_write_kb":100634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'215","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.944674+0000","last_change":"2024-01-18T00:48:46.944695+0000","last_active":"2024-01-18T00:48:46.944674+0000","last_peered":"2024-01-18T00:48:46.944674+0000","last_clean":"2024-01-18T00:48:46.944674+0000","last_became_active":"2024-01-17T23:00:19.816281+0000","last_became_peered":"2024-01-17T23:00:19.816281+0000","last_unstale":"2024-01-18T00:48:46.944674+0000","last_undegraded":"2024-01-18T00:48:46.944674+0000","last_fullsized":"2024-01-18T00:48:46.944674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-01-18T00:48:46.944611+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-01-18T00:48:46.944611+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.944611+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:12.355007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'1201","reported_seq":1275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.120604+0000","last_change":"2024-01-18T00:48:46.120604+0000","last_active":"2024-01-18T00:48:46.120604+0000","last_peered":"2024-01-18T00:48:46.120604+0000","last_clean":"2024-01-18T00:48:46.120604+0000","last_became_active":"2024-01-17T23:00:17.366304+0000","last_became_peered":"2024-01-17T23:00:17.366304+0000","last_unstale":"2024-01-18T00:48:46.120604+0000","last_undegraded":"2024-01-18T00:48:46.120604+0000","last_fullsized":"2024-01-18T00:48:46.120604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1201","last_scrub_stamp":"2024-01-18T00:48:46.120254+0000","last_deep_scrub":"29'1201","last_deep_scrub_stamp":"2024-01-18T00:48:46.120254+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.120254+0000","objects_scrubbed":3,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:21:48.484060+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'702","reported_seq":810,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:58.162192+0000","last_change":"2024-01-18T00:48:58.162252+0000","last_active":"2024-01-18T00:48:58.162192+0000","last_peered":"2024-01-18T00:48:58.162192+0000","last_clean":"2024-01-18T00:48:58.162192+0000","last_became_active":"2024-01-17T23:00:24.762631+0000","last_became_peered":"2024-01-17T23:00:24.762631+0000","last_unstale":"2024-01-18T00:48:58.162192+0000","last_undegraded":"2024-01-18T00:48:58.162192+0000","last_fullsized":"2024-01-18T00:48:58.162192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'702","last_scrub_stamp":"2024-01-18T00:48:58.162020+0000","last_deep_scrub":"29'702","last_deep_scrub_stamp":"2024-01-18T00:48:58.162020+0000","last_clean_scrub_stamp":"2024-01-18T00:48:58.162020+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:32:49.511490+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":94856,"num_write":687,"num_write_kb":72747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'234","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.070602+0000","last_change":"2024-01-18T00:48:44.070602+0000","last_active":"2024-01-18T00:48:44.070602+0000","last_peered":"2024-01-18T00:48:44.070602+0000","last_clean":"2024-01-18T00:48:44.070602+0000","last_became_active":"2024-01-17T23:00:20.212972+0000","last_became_peered":"2024-01-17T23:00:20.212972+0000","last_unstale":"2024-01-18T00:48:44.070602+0000","last_undegraded":"2024-01-18T00:48:44.070602+0000","last_fullsized":"2024-01-18T00:48:44.070602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'234","last_scrub_stamp":"2024-01-18T00:48:44.070497+0000","last_deep_scrub":"29'234","last_deep_scrub_stamp":"2024-01-18T00:48:44.070497+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.070497+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:51:00.307938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'182","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.092320+0000","last_change":"2024-01-18T00:48:46.092345+0000","last_active":"2024-01-18T00:48:46.092320+0000","last_peered":"2024-01-18T00:48:46.092320+0000","last_clean":"2024-01-18T00:48:46.092320+0000","last_became_active":"2024-01-17T23:00:17.368896+0000","last_became_peered":"2024-01-17T23:00:17.368896+0000","last_unstale":"2024-01-18T00:48:46.092320+0000","last_undegraded":"2024-01-18T00:48:46.092320+0000","last_fullsized":"2024-01-18T00:48:46.092320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2024-01-18T00:48:46.092262+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2024-01-18T00:48:46.092262+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.092262+0000","objects_scrubbed":2,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:23:15.607478+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'1541","reported_seq":1613,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.220857+0000","last_change":"2024-01-18T00:48:46.220942+0000","last_active":"2024-01-18T00:48:46.220857+0000","last_peered":"2024-01-18T00:48:46.220857+0000","last_clean":"2024-01-18T00:48:46.220857+0000","last_became_active":"2024-01-17T23:00:17.369609+0000","last_became_peered":"2024-01-17T23:00:17.369609+0000","last_unstale":"2024-01-18T00:48:46.220857+0000","last_undegraded":"2024-01-18T00:48:46.220857+0000","last_fullsized":"2024-01-18T00:48:46.220857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1541","last_scrub_stamp":"2024-01-18T00:48:46.220655+0000","last_deep_scrub":"29'1541","last_deep_scrub_stamp":"2024-01-18T00:48:46.220655+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.220655+0000","objects_scrubbed":5,"log_size":1541,"log_dups_size":0,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:28:09.793640+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16109257,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":16502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'179","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.115490+0000","last_change":"2024-01-18T00:48:47.115523+0000","last_active":"2024-01-18T00:48:47.115490+0000","last_peered":"2024-01-18T00:48:47.115490+0000","last_clean":"2024-01-18T00:48:47.115490+0000","last_became_active":"2024-01-17T23:00:18.560659+0000","last_became_peered":"2024-01-17T23:00:18.560659+0000","last_unstale":"2024-01-18T00:48:47.115490+0000","last_undegraded":"2024-01-18T00:48:47.115490+0000","last_fullsized":"2024-01-18T00:48:47.115490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'179","last_scrub_stamp":"2024-01-18T00:48:47.115396+0000","last_deep_scrub":"29'179","last_deep_scrub_stamp":"2024-01-18T00:48:47.115396+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.115396+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:51:03.352837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'748","reported_seq":862,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.573351+0000","last_change":"2024-01-18T00:48:50.573374+0000","last_active":"2024-01-18T00:48:50.573351+0000","last_peered":"2024-01-18T00:48:50.573351+0000","last_clean":"2024-01-18T00:48:50.573351+0000","last_became_active":"2024-01-17T23:00:34.460675+0000","last_became_peered":"2024-01-17T23:00:34.460675+0000","last_unstale":"2024-01-18T00:48:50.573351+0000","last_undegraded":"2024-01-18T00:48:50.573351+0000","last_fullsized":"2024-01-18T00:48:50.573351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'748","last_scrub_stamp":"2024-01-18T00:48:50.573280+0000","last_deep_scrub":"29'748","last_deep_scrub_stamp":"2024-01-18T00:48:50.573280+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.573280+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T03:16:16.326854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":128829,"num_write":735,"num_write_kb":187979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'219","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.051621+0000","last_change":"2024-01-18T00:48:48.051645+0000","last_active":"2024-01-18T00:48:48.051621+0000","last_peered":"2024-01-18T00:48:48.051621+0000","last_clean":"2024-01-18T00:48:48.051621+0000","last_became_active":"2024-01-17T23:00:17.456501+0000","last_became_peered":"2024-01-17T23:00:17.456501+0000","last_unstale":"2024-01-18T00:48:48.051621+0000","last_undegraded":"2024-01-18T00:48:48.051621+0000","last_fullsized":"2024-01-18T00:48:48.051621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'219","last_scrub_stamp":"2024-01-18T00:48:48.051563+0000","last_deep_scrub":"29'219","last_deep_scrub_stamp":"2024-01-18T00:48:48.051563+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.051563+0000","objects_scrubbed":3,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:52:13.461959+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'196","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:43.799765+0000","last_change":"2024-01-18T00:48:43.799884+0000","last_active":"2024-01-18T00:48:43.799765+0000","last_peered":"2024-01-18T00:48:43.799765+0000","last_clean":"2024-01-18T00:48:43.799765+0000","last_became_active":"2024-01-17T23:00:18.358144+0000","last_became_peered":"2024-01-17T23:00:18.358144+0000","last_unstale":"2024-01-18T00:48:43.799765+0000","last_undegraded":"2024-01-18T00:48:43.799765+0000","last_fullsized":"2024-01-18T00:48:43.799765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-01-18T00:48:43.799494+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-01-18T00:48:43.799494+0000","last_clean_scrub_stamp":"2024-01-18T00:48:43.799494+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:39:24.016149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'730","reported_seq":820,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:00.029299+0000","last_change":"2024-01-18T00:49:00.029322+0000","last_active":"2024-01-18T00:49:00.029299+0000","last_peered":"2024-01-18T00:49:00.029299+0000","last_clean":"2024-01-18T00:49:00.029299+0000","last_became_active":"2024-01-17T23:00:24.773703+0000","last_became_peered":"2024-01-17T23:00:24.773703+0000","last_unstale":"2024-01-18T00:49:00.029299+0000","last_undegraded":"2024-01-18T00:49:00.029299+0000","last_fullsized":"2024-01-18T00:49:00.029299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'730","last_scrub_stamp":"2024-01-18T00:49:00.029215+0000","last_deep_scrub":"29'730","last_deep_scrub_stamp":"2024-01-18T00:49:00.029215+0000","last_clean_scrub_stamp":"2024-01-18T00:49:00.029215+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:24:02.719452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":53396,"num_write":716,"num_write_kb":86798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'217","reported_seq":296,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.129479+0000","last_change":"2024-01-18T00:48:55.129540+0000","last_active":"2024-01-18T00:48:55.129479+0000","last_peered":"2024-01-18T00:48:55.129479+0000","last_clean":"2024-01-18T00:48:55.129479+0000","last_became_active":"2024-01-17T23:00:20.214585+0000","last_became_peered":"2024-01-17T23:00:20.214585+0000","last_unstale":"2024-01-18T00:48:55.129479+0000","last_undegraded":"2024-01-18T00:48:55.129479+0000","last_fullsized":"2024-01-18T00:48:55.129479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'217","last_scrub_stamp":"2024-01-18T00:48:55.129320+0000","last_deep_scrub":"29'217","last_deep_scrub_stamp":"2024-01-18T00:48:55.129320+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.129320+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:18:30.156177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'221","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.571774+0000","last_change":"2024-01-18T00:48:44.571813+0000","last_active":"2024-01-18T00:48:44.571774+0000","last_peered":"2024-01-18T00:48:44.571774+0000","last_clean":"2024-01-18T00:48:44.571774+0000","last_became_active":"2024-01-17T23:00:18.485770+0000","last_became_peered":"2024-01-17T23:00:18.485770+0000","last_unstale":"2024-01-18T00:48:44.571774+0000","last_undegraded":"2024-01-18T00:48:44.571774+0000","last_fullsized":"2024-01-18T00:48:44.571774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-01-18T00:48:44.571677+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-01-18T00:48:44.571677+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.571677+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T00:55:12.815035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'227","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.080225+0000","last_change":"2024-01-18T00:48:55.080283+0000","last_active":"2024-01-18T00:48:55.080225+0000","last_peered":"2024-01-18T00:48:55.080225+0000","last_clean":"2024-01-18T00:48:55.080225+0000","last_became_active":"2024-01-17T23:00:18.563167+0000","last_became_peered":"2024-01-17T23:00:18.563167+0000","last_unstale":"2024-01-18T00:48:55.080225+0000","last_undegraded":"2024-01-18T00:48:55.080225+0000","last_fullsized":"2024-01-18T00:48:55.080225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'227","last_scrub_stamp":"2024-01-18T00:48:55.080071+0000","last_deep_scrub":"29'227","last_deep_scrub_stamp":"2024-01-18T00:48:55.080071+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.080071+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:12:19.326619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'198","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:43.034414+0000","last_change":"2024-01-18T00:48:43.034434+0000","last_active":"2024-01-18T00:48:43.034414+0000","last_peered":"2024-01-18T00:48:43.034414+0000","last_clean":"2024-01-18T00:48:43.034414+0000","last_became_active":"2024-01-17T23:00:18.558444+0000","last_became_peered":"2024-01-17T23:00:18.558444+0000","last_unstale":"2024-01-18T00:48:43.034414+0000","last_undegraded":"2024-01-18T00:48:43.034414+0000","last_fullsized":"2024-01-18T00:48:43.034414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-01-18T00:48:43.034347+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-01-18T00:48:43.034347+0000","last_clean_scrub_stamp":"2024-01-18T00:48:43.034347+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T05:52:13.090763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'184","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.885188+0000","last_change":"2024-01-18T00:48:54.885188+0000","last_active":"2024-01-18T00:48:54.885188+0000","last_peered":"2024-01-18T00:48:54.885188+0000","last_clean":"2024-01-18T00:48:54.885188+0000","last_became_active":"2024-01-17T23:00:34.116473+0000","last_became_peered":"2024-01-17T23:00:34.116473+0000","last_unstale":"2024-01-18T00:48:54.885188+0000","last_undegraded":"2024-01-18T00:48:54.885188+0000","last_fullsized":"2024-01-18T00:48:54.885188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'184","last_scrub_stamp":"2024-01-18T00:48:54.885102+0000","last_deep_scrub":"29'184","last_deep_scrub_stamp":"2024-01-18T00:48:54.885102+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.885102+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:12:54.890862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"29'201","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.959863+0000","last_change":"2024-01-18T00:48:47.959886+0000","last_active":"2024-01-18T00:48:47.959863+0000","last_peered":"2024-01-18T00:48:47.959863+0000","last_clean":"2024-01-18T00:48:47.959863+0000","last_became_active":"2024-01-17T23:00:19.816355+0000","last_became_peered":"2024-01-17T23:00:19.816355+0000","last_unstale":"2024-01-18T00:48:47.959863+0000","last_undegraded":"2024-01-18T00:48:47.959863+0000","last_fullsized":"2024-01-18T00:48:47.959863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-01-18T00:48:47.959796+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-01-18T00:48:47.959796+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.959796+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:05:08.332884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'239","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.150107+0000","last_change":"2024-01-18T00:48:56.150216+0000","last_active":"2024-01-18T00:48:56.150107+0000","last_peered":"2024-01-18T00:48:56.150107+0000","last_clean":"2024-01-18T00:48:56.150107+0000","last_became_active":"2024-01-17T23:00:20.244650+0000","last_became_peered":"2024-01-17T23:00:20.244650+0000","last_unstale":"2024-01-18T00:48:56.150107+0000","last_undegraded":"2024-01-18T00:48:56.150107+0000","last_fullsized":"2024-01-18T00:48:56.150107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'239","last_scrub_stamp":"2024-01-18T00:48:56.149853+0000","last_deep_scrub":"29'239","last_deep_scrub_stamp":"2024-01-18T00:48:56.149853+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.149853+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:05:16.522940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'202","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.115520+0000","last_change":"2024-01-18T00:48:45.115541+0000","last_active":"2024-01-18T00:48:45.115520+0000","last_peered":"2024-01-18T00:48:45.115520+0000","last_clean":"2024-01-18T00:48:45.115520+0000","last_became_active":"2024-01-17T23:00:19.908766+0000","last_became_peered":"2024-01-17T23:00:19.908766+0000","last_unstale":"2024-01-18T00:48:45.115520+0000","last_undegraded":"2024-01-18T00:48:45.115520+0000","last_fullsized":"2024-01-18T00:48:45.115520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-01-18T00:48:45.115459+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-01-18T00:48:45.115459+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.115459+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T04:40:40.654109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'211","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.592679+0000","last_change":"2024-01-18T00:48:46.592699+0000","last_active":"2024-01-18T00:48:46.592679+0000","last_peered":"2024-01-18T00:48:46.592679+0000","last_clean":"2024-01-18T00:48:46.592679+0000","last_became_active":"2024-01-17T23:00:34.196599+0000","last_became_peered":"2024-01-17T23:00:34.196599+0000","last_unstale":"2024-01-18T00:48:46.592679+0000","last_undegraded":"2024-01-18T00:48:46.592679+0000","last_fullsized":"2024-01-18T00:48:46.592679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-01-18T00:48:46.592613+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-01-18T00:48:46.592613+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.592613+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:00:04.044278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"29'200","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:43.023497+0000","last_change":"2024-01-18T00:48:43.023543+0000","last_active":"2024-01-18T00:48:43.023497+0000","last_peered":"2024-01-18T00:48:43.023497+0000","last_clean":"2024-01-18T00:48:43.023497+0000","last_became_active":"2024-01-17T23:00:19.909991+0000","last_became_peered":"2024-01-17T23:00:19.909991+0000","last_unstale":"2024-01-18T00:48:43.023497+0000","last_undegraded":"2024-01-18T00:48:43.023497+0000","last_fullsized":"2024-01-18T00:48:43.023497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-01-18T00:48:43.023386+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-01-18T00:48:43.023386+0000","last_clean_scrub_stamp":"2024-01-18T00:48:43.023386+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:08:22.817364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'201","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.057378+0000","last_change":"2024-01-18T00:48:53.057429+0000","last_active":"2024-01-18T00:48:53.057378+0000","last_peered":"2024-01-18T00:48:53.057378+0000","last_clean":"2024-01-18T00:48:53.057378+0000","last_became_active":"2024-01-17T23:00:18.493028+0000","last_became_peered":"2024-01-17T23:00:18.493028+0000","last_unstale":"2024-01-18T00:48:53.057378+0000","last_undegraded":"2024-01-18T00:48:53.057378+0000","last_fullsized":"2024-01-18T00:48:53.057378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-01-18T00:48:53.057248+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-01-18T00:48:53.057248+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.057248+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:15:27.341732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'202","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.064277+0000","last_change":"2024-01-18T00:48:44.064297+0000","last_active":"2024-01-18T00:48:44.064277+0000","last_peered":"2024-01-18T00:48:44.064277+0000","last_clean":"2024-01-18T00:48:44.064277+0000","last_became_active":"2024-01-17T23:00:18.559257+0000","last_became_peered":"2024-01-17T23:00:18.559257+0000","last_unstale":"2024-01-18T00:48:44.064277+0000","last_undegraded":"2024-01-18T00:48:44.064277+0000","last_fullsized":"2024-01-18T00:48:44.064277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-01-18T00:48:44.064212+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-01-18T00:48:44.064212+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.064212+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:57:05.646515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'225","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:53.159145+0000","last_change":"2024-01-18T00:48:53.159261+0000","last_active":"2024-01-18T00:48:53.159145+0000","last_peered":"2024-01-18T00:48:53.159145+0000","last_clean":"2024-01-18T00:48:53.159145+0000","last_became_active":"2024-01-17T23:00:19.914996+0000","last_became_peered":"2024-01-17T23:00:19.914996+0000","last_unstale":"2024-01-18T00:48:53.159145+0000","last_undegraded":"2024-01-18T00:48:53.159145+0000","last_fullsized":"2024-01-18T00:48:53.159145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'225","last_scrub_stamp":"2024-01-18T00:48:53.158888+0000","last_deep_scrub":"29'225","last_deep_scrub_stamp":"2024-01-18T00:48:53.158888+0000","last_clean_scrub_stamp":"2024-01-18T00:48:53.158888+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:23:22.674104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'206","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:55.223360+0000","last_change":"2024-01-18T00:48:55.223473+0000","last_active":"2024-01-18T00:48:55.223360+0000","last_peered":"2024-01-18T00:48:55.223360+0000","last_clean":"2024-01-18T00:48:55.223360+0000","last_became_active":"2024-01-17T23:00:18.502303+0000","last_became_peered":"2024-01-17T23:00:18.502303+0000","last_unstale":"2024-01-18T00:48:55.223360+0000","last_undegraded":"2024-01-18T00:48:55.223360+0000","last_fullsized":"2024-01-18T00:48:55.223360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'206","last_scrub_stamp":"2024-01-18T00:48:55.223066+0000","last_deep_scrub":"29'206","last_deep_scrub_stamp":"2024-01-18T00:48:55.223066+0000","last_clean_scrub_stamp":"2024-01-18T00:48:55.223066+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:49:20.671198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'196","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:45.604096+0000","last_change":"2024-01-18T00:48:45.604116+0000","last_active":"2024-01-18T00:48:45.604096+0000","last_peered":"2024-01-18T00:48:45.604096+0000","last_clean":"2024-01-18T00:48:45.604096+0000","last_became_active":"2024-01-17T23:00:18.560841+0000","last_became_peered":"2024-01-17T23:00:18.560841+0000","last_unstale":"2024-01-18T00:48:45.604096+0000","last_undegraded":"2024-01-18T00:48:45.604096+0000","last_fullsized":"2024-01-18T00:48:45.604096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-01-18T00:48:45.604034+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-01-18T00:48:45.604034+0000","last_clean_scrub_stamp":"2024-01-18T00:48:45.604034+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:03:38.342846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'207","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:44.029726+0000","last_change":"2024-01-18T00:48:44.029784+0000","last_active":"2024-01-18T00:48:44.029726+0000","last_peered":"2024-01-18T00:48:44.029726+0000","last_clean":"2024-01-18T00:48:44.029726+0000","last_became_active":"2024-01-17T23:00:18.498603+0000","last_became_peered":"2024-01-17T23:00:18.498603+0000","last_unstale":"2024-01-18T00:48:44.029726+0000","last_undegraded":"2024-01-18T00:48:44.029726+0000","last_fullsized":"2024-01-18T00:48:44.029726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-01-18T00:48:44.029556+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-01-18T00:48:44.029556+0000","last_clean_scrub_stamp":"2024-01-18T00:48:44.029556+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:12:06.514992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'213","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.090492+0000","last_change":"2024-01-18T00:48:54.090552+0000","last_active":"2024-01-18T00:48:54.090492+0000","last_peered":"2024-01-18T00:48:54.090492+0000","last_clean":"2024-01-18T00:48:54.090492+0000","last_became_active":"2024-01-17T23:00:18.557727+0000","last_became_peered":"2024-01-17T23:00:18.557727+0000","last_unstale":"2024-01-18T00:48:54.090492+0000","last_undegraded":"2024-01-18T00:48:54.090492+0000","last_fullsized":"2024-01-18T00:48:54.090492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'213","last_scrub_stamp":"2024-01-18T00:48:54.090323+0000","last_deep_scrub":"29'213","last_deep_scrub_stamp":"2024-01-18T00:48:54.090323+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.090323+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T06:49:19.538455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'214","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:49.900937+0000","last_change":"2024-01-18T00:48:49.900976+0000","last_active":"2024-01-18T00:48:49.900937+0000","last_peered":"2024-01-18T00:48:49.900937+0000","last_clean":"2024-01-18T00:48:49.900937+0000","last_became_active":"2024-01-17T23:00:19.911185+0000","last_became_peered":"2024-01-17T23:00:19.911185+0000","last_unstale":"2024-01-18T00:48:49.900937+0000","last_undegraded":"2024-01-18T00:48:49.900937+0000","last_fullsized":"2024-01-18T00:48:49.900937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'214","last_scrub_stamp":"2024-01-18T00:48:49.900867+0000","last_deep_scrub":"29'214","last_deep_scrub_stamp":"2024-01-18T00:48:49.900867+0000","last_clean_scrub_stamp":"2024-01-18T00:48:49.900867+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:32:41.250337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'216","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:46.071007+0000","last_change":"2024-01-18T00:48:46.071044+0000","last_active":"2024-01-18T00:48:46.071007+0000","last_peered":"2024-01-18T00:48:46.071007+0000","last_clean":"2024-01-18T00:48:46.071007+0000","last_became_active":"2024-01-17T23:00:18.559959+0000","last_became_peered":"2024-01-17T23:00:18.559959+0000","last_unstale":"2024-01-18T00:48:46.071007+0000","last_undegraded":"2024-01-18T00:48:46.071007+0000","last_fullsized":"2024-01-18T00:48:46.071007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-01-18T00:48:46.070940+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-01-18T00:48:46.070940+0000","last_clean_scrub_stamp":"2024-01-18T00:48:46.070940+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:08:25.864918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'201","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:52.060558+0000","last_change":"2024-01-18T00:48:52.060558+0000","last_active":"2024-01-18T00:48:52.060558+0000","last_peered":"2024-01-18T00:48:52.060558+0000","last_clean":"2024-01-18T00:48:52.060558+0000","last_became_active":"2024-01-17T23:00:19.747238+0000","last_became_peered":"2024-01-17T23:00:19.747238+0000","last_unstale":"2024-01-18T00:48:52.060558+0000","last_undegraded":"2024-01-18T00:48:52.060558+0000","last_fullsized":"2024-01-18T00:48:52.060558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-01-18T00:48:52.060435+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-01-18T00:48:52.060435+0000","last_clean_scrub_stamp":"2024-01-18T00:48:52.060435+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:32:43.409905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'175","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.819426+0000","last_change":"2024-01-18T00:48:47.819426+0000","last_active":"2024-01-18T00:48:47.819426+0000","last_peered":"2024-01-18T00:48:47.819426+0000","last_clean":"2024-01-18T00:48:47.819426+0000","last_became_active":"2024-01-17T23:00:18.560132+0000","last_became_peered":"2024-01-17T23:00:18.560132+0000","last_unstale":"2024-01-18T00:48:47.819426+0000","last_undegraded":"2024-01-18T00:48:47.819426+0000","last_fullsized":"2024-01-18T00:48:47.819426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'175","last_scrub_stamp":"2024-01-18T00:48:47.819119+0000","last_deep_scrub":"29'175","last_deep_scrub_stamp":"2024-01-18T00:48:47.819119+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.819119+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:28:41.562401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'174","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:51.223201+0000","last_change":"2024-01-18T00:48:51.223201+0000","last_active":"2024-01-18T00:48:51.223201+0000","last_peered":"2024-01-18T00:48:51.223201+0000","last_clean":"2024-01-18T00:48:51.223201+0000","last_became_active":"2024-01-17T23:00:19.749330+0000","last_became_peered":"2024-01-17T23:00:19.749330+0000","last_unstale":"2024-01-18T00:48:51.223201+0000","last_undegraded":"2024-01-18T00:48:51.223201+0000","last_fullsized":"2024-01-18T00:48:51.223201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'174","last_scrub_stamp":"2024-01-18T00:48:51.222920+0000","last_deep_scrub":"29'174","last_deep_scrub_stamp":"2024-01-18T00:48:51.222920+0000","last_clean_scrub_stamp":"2024-01-18T00:48:51.222920+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T11:58:39.088221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'211","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.186583+0000","last_change":"2024-01-18T00:48:50.186583+0000","last_active":"2024-01-18T00:48:50.186583+0000","last_peered":"2024-01-18T00:48:50.186583+0000","last_clean":"2024-01-18T00:48:50.186583+0000","last_became_active":"2024-01-17T23:00:19.748213+0000","last_became_peered":"2024-01-17T23:00:19.748213+0000","last_unstale":"2024-01-18T00:48:50.186583+0000","last_undegraded":"2024-01-18T00:48:50.186583+0000","last_fullsized":"2024-01-18T00:48:50.186583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-01-18T00:48:50.186378+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-01-18T00:48:50.186378+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.186378+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:48:16.332977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'219","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:58.259969+0000","last_change":"2024-01-18T00:48:58.260025+0000","last_active":"2024-01-18T00:48:58.259969+0000","last_peered":"2024-01-18T00:48:58.259969+0000","last_clean":"2024-01-18T00:48:58.259969+0000","last_became_active":"2024-01-17T23:00:18.504143+0000","last_became_peered":"2024-01-17T23:00:18.504143+0000","last_unstale":"2024-01-18T00:48:58.259969+0000","last_undegraded":"2024-01-18T00:48:58.259969+0000","last_fullsized":"2024-01-18T00:48:58.259969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'219","last_scrub_stamp":"2024-01-18T00:48:58.259807+0000","last_deep_scrub":"29'219","last_deep_scrub_stamp":"2024-01-18T00:48:58.259807+0000","last_clean_scrub_stamp":"2024-01-18T00:48:58.259807+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:26:58.927945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'198","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.025818+0000","last_change":"2024-01-18T00:48:50.025838+0000","last_active":"2024-01-18T00:48:50.025818+0000","last_peered":"2024-01-18T00:48:50.025818+0000","last_clean":"2024-01-18T00:48:50.025818+0000","last_became_active":"2024-01-17T23:00:19.654142+0000","last_became_peered":"2024-01-17T23:00:19.654142+0000","last_unstale":"2024-01-18T00:48:50.025818+0000","last_undegraded":"2024-01-18T00:48:50.025818+0000","last_fullsized":"2024-01-18T00:48:50.025818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-01-18T00:48:50.025754+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-01-18T00:48:50.025754+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.025754+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:05:10.398842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'203","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:48.627557+0000","last_change":"2024-01-18T00:48:48.627578+0000","last_active":"2024-01-18T00:48:48.627557+0000","last_peered":"2024-01-18T00:48:48.627557+0000","last_clean":"2024-01-18T00:48:48.627557+0000","last_became_active":"2024-01-17T23:00:34.459520+0000","last_became_peered":"2024-01-17T23:00:34.459520+0000","last_unstale":"2024-01-18T00:48:48.627557+0000","last_undegraded":"2024-01-18T00:48:48.627557+0000","last_fullsized":"2024-01-18T00:48:48.627557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-01-18T00:48:48.627494+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-01-18T00:48:48.627494+0000","last_clean_scrub_stamp":"2024-01-18T00:48:48.627494+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T01:34:07.066744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"29'195","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:47.585170+0000","last_change":"2024-01-18T00:48:47.585189+0000","last_active":"2024-01-18T00:48:47.585170+0000","last_peered":"2024-01-18T00:48:47.585170+0000","last_clean":"2024-01-18T00:48:47.585170+0000","last_became_active":"2024-01-17T23:00:34.458399+0000","last_became_peered":"2024-01-17T23:00:34.458399+0000","last_unstale":"2024-01-18T00:48:47.585170+0000","last_undegraded":"2024-01-18T00:48:47.585170+0000","last_fullsized":"2024-01-18T00:48:47.585170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-01-18T00:48:47.585104+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-01-18T00:48:47.585104+0000","last_clean_scrub_stamp":"2024-01-18T00:48:47.585104+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T10:30:21.911563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'207","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:54.212895+0000","last_change":"2024-01-18T00:48:54.212971+0000","last_active":"2024-01-18T00:48:54.212895+0000","last_peered":"2024-01-18T00:48:54.212895+0000","last_clean":"2024-01-18T00:48:54.212895+0000","last_became_active":"2024-01-17T23:00:18.501941+0000","last_became_peered":"2024-01-17T23:00:18.501941+0000","last_unstale":"2024-01-18T00:48:54.212895+0000","last_undegraded":"2024-01-18T00:48:54.212895+0000","last_fullsized":"2024-01-18T00:48:54.212895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-01-18T00:48:54.212716+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-01-18T00:48:54.212716+0000","last_clean_scrub_stamp":"2024-01-18T00:48:54.212716+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T07:15:28.497199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'198","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:56.036494+0000","last_change":"2024-01-18T00:48:56.036553+0000","last_active":"2024-01-18T00:48:56.036494+0000","last_peered":"2024-01-18T00:48:56.036494+0000","last_clean":"2024-01-18T00:48:56.036494+0000","last_became_active":"2024-01-17T23:00:18.563811+0000","last_became_peered":"2024-01-17T23:00:18.563811+0000","last_unstale":"2024-01-18T00:48:56.036494+0000","last_undegraded":"2024-01-18T00:48:56.036494+0000","last_fullsized":"2024-01-18T00:48:56.036494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-01-18T00:48:56.036344+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-01-18T00:48:56.036344+0000","last_clean_scrub_stamp":"2024-01-18T00:48:56.036344+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T08:23:26.648086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'195","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:42.016524+0000","last_change":"2024-01-18T00:48:42.016546+0000","last_active":"2024-01-18T00:48:42.016524+0000","last_peered":"2024-01-18T00:48:42.016524+0000","last_clean":"2024-01-18T00:48:42.016524+0000","last_became_active":"2024-01-17T23:00:18.556581+0000","last_became_peered":"2024-01-17T23:00:18.556581+0000","last_unstale":"2024-01-18T00:48:42.016524+0000","last_undegraded":"2024-01-18T00:48:42.016524+0000","last_fullsized":"2024-01-18T00:48:42.016524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-01-18T00:48:42.016460+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-01-18T00:48:42.016460+0000","last_clean_scrub_stamp":"2024-01-18T00:48:42.016460+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T02:51:15.773297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'200","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:48:50.920007+0000","last_change":"2024-01-18T00:48:50.920027+0000","last_active":"2024-01-18T00:48:50.920007+0000","last_peered":"2024-01-18T00:48:50.920007+0000","last_clean":"2024-01-18T00:48:50.920007+0000","last_became_active":"2024-01-17T23:00:20.211655+0000","last_became_peered":"2024-01-17T23:00:20.211655+0000","last_unstale":"2024-01-18T00:48:50.920007+0000","last_undegraded":"2024-01-18T00:48:50.920007+0000","last_fullsized":"2024-01-18T00:48:50.920007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'200","last_scrub_stamp":"2024-01-18T00:48:50.919948+0000","last_deep_scrub":"29'200","last_deep_scrub_stamp":"2024-01-18T00:48:50.919948+0000","last_clean_scrub_stamp":"2024-01-18T00:48:50.919948+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T09:12:05.842383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'204","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-18T00:49:02.325861+0000","last_change":"2024-01-18T00:49:02.325970+0000","last_active":"2024-01-18T00:49:02.325861+0000","last_peered":"2024-01-18T00:49:02.325861+0000","last_clean":"2024-01-18T00:49:02.325861+0000","last_became_active":"2024-01-17T23:00:18.562444+0000","last_became_peered":"2024-01-17T23:00:18.562444+0000","last_unstale":"2024-01-18T00:49:02.325861+0000","last_undegraded":"2024-01-18T00:49:02.325861+0000","last_fullsized":"2024-01-18T00:49:02.325861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-01-18T00:49:02.325643+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-01-18T00:49:02.325643+0000","last_clean_scrub_stamp":"2024-01-18T00:49:02.325643+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-19T12:13:02.331404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":3686645,"num_write":24416,"num_write_kb":4363145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24890,"ondisk_log_size":24890,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13124,"ondisk_log_size":13124,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":198027587,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":1786,"num_read_kb":2854,"num_write":22123,"num_write_kb":206009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":180731904,"data_stored":396055174,"data_compressed":51429318,"data_compressed_allocated":69492736,"data_compressed_original":284966912,"omap_allocated":0,"internal_metadata":0},"log_size":21782,"ondisk_log_size":21782,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":62450,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510754,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143480,"kb_used_data":31856,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94228360,"statfs":{"total":96636764160,"available":96489840640,"internally_reserved":0,"allocated":32620544,"data_stored":76215532,"data_compressed":10068524,"data_compressed_allocated":13414400,"data_compressed_original":57212928,"omap_allocated":1590,"internal_metadata":114293194},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.89000000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35399999999999998},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84999999999999998,"15min":0.85499999999999998},"min":{"1min":0.59599999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3260000000000001,"5min":1.377,"15min":1.377},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90300000000000002,"15min":0.89400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.34599999999999997},"max":{"1min":1.508,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.61899999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.306,"5min":1.468,"15min":1.4830000000000001},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.86499999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47099999999999997},"max":{"1min":1.1399999999999999,"5min":1.2410000000000001,"15min":1.3120000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.997,"15min":0.97599999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45900000000000002},"max":{"1min":1.389,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.228}]},{"osd":3,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93100000000000005,"15min":0.92900000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.44900000000000001},"max":{"1min":1.304,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.153},{"interface":"front","average":{"1min":1.101,"5min":1.0669999999999999,"15min":1.0409999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.639,"5min":1.996,"15min":1.996},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.99399999999999999,"15min":0.98199999999999998},"min":{"1min":0.59099999999999997,"5min":0.52300000000000002,"15min":0.41499999999999998},"max":{"1min":1.54,"5min":1.7470000000000001,"15min":1.77},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.05,"15min":1.0269999999999999},"min":{"1min":0.77400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.415,"5min":1.5489999999999999,"15min":1.6499999999999999},"last":1.329}]},{"osd":5,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.161,"15min":1.109},"min":{"1min":0.70999999999999996,"5min":0.59499999999999997,"15min":0.44700000000000001},"max":{"1min":1.702,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.28},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.145,"15min":1.111},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.41899999999999998},"max":{"1min":1.7929999999999999,"5min":1.8500000000000001,"15min":1.994},"last":1.075}]},{"osd":6,"last update":"Thu Jan 18 00:48:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.157,"15min":1.161},"min":{"1min":0.64500000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.891},"last":1.2},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.161,"15min":1.1559999999999999},"min":{"1min":0.72299999999999998,"5min":0.66400000000000003,"15min":0.44900000000000001},"max":{"1min":1.488,"5min":1.6739999999999999,"15min":1.746},"last":1.2509999999999999}]}]},{"osd":6,"up_from":15,"seq":64424510755,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138804,"kb_used_data":23020,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94233036,"statfs":{"total":96636764160,"available":96494628864,"internally_reserved":0,"allocated":23572480,"data_stored":53985719,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":1594,"internal_metadata":118553030},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.495,"5min":0.46500000000000002,"15min":0.36299999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.427},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.67200000000000004,"5min":0.51900000000000002,"15min":0.41199999999999998},"max":{"1min":1.2170000000000001,"5min":1.4330000000000001,"15min":1.6379999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.86499999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47699999999999998},"max":{"1min":1.264,"5min":1.357,"15min":1.607},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93400000000000005,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.40899999999999997},"max":{"1min":1.3600000000000001,"5min":1.466,"15min":1.466},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96599999999999997},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.501},"max":{"1min":1.272,"5min":1.756,"15min":1.756},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0049999999999999,"15min":1.0409999999999999},"min":{"1min":0.66400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":2.4209999999999998},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.91300000000000003,"15min":0.94599999999999995},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.53400000000000003},"max":{"1min":1.347,"5min":1.347,"15min":2.3180000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4359999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0900000000000001,"15min":1.0469999999999999},"min":{"1min":0.53800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.4770000000000001,"5min":1.964,"15min":1.964},"last":1.036},{"interface":"front","average":{"1min":0.94699999999999995,"5min":1.0329999999999999,"15min":1.0429999999999999},"min":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.40799999999999997},"max":{"1min":1.353,"5min":2.1339999999999999,"15min":2.3439999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0489999999999999,"15min":1.0669999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":1.3879999999999999,"5min":1.585,"15min":2.4849999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":1.161},"min":{"1min":0.82899999999999996,"5min":0.56200000000000006,"15min":0.55700000000000005},"max":{"1min":1.6100000000000001,"5min":2.0609999999999999,"15min":2.1400000000000001},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.099},"min":{"1min":0.66400000000000003,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":1.7430000000000001,"5min":1.837,"15min":1.8959999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1879999999999999,"15min":1.2030000000000001},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.41799999999999998},"max":{"1min":1.831,"5min":1.8819999999999999,"15min":2.5979999999999999},"last":1.2609999999999999}]}]},{"osd":5,"up_from":15,"seq":64424510755,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123756,"kb_used_data":20452,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94248084,"statfs":{"total":96636764160,"available":96510038016,"internally_reserved":0,"allocated":20942848,"data_stored":42070399,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.2879999999999998,"5min":2.2879999999999998,"15min":2.2879999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88400000000000001,"15min":0.88300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":1.4379999999999999,"5min":1.482,"15min":1.482},"last":1.3300000000000001}]},{"osd":1,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88,"15min":0.85899999999999999},"min":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.46200000000000002},"max":{"1min":1.1950000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.95299999999999996,"15min":0.92800000000000005},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.48999999999999999},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.393}]},{"osd":2,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.629,"5min":0.495,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.502,"15min":1.5429999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.93100000000000005,"15min":0.91900000000000004},"min":{"1min":0.62,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3959999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.002,"15min":1.002},"min":{"1min":0.67200000000000004,"5min":0.56799999999999995,"15min":0.51900000000000002},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0580000000000001,"15min":1.0369999999999999},"min":{"1min":0.75700000000000001,"5min":0.63400000000000001,"15min":0.624},"max":{"1min":1.556,"5min":1.5620000000000001,"15min":1.6679999999999999},"last":1.115}]},{"osd":4,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0269999999999999,"15min":0.997},"min":{"1min":0.64100000000000001,"5min":0.36399999999999999,"15min":0.32400000000000001},"max":{"1min":1.5129999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.085,"15min":1.101},"min":{"1min":0.52500000000000002,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.5069999999999999}]},{"osd":6,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1080000000000001,"15min":1.119},"min":{"1min":0.68799999999999994,"5min":0.53400000000000003,"15min":0.51700000000000002},"max":{"1min":1.536,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.133,"15min":1.123},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.39000000000000001},"max":{"1min":1.609,"5min":2.032,"15min":2.032},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:48:33 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2150000000000001,"15min":1.2030000000000001},"min":{"1min":0.93100000000000005,"5min":0.58699999999999997,"15min":0.35099999999999998},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.607},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.86599999999999999,"5min":0.61399999999999999,"15min":0.56599999999999995},"max":{"1min":1.657,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.645}]}]},{"osd":3,"up_from":15,"seq":64424510755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142796,"kb_used_data":21444,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94229044,"statfs":{"total":96636764160,"available":96490541056,"internally_reserved":0,"allocated":21958656,"data_stored":43628986,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45000000000000001},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.254},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.505,"15min":0.496},"min":{"1min":0.311,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.71799999999999997,"5min":0.78300000000000003,"15min":0.94199999999999995},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.312,"5min":0.29199999999999998,"15min":0.27000000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.83799999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.33800000000000002},"max":{"1min":0.77700000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.54800000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34399999999999997},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.91100000000000003},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76900000000000002},"min":{"1min":0.53500000000000003,"5min":0.45900000000000002,"15min":0.45000000000000001},"max":{"1min":1.0489999999999999,"5min":1.1779999999999999,"15min":1.587},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.82499999999999996,"15min":0.80000000000000004},"min":{"1min":0.72499999999999998,"5min":0.52700000000000002,"15min":0.48999999999999999},"max":{"1min":1.1399999999999999,"5min":1.296,"15min":1.296},"last":1.0920000000000001}]},{"osd":5,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.55900000000000005,"5min":0.48899999999999999,"15min":0.432},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83899999999999997,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.48099999999999998},"max":{"1min":1.141,"5min":1.2789999999999999,"15min":1.3080000000000001},"last":1.02}]},{"osd":6,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.80100000000000005,"15min":0.79500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.46999999999999997},"max":{"1min":1.028,"5min":1.1599999999999999,"15min":1.1879999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.82999999999999996},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.101,"5min":1.22,"15min":1.3109999999999999},"last":1.1299999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86099999999999999},"min":{"1min":0.63100000000000001,"5min":0.56799999999999995,"15min":0.497},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.5620000000000001},"last":1.119},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85499999999999998,"15min":0.85799999999999998},"min":{"1min":0.69899999999999995,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.256},"last":1.03}]}]},{"osd":1,"up_from":15,"seq":64424510757,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141028,"kb_used_data":23836,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94230812,"statfs":{"total":96636764160,"available":96492351488,"internally_reserved":0,"allocated":24408064,"data_stored":54652877,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.439},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.71999999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.74099999999999999,"15min":1.2749999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47599999999999998},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":1.0329999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.78600000000000003,"15min":0.83799999999999997},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.40799999999999997,"5min":0.379,"15min":0.33500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.624},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.35299999999999998,"15min":0.33400000000000002},"max":{"1min":0.76700000000000002,"5min":0.84899999999999998,"15min":1.375},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.63100000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.147,"5min":1.1759999999999999,"15min":1.3220000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.79300000000000004},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1319999999999999,"5min":1.2629999999999999,"15min":1.5660000000000001},"last":1.018},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79200000000000004,"15min":0.79500000000000004},"min":{"1min":0.55100000000000005,"5min":0.51600000000000001,"15min":0.51200000000000001},"max":{"1min":1.01,"5min":1.2190000000000001,"15min":1.222},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1839999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.83299999999999996},"min":{"1min":0.59799999999999998,"5min":0.505,"15min":0.497},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 18 00:48:30 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.871,"15min":0.86099999999999999},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.202,"5min":1.298,"15min":1.4239999999999999},"last":1.044},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.69699999999999995,"5min":0.59699999999999998,"15min":0.53200000000000003},"max":{"1min":1.0660000000000001,"5min":1.339,"15min":1.341},"last":0.89400000000000002}]}]},{"osd":0,"up_from":15,"seq":64424510755,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108120,"kb_used_data":18704,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94263720,"statfs":{"total":96636764160,"available":96526049280,"internally_reserved":0,"allocated":19152896,"data_stored":46854353,"data_compressed":6403410,"data_compressed_allocated":8425472,"data_compressed_original":36327424,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.33000000000000002,"5min":0.26900000000000002,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.79400000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.36599999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69199999999999995,"5min":0.752,"15min":1.0369999999999999},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.39500000000000002,"5min":0.32400000000000001,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.79500000000000004,"15min":0.81599999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.749,"5min":0.80100000000000005,"15min":1.2350000000000001},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.72499999999999998,"5min":0.76400000000000001,"15min":1.1759999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58199999999999996,"15min":0.56399999999999995},"min":{"1min":0.46300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75,"5min":0.90100000000000002,"15min":0.93300000000000005},"last":0.438}]},{"osd":4,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.61199999999999999,"5min":0.48999999999999999,"15min":0.44600000000000001},"max":{"1min":1.0629999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.82199999999999995,"15min":0.81000000000000005},"min":{"1min":0.68600000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1459999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.628}]},{"osd":5,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.80400000000000005,"15min":0.79200000000000004},"min":{"1min":0.69199999999999995,"5min":0.52400000000000002,"15min":0.502},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2869999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81299999999999994,"15min":0.80300000000000005},"min":{"1min":0.60399999999999998,"5min":0.499,"15min":0.48699999999999999},"max":{"1min":1.103,"5min":1.335,"15min":1.335},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.82799999999999996,"15min":0.83199999999999996},"min":{"1min":0.73599999999999999,"5min":0.55400000000000005,"15min":0.54700000000000004},"max":{"1min":1.1619999999999999,"5min":1.377,"15min":1.377},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.83199999999999996,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2010000000000001,"5min":1.2190000000000001,"15min":1.266},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 18 00:48:57 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.68600000000000005,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.2370000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.88,"15min":0.83999999999999997},"min":{"1min":0.70399999999999996,"5min":0.58599999999999997,"15min":0.50600000000000001},"max":{"1min":1.2989999999999999,"5min":1.411,"15min":1.411},"last":0.72699999999999998}]}]},{"osd":4,"up_from":14,"seq":60129543461,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139428,"kb_used_data":27804,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94232412,"statfs":{"total":96636764160,"available":96493989888,"internally_reserved":0,"allocated":28471296,"data_stored":58179387,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.54100000000000004,"5min":0.38200000000000001,"15min":0.35599999999999998},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.04},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.90800000000000003},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":1.198,"5min":1.506,"15min":1.506},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.98599999999999999,"15min":0.95499999999999996},"min":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.4810000000000001,"15min":1.522},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.56799999999999995,"5min":0.42799999999999999,"15min":0.36199999999999999},"max":{"1min":1.2290000000000001,"5min":1.6200000000000001,"15min":1.7589999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93899999999999995,"15min":0.94199999999999995},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2629999999999999,"5min":1.5429999999999999,"15min":1.587},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.04,"15min":1.016},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.52500000000000002},"max":{"1min":1.4279999999999999,"5min":1.5940000000000001,"15min":1.639},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.94299999999999995,"15min":0.95099999999999996},"min":{"1min":0.55500000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.8240000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0580000000000001,"15min":1.0329999999999999},"min":{"1min":0.82999999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.526,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.68899999999999995,"5min":0.50600000000000001,"15min":0.46700000000000003},"max":{"1min":1.5600000000000001,"5min":1.76,"15min":1.76},"last":0.998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.073,"15min":1.056},"min":{"1min":0.81699999999999995,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":1.732,"5min":1.8240000000000001,"15min":2.1960000000000002},"last":1.0840000000000001}]},{"osd":6,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1120000000000001,"15min":1.1060000000000001},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.46700000000000003},"max":{"1min":1.7869999999999999,"5min":1.992,"15min":1.992},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.2,"15min":1.1850000000000001},"min":{"1min":0.80700000000000005,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":1.542,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 18 00:48:45 2024","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.167,"15min":1.149},"min":{"1min":0.876,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.8320000000000001,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.359},{"interface":"front","average":{"1min":1.29,"5min":1.23,"15min":1.2310000000000001},"min":{"1min":0.57599999999999996,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.8740000000000001,"5min":1.9279999999999999,"15min":2.0110000000000001},"last":1.4319999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543460,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79108,"kb_used_data":11900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94292732,"statfs":{"total":96636764160,"available":96555757568,"internally_reserved":0,"allocated":12185600,"data_stored":22656505,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45000000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":0.877},"last":0.38}]},{"osd":1,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.30599999999999999,"15min":0.249},"max":{"1min":0.61099999999999999,"5min":0.76300000000000001,"15min":0.82399999999999995},"last":0.309},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.53600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71699999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.40999999999999998,"15min":0.37},"max":{"1min":0.79300000000000004,"5min":0.84899999999999998,"15min":0.87},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.58999999999999997,"5min":0.56899999999999995,"15min":0.48999999999999999},"max":{"1min":1.052,"5min":1.359,"15min":1.359},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.51100000000000001,"15min":0.46300000000000002},"max":{"1min":0.96799999999999997,"5min":1.0900000000000001,"15min":1.3140000000000001},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47099999999999997},"max":{"1min":1.087,"5min":1.3100000000000001,"15min":1.3420000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80600000000000005,"15min":0.81899999999999995},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.998,"5min":1.196,"15min":1.3480000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.52500000000000002},"max":{"1min":1.079,"5min":1.254,"15min":1.476},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.56399999999999995,"15min":0.45100000000000001},"max":{"1min":1,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 18 00:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.86099999999999999,"15min":0.85999999999999999},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.48299999999999998},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":31225,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18784256,"data_stored":46138004,"data_compressed":6372185,"data_compressed_allocated":8384512,"data_compressed_original":35753984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24100864,"data_stored":54526896,"data_compressed":7383945,"data_compressed_allocated":9854976,"data_compressed_original":40304640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":22530524,"data_compressed":2853271,"data_compressed_allocated":3850240,"data_compressed_original":14524416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":43503005,"data_compressed":5314148,"data_compressed_allocated":7417856,"data_compressed_original":29290496,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28164096,"data_stored":58053406,"data_compressed":7272381,"data_compressed_allocated":9990144,"data_compressed_original":39895040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":41944418,"data_compressed":5233102,"data_compressed_allocated":7077888,"data_compressed_original":28405760,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23265280,"data_stored":53859738,"data_compressed":6962987,"data_compressed_allocated":9543680,"data_compressed_original":40153088,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32251904,"data_stored":75499183,"data_compressed":10037299,"data_compressed_allocated":13373440,"data_compressed_original":56639488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-18T00:49:06.847 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-18T00:49:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 Processor -- start 2024-01-18T00:49:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 -- start start 2024-01-18T00:49:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0878156300 0x7f087806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780bffb0 con 0x7f08781506b0 2024-01-18T00:49:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780b1130 con 0x7f087806df20 2024-01-18T00:49:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.016+0000 7f087d800640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087806e330 con 0x7f0878156300 2024-01-18T00:49:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.020+0000 7f0876a00640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f08781506b0 0x7f08780c0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33964/0 (socket says 172.21.15.67:33964) 2024-01-18T00:49:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.020+0000 7f0876a00640 1 -- 172.21.15.67:0/900321430 learned_addr learned my addr 172.21.15.67:0/900321430 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:49:07.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.020+0000 7f0876000640 1 --2- 172.21.15.67:0/900321430 >> v2:172.21.15.137:3300/0 conn(0x7f0878156300 0x7f087806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.020+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759463473 0 0) 0x7f08780bffb0 con 0x7f08781506b0 2024-01-18T00:49:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.020+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0858003530 con 0x7f08781506b0 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301672185 0 0) 0x7f0858003530 con 0x7f08781506b0 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 >> v2:172.21.15.137:3300/0 conn(0x7f0878156300 msgr2=0x7f087806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 --2- 172.21.15.67:0/900321430 >> v2:172.21.15.137:3300/0 conn(0x7f0878156300 0x7f087806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 >> v1:172.21.15.137:6789/0 conn(0x7f087806df20 legacy=0x7f08780c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08781567b0 con 0x7f08781506b0 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f0868001680 con 0x7f08781506b0 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 >> v1:172.21.15.67:6789/0 conn(0x7f08781506b0 legacy=0x7f08780c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580039d0 0x7f0858003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08580047d0 0x7f0858004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 0x7f085800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087806e330 con 0x7f08580051e0 2024-01-18T00:49:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085800e340 con 0x7f08580039d0 2024-01-18T00:49:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085800e500 con 0x7f08580047d0 2024-01-18T00:49:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0876000640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08580047d0 0x7f0858004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.028+0000 7f0877400640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 0x7f085800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.032+0000 7f0877400640 1 -- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08580047d0 msgr2=0x7f0858004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.032+0000 7f0877400640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f08580047d0 0x7f0858004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.032+0000 7f0877400640 1 -- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580039d0 msgr2=0x7f0858003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.032+0000 7f0877400640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580039d0 0x7f0858003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.032+0000 7f0877400640 1 -- 172.21.15.67:0/900321430 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858003530 con 0x7f08580051e0 2024-01-18T00:49:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.036+0000 7f0877400640 1 -- 172.21.15.67:0/900321430 reap_dead start 2024-01-18T00:49:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.036+0000 7f0877400640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 0x7f085800dba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0870001e70 tx=0x7f087001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ef0c7e167f731d server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870003b80 con 0x7f08580051e0 2024-01-18T00:49:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870003d20 con 0x7f08580051e0 2024-01-18T00:49:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f0875600640 1 -- 172.21.15.67:0/900321430 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870005260 con 0x7f08580051e0 2024-01-18T00:49:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 -- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 msgr2=0x7f085800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 0x7f085800dba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0870001e70 tx=0x7f087001c760 comp rx=0 tx=0).stop 2024-01-18T00:49:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 -- 172.21.15.67:0/900321430 shutdown_connections 2024-01-18T00:49:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 --2- 172.21.15.67:0/900321430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08580051e0 0x7f085800dba0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 -- 172.21.15.67:0/900321430 >> 172.21.15.67:0/900321430 conn(0x7f08780c7a90 msgr2=0x7f08780c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 -- 172.21.15.67:0/900321430 shutdown_connections 2024-01-18T00:49:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.040+0000 7f087d800640 1 -- 172.21.15.67:0/900321430 wait complete. 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 Processor -- start 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 -- start start 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580051e0 0x7f08781585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f087814beb0 0x7f087814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0878157530 con 0x7f08781eff40 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087814a8d0 con 0x7f08580051e0 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f087d800640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087814c360 con 0x7f087814beb0 2024-01-18T00:49:07.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f0877400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f0876a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580051e0 0x7f08781585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f0877400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42666/0 (socket says 172.21.15.67:42666) 2024-01-18T00:49:07.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f0877400640 1 -- 172.21.15.67:0/2254724913 learned_addr learned my addr 172.21.15.67:0/2254724913 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:07.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.044+0000 7f0876000640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f087814beb0 0x7f087814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.048+0000 7f0877400640 1 -- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f087814beb0 msgr2=0x7f087814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.048+0000 7f0877400640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f087814beb0 0x7f087814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.048+0000 7f0877400640 1 -- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580051e0 msgr2=0x7f08781585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.048+0000 7f0877400640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580051e0 0x7f08781585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.048+0000 7f0877400640 1 -- 172.21.15.67:0/2254724913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087814c640 con 0x7f08781eff40 2024-01-18T00:49:07.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.052+0000 7f0877400640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f087001cc40 tx=0x7f0858005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:07.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700ac070 con 0x7f08781eff40 2024-01-18T00:49:07.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087814ab70 con 0x7f08781eff40 2024-01-18T00:49:07.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087814c920 con 0x7f08781eff40 2024-01-18T00:49:07.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870003e90 con 0x7f08781eff40 2024-01-18T00:49:07.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870006d60 con 0x7f08781eff40 2024-01-18T00:49:07.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.056+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08780746a0 con 0x7f08781eff40 2024-01-18T00:49:07.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.076+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f0870007030 con 0x7f08781eff40 2024-01-18T00:49:07.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.076+0000 7f086ea00640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 0x7f0850068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.076+0000 7f0876a00640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 0x7f0850068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.080+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0870005810 con 0x7f08781eff40 2024-01-18T00:49:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.080+0000 7f0876a00640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 0x7f0850068d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0868001000 tx=0x7f08680019c0 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:07.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.320+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f08700ea9e0 con 0x7f08781eff40 2024-01-18T00:49:07.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.480+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f087814fee0 con 0x7f08781eff40 2024-01-18T00:49:07.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.576+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f08700ec910 con 0x7f08781eff40 2024-01-18T00:49:07.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.576+0000 7f086ea00640 1 -- 172.21.15.67:0/2254724913 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0870003b90 con 0x7f08781eff40 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 msgr2=0x7f0850068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 0x7f0850068d00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0868001000 tx=0x7f08680019c0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 msgr2=0x7f08780ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f087001cc40 tx=0x7f0858005800 comp rx=0 tx=0).stop 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 shutdown_connections 2024-01-18T00:49:07.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f0850066840 0x7f0850068d00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08781eff40 0x7f08780ca170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f087814beb0 0x7f087814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 --2- 172.21.15.67:0/2254724913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08580051e0 0x7f08781585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 >> 172.21.15.67:0/2254724913 conn(0x7f08780c7a90 msgr2=0x7f0878149790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 shutdown_connections 2024-01-18T00:49:07.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.580+0000 7f087d800640 1 -- 172.21.15.67:0/2254724913 wait complete. 2024-01-18T00:49:07.610 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-18T00:49:07.610 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-18T00:49:07.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 Processor -- start 2024-01-18T00:49:07.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 -- start start 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa76406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa76406d210 0x7fa764072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa764072840 0x7fa764157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76415b9c0 con 0x7fa76406d210 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76415ae40 con 0x7fa764072840 2024-01-18T00:49:07.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa769000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415b120 con 0x7fa7641517a0 2024-01-18T00:49:07.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.752+0000 7fa761400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa76406d210 0x7fa764072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa76406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa76406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55746/0 (socket says 172.21.15.67:55746) 2024-01-18T00:49:07.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761e00640 1 -- 172.21.15.67:0/4089838123 learned_addr learned my addr 172.21.15.67:0/4089838123 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:07.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa762800640 1 --2- 172.21.15.67:0/4089838123 >> v2:172.21.15.137:3300/0 conn(0x7fa764072840 0x7fa764157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761400640 1 -- 172.21.15.67:0/4089838123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 msgr2=0x7fa76406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:07.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761400640 1 --2- 172.21.15.67:0/4089838123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa76406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761400640 1 -- 172.21.15.67:0/4089838123 >> v2:172.21.15.137:3300/0 conn(0x7fa764072840 msgr2=0x7fa764157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:07.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761400640 1 --2- 172.21.15.67:0/4089838123 >> v2:172.21.15.137:3300/0 conn(0x7fa764072840 0x7fa764157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.756+0000 7fa761400640 1 -- 172.21.15.67:0/4089838123 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76415b400 con 0x7fa76406d210 2024-01-18T00:49:07.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.760+0000 7fa761400640 1 --2- 172.21.15.67:0/4089838123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76406d210 0x7fa764072300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa7640cbea0 tx=0x7fa74c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458274c35976d743 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.776+0000 7fa760a00640 1 -- 172.21.15.67:0/4089838123 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0ab600 con 0x7fa76406d210 2024-01-18T00:49:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.776+0000 7fa760a00640 1 -- 172.21.15.67:0/4089838123 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa74c0a7050 con 0x7fa76406d210 2024-01-18T00:49:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.776+0000 7fa760a00640 1 -- 172.21.15.67:0/4089838123 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0ab9a0 con 0x7fa76406d210 2024-01-18T00:49:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- 172.21.15.67:0/4089838123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76406d210 msgr2=0x7fa764072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 --2- 172.21.15.67:0/4089838123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76406d210 0x7fa764072300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa7640cbea0 tx=0x7fa74c01c430 comp rx=0 tx=0).stop 2024-01-18T00:49:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- 172.21.15.67:0/4089838123 shutdown_connections 2024-01-18T00:49:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 --2- 172.21.15.67:0/4089838123 >> v2:172.21.15.137:3300/0 conn(0x7fa764072840 0x7fa764157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 --2- 172.21.15.67:0/4089838123 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa76406d210 0x7fa764072300 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 --2- 172.21.15.67:0/4089838123 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa76406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- 172.21.15.67:0/4089838123 >> 172.21.15.67:0/4089838123 conn(0x7fa7640cb070 msgr2=0x7fa7640cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- 172.21.15.67:0/4089838123 shutdown_connections 2024-01-18T00:49:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- 172.21.15.67:0/4089838123 wait complete. 2024-01-18T00:49:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 Processor -- start 2024-01-18T00:49:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.780+0000 7fa769000640 1 -- start start 2024-01-18T00:49:07.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76406d210 0x7fa76414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 0x7fa7640c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa7640c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640caaf0 con 0x7fa764072840 2024-01-18T00:49:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641605f0 con 0x7fa76406d210 2024-01-18T00:49:07.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa769000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640c9e30 con 0x7fa7641517a0 2024-01-18T00:49:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa762800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa7640c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa761400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 0x7fa7640c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa762800640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa7640c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55762/0 (socket says 172.21.15.67:55762) 2024-01-18T00:49:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa762800640 1 -- 172.21.15.67:0/3361369784 learned_addr learned my addr 172.21.15.67:0/3361369784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:07.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.784+0000 7fa761e00640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76406d210 0x7fa76414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 -- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 msgr2=0x7fa7640c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa7640c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 -- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76406d210 msgr2=0x7fa76414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:07.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76406d210 0x7fa76414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:07.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 -- 172.21.15.67:0/3361369784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c009420 con 0x7fa764072840 2024-01-18T00:49:07.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.788+0000 7fa761400640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 0x7fa7640c0090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0ab000 tx=0x7fa74c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:07.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.792+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0b4600 con 0x7fa764072840 2024-01-18T00:49:07.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.792+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa74c0b47a0 con 0x7fa764072840 2024-01-18T00:49:07.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.792+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7640c1f50 con 0x7fa764072840 2024-01-18T00:49:07.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.792+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0b4b70 con 0x7fa764072840 2024-01-18T00:49:07.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.792+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7641f2900 con 0x7fa764072840 2024-01-18T00:49:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.796+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7640746a0 con 0x7fa764072840 2024-01-18T00:49:07.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.812+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7fa74c0b2040 con 0x7fa764072840 2024-01-18T00:49:07.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.816+0000 7fa75a000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 0x7fa73c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:07.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.816+0000 7fa761e00640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 0x7fa73c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:07.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.816+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa74c0eed70 con 0x7fa764072840 2024-01-18T00:49:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:07.816+0000 7fa761e00640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 0x7fa73c068d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa754009a30 tx=0x7fa754009240 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:08.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.060+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7fa74c0eb0b0 con 0x7fa764072840 2024-01-18T00:49:08.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.256+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa76406cab0 con 0x7fa764072840 2024-01-18T00:49:08.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa75a000640 1 -- 172.21.15.67:0/3361369784 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6557 (secure 0 0 0) 0x7fa74c0ee6d0 con 0x7fa764072840 2024-01-18T00:49:08.274 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:49:08.274 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:58:43.844589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":873,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-18T00:49:08.274 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 18 2024-01-18T00:49:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 msgr2=0x7fa73c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 0x7fa73c068d50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa754009a30 tx=0x7fa754009240 comp rx=0 tx=0).stop 2024-01-18T00:49:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 msgr2=0x7fa7640c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 0x7fa7640c0090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0ab000 tx=0x7fa74c0191d0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 shutdown_connections 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7fa73c066890 0x7fa73c068d50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7fa7641517a0 0x7fa7640c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa764072840 0x7fa7640c0090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 --2- 172.21.15.67:0/3361369784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa76406d210 0x7fa76414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 >> 172.21.15.67:0/3361369784 conn(0x7fa7640cb070 msgr2=0x7fa7640c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 shutdown_connections 2024-01-18T00:49:08.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.272+0000 7fa769000640 1 -- 172.21.15.67:0/3361369784 wait complete. 2024-01-18T00:49:08.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-18T00:49:08.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.432+0000 7f53b1c00640 1 Processor -- start 2024-01-18T00:49:08.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.432+0000 7f53b1c00640 1 -- start start 2024-01-18T00:49:08.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53b1c00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53ac153860 0x7f53ac06b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53b1c00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac15a4c0 con 0x7f53ac061530 2024-01-18T00:49:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53b1c00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac06a780 con 0x7f53ac159ff0 2024-01-18T00:49:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53b1c00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac06ffb0 con 0x7f53ac153860 2024-01-18T00:49:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53ab400640 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f53ac061530 0x7f53ac06f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:33978/0 (socket says 172.21.15.67:33978) 2024-01-18T00:49:08.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.436+0000 7f53ab400640 1 -- 172.21.15.67:0/1386077598 learned_addr learned my addr 172.21.15.67:0/1386077598 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:49:08.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.440+0000 7f53aaa00640 1 --2- 172.21.15.67:0/1386077598 >> v2:172.21.15.137:3300/0 conn(0x7f53ac153860 0x7f53ac06b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.440+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150946949 0 0) 0x7f53ac15a4c0 con 0x7f53ac061530 2024-01-18T00:49:08.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.440+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c003530 con 0x7f53ac061530 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423749148 0 0) 0x7f538c003530 con 0x7f53ac061530 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 >> v2:172.21.15.137:3300/0 conn(0x7f53ac153860 msgr2=0x7f53ac06b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 --2- 172.21.15.67:0/1386077598 >> v2:172.21.15.137:3300/0 conn(0x7f53ac153860 0x7f53ac06b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 >> v1:172.21.15.137:6789/0 conn(0x7f53ac159ff0 legacy=0x7f53ac06f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac06aa60 con 0x7f53ac061530 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2266586223 0 0) 0x7f53a4001a00 con 0x7f53ac061530 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 >> v1:172.21.15.67:6789/0 conn(0x7f53ac061530 legacy=0x7f53ac06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f538c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f538c0047d0 0x7f538c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f538c005190 0x7f538c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00c040 con 0x7f538c0039d0 2024-01-18T00:49:08.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00c1b0 con 0x7f538c005190 2024-01-18T00:49:08.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c00c370 con 0x7f538c0047d0 2024-01-18T00:49:08.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53aa000640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f538c0047d0 0x7f538c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.444+0000 7f53aaa00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f538c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53aaa00640 1 -- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f538c0047d0 msgr2=0x7f538c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53aaa00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f538c0047d0 0x7f538c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53aaa00640 1 -- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f538c005190 msgr2=0x7f538c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53aaa00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f538c005190 0x7f538c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53aaa00640 1 -- 172.21.15.67:0/1386077598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c003530 con 0x7f538c0039d0 2024-01-18T00:49:08.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.448+0000 7f53ab400640 1 -- 172.21.15.67:0/1386077598 reap_dead start 2024-01-18T00:49:08.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.452+0000 7f53aaa00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f538c003df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f539c009ae0 tx=0x7f539c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b016e908a2438a server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:08.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0a5660 con 0x7f538c0039d0 2024-01-18T00:49:08.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f539c0a57c0 con 0x7f538c0039d0 2024-01-18T00:49:08.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53a9600640 1 -- 172.21.15.67:0/1386077598 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0a5bd0 con 0x7f538c0039d0 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 -- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 msgr2=0x7f538c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f538c003df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f539c009ae0 tx=0x7f539c01ca70 comp rx=0 tx=0).stop 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 -- 172.21.15.67:0/1386077598 shutdown_connections 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 --2- 172.21.15.67:0/1386077598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f538c003df0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 -- 172.21.15.67:0/1386077598 >> 172.21.15.67:0/1386077598 conn(0x7f53ac0c8160 msgr2=0x7f53ac0c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 -- 172.21.15.67:0/1386077598 shutdown_connections 2024-01-18T00:49:08.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.456+0000 7f53b1c00640 1 -- 172.21.15.67:0/1386077598 wait complete. 2024-01-18T00:49:08.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 Processor -- start 2024-01-18T00:49:08.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 -- start start 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53ac14bf10 0x7f53ac148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53ac159330 0x7f53ac149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac14c840 con 0x7f538c0039d0 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac154600 con 0x7f53ac14bf10 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53b1c00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac155dd0 con 0x7f53ac159330 2024-01-18T00:49:08.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53aaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53aaa00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42714/0 (socket says 172.21.15.67:42714) 2024-01-18T00:49:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53aaa00640 1 -- 172.21.15.67:0/3282969555 learned_addr learned my addr 172.21.15.67:0/3282969555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:08.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.460+0000 7f53ab400640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53ac159330 0x7f53ac149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.464+0000 7f53aaa00640 1 -- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53ac159330 msgr2=0x7f53ac149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.464+0000 7f53aaa00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53ac159330 0x7f53ac149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.464+0000 7f53aaa00640 1 -- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53ac14bf10 msgr2=0x7f53ac148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.464+0000 7f53aaa00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53ac14bf10 0x7f53ac148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.464+0000 7f53aaa00640 1 -- 172.21.15.67:0/3282969555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac154040 con 0x7f538c0039d0 2024-01-18T00:49:08.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.468+0000 7f53aaa00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f539c01cf50 tx=0x7f538c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ad640 con 0x7f538c0039d0 2024-01-18T00:49:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac154320 con 0x7f538c0039d0 2024-01-18T00:49:08.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac155500 con 0x7f538c0039d0 2024-01-18T00:49:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f539c000e90 con 0x7f538c0039d0 2024-01-18T00:49:08.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ad9a0 con 0x7f538c0039d0 2024-01-18T00:49:08.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.472+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c0052a0 con 0x7f538c0039d0 2024-01-18T00:49:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.492+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f539c0b4040 con 0x7f538c0039d0 2024-01-18T00:49:08.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.492+0000 7f53a2a00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 0x7f5384068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:08.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.492+0000 7f53aa000640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 0x7f5384068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:08.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.496+0000 7f53aa000640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 0x7f5384068d30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f53ac158dd0 tx=0x7f5394009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.744+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f539c0ee940 con 0x7f538c0039d0 2024-01-18T00:49:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.744+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f539c0eac80 con 0x7f538c0039d0 2024-01-18T00:49:08.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.952+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f537c005900 con 0x7f538c0039d0 2024-01-18T00:49:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53a2a00640 1 -- 172.21.15.67:0/3282969555 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6557 (secure 0 0 0) 0x7f537c005900 con 0x7f538c0039d0 2024-01-18T00:49:08.970 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:49:08.970 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6833/1655468429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":1655468429},{"type":"v1","addr":"172.21.15.67:6833","nonce":1655468429}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4233,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/4032552678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":4032552678},{"type":"v1","addr":"172.21.15.67:6835","nonce":4032552678}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/2664916976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":2664916976},{"type":"v1","addr":"172.21.15.67:6837","nonce":2664916976}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-17T23:00:18.027327+0000","modified":"2024-01-17T23:58:43.844589+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4276,"mds_2":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6838/746278968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":746278968},{"type":"v1","addr":"172.21.15.137:6838","nonce":746278968}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"b","rank":1,"incarnation":10,"state":"up:active","state_seq":15,"addr":"172.21.15.137:6835/3667909367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3667909367},{"type":"v1","addr":"172.21.15.137:6835","nonce":3667909367}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":873,"addr":"172.21.15.137:6839/2865340697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6837","nonce":2865340697},{"type":"v1","addr":"172.21.15.137:6839","nonce":2865340697}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-18T00:49:08.970 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 18 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 msgr2=0x7f5384068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 0x7f5384068d30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f53ac158dd0 tx=0x7f5394009040 comp rx=0 tx=0).stop 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 msgr2=0x7f53ac0c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f539c01cf50 tx=0x7f538c005800 comp rx=0 tx=0).stop 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 shutdown_connections 2024-01-18T00:49:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f5384066870 0x7f5384068d30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f53ac159330 0x7f53ac149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53ac14bf10 0x7f53ac148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 --2- 172.21.15.67:0/3282969555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f538c0039d0 0x7f53ac0c4f10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 >> 172.21.15.67:0/3282969555 conn(0x7f53ac0c8160 msgr2=0x7f53ac0c6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 shutdown_connections 2024-01-18T00:49:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:08.968+0000 7f53b1c00640 1 -- 172.21.15.67:0/3282969555 wait complete. 2024-01-18T00:49:08.992 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-18T00:49:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.136+0000 7f2064600640 1 Processor -- start 2024-01-18T00:49:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.136+0000 7f2064600640 1 -- start start 2024-01-18T00:49:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2064600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 0x7f205c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2064600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f205c0ca780 0x7f205c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2064600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c0c7d10 con 0x7f205c0ca3a0 2024-01-18T00:49:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2064600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c1576d0 con 0x7f205c0ca780 2024-01-18T00:49:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2064600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c157970 con 0x7f205c1517f0 2024-01-18T00:49:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2061c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 0x7f205c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2061c00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 0x7f205c15b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55774/0 (socket says 172.21.15.67:55774) 2024-01-18T00:49:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.140+0000 7f2061c00640 1 -- 172.21.15.67:0/3465477560 learned_addr learned my addr 172.21.15.67:0/3465477560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:09.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.176+0000 7f2062600640 1 --2- 172.21.15.67:0/3465477560 >> v2:172.21.15.67:3300/0 conn(0x7f205c0ca780 0x7f205c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.184+0000 7f2062600640 1 -- 172.21.15.67:0/3465477560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 msgr2=0x7f205c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:09.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.184+0000 7f2062600640 1 --2- 172.21.15.67:0/3465477560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 0x7f205c15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.184+0000 7f2062600640 1 -- 172.21.15.67:0/3465477560 >> v1:172.21.15.67:6789/0 conn(0x7f205c0ca3a0 legacy=0x7f205c061100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.184+0000 7f2062600640 1 -- 172.21.15.67:0/3465477560 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c157c50 con 0x7f205c0ca780 2024-01-18T00:49:09.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.188+0000 7f2062600640 1 --2- 172.21.15.67:0/3465477560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c0ca780 0x7f205c0c8a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f205401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e744a6b8fb2c9bd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:09.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f205be00640 1 -- 172.21.15.67:0/3465477560 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540a5a10 con 0x7f205c0ca780 2024-01-18T00:49:09.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f205be00640 1 -- 172.21.15.67:0/3465477560 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f20540a5b70 con 0x7f205c0ca780 2024-01-18T00:49:09.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f205be00640 1 -- 172.21.15.67:0/3465477560 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540ad440 con 0x7f205c0ca780 2024-01-18T00:49:09.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 -- 172.21.15.67:0/3465477560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c0ca780 msgr2=0x7f205c0c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 --2- 172.21.15.67:0/3465477560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c0ca780 0x7f205c0c8a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f205401c950 comp rx=0 tx=0).stop 2024-01-18T00:49:09.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 -- 172.21.15.67:0/3465477560 shutdown_connections 2024-01-18T00:49:09.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 --2- 172.21.15.67:0/3465477560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c0ca780 0x7f205c0c8a30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 --2- 172.21.15.67:0/3465477560 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c1517f0 0x7f205c15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 -- 172.21.15.67:0/3465477560 >> 172.21.15.67:0/3465477560 conn(0x7f205c06ad40 msgr2=0x7f205c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 -- 172.21.15.67:0/3465477560 shutdown_connections 2024-01-18T00:49:09.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.192+0000 7f2064600640 1 -- 172.21.15.67:0/3465477560 wait complete. 2024-01-18T00:49:09.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 Processor -- start 2024-01-18T00:49:09.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 -- start start 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205c0ca3a0 0x7f205c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c0ca780 0x7f205c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0afa10 con 0x7f205c1517f0 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0b0420 con 0x7f205c0ca3a0 2024-01-18T00:49:09.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2064600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0b0690 con 0x7f205c0ca780 2024-01-18T00:49:09.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2062600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2062600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42738/0 (socket says 172.21.15.67:42738) 2024-01-18T00:49:09.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.196+0000 7f2062600640 1 -- 172.21.15.67:0/3072596219 learned_addr learned my addr 172.21.15.67:0/3072596219 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.200+0000 7f2062600640 1 -- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c0ca780 msgr2=0x7f205c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.200+0000 7f2062600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c0ca780 0x7f205c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.200+0000 7f2062600640 1 -- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205c0ca3a0 msgr2=0x7f205c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.200+0000 7f2062600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205c0ca3a0 0x7f205c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.200+0000 7f2062600640 1 -- 172.21.15.67:0/3072596219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009a70 con 0x7f205c1517f0 2024-01-18T00:49:09.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.204+0000 7f2062600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f20540196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b7600 con 0x7f205c1517f0 2024-01-18T00:49:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c0b2010 con 0x7f205c1517f0 2024-01-18T00:49:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c159cb0 con 0x7f205c1517f0 2024-01-18T00:49:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2054009450 con 0x7f205c1517f0 2024-01-18T00:49:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b7960 con 0x7f205c1517f0 2024-01-18T00:49:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.208+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0052a0 con 0x7f205c1517f0 2024-01-18T00:49:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.228+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f20540b7ac0 con 0x7f205c1517f0 2024-01-18T00:49:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.228+0000 7f2059600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 0x7f2034068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.228+0000 7f2061c00640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 0x7f2034068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.232+0000 7f2061c00640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 0x7f2034068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b850 tx=0x7f204c008040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.232+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20540f14d0 con 0x7f205c1517f0 2024-01-18T00:49:09.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.480+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f20540ed110 con 0x7f205c1517f0 2024-01-18T00:49:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.640+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f202c005820 con 0x7f205c1517f0 2024-01-18T00:49:09.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.680+0000 7f2059600640 1 -- 172.21.15.67:0/3072596219 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18669 (secure 0 0 0) 0x7f20540c5090 con 0x7f205c1517f0 2024-01-18T00:49:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-01-18T00:49:09.684 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":29,"fsid":"cbf3e000-36d7-4ba2-8f3c-40e9fbf9a2c1","created":"2024-01-17T22:59:25.627666+0000","modified":"2024-01-17T23:00:34.045126+0000","last_up_change":"2024-01-17T22:59:41.625725+0000","last_in_change":"2024-01-17T22:59:32.091866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-17T22:59:42.180289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-17T23:00:15.126108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-17T23:00:16.891955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-17T23:00:22.346907+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"737cbe53-a176-4dd6-b75a-58bcd81c59f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6809","nonce":3222856110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6811","nonce":3222856110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6815","nonce":3222856110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3222856110},{"type":"v1","addr":"172.21.15.67:6813","nonce":3222856110}]},"public_addr":"172.21.15.67:6809/3222856110","cluster_addr":"172.21.15.67:6811/3222856110","heartbeat_back_addr":"172.21.15.67:6815/3222856110","heartbeat_front_addr":"172.21.15.67:6813/3222856110","state":["exists","up"]},{"osd":1,"uuid":"821fecd1-9c6f-4c70-804f-cfc665c49c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6817","nonce":2710123956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6819","nonce":2710123956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6825","nonce":2710123956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":2710123956},{"type":"v1","addr":"172.21.15.67:6821","nonce":2710123956}]},"public_addr":"172.21.15.67:6817/2710123956","cluster_addr":"172.21.15.67:6819/2710123956","heartbeat_back_addr":"172.21.15.67:6825/2710123956","heartbeat_front_addr":"172.21.15.67:6821/2710123956","state":["exists","up"]},{"osd":2,"uuid":"4c27f159-264f-4f37-96dd-a6d63f8e48f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6801","nonce":549028895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6803","nonce":549028895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6807","nonce":549028895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":549028895},{"type":"v1","addr":"172.21.15.67:6805","nonce":549028895}]},"public_addr":"172.21.15.67:6801/549028895","cluster_addr":"172.21.15.67:6803/549028895","heartbeat_back_addr":"172.21.15.67:6807/549028895","heartbeat_front_addr":"172.21.15.67:6805/549028895","state":["exists","up"]},{"osd":3,"uuid":"b135c646-e754-4bfd-b04d-28624a242fe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6824","nonce":3364232548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6827","nonce":3364232548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6831","nonce":3364232548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":3364232548},{"type":"v1","addr":"172.21.15.67:6829","nonce":3364232548}]},"public_addr":"172.21.15.67:6824/3364232548","cluster_addr":"172.21.15.67:6827/3364232548","heartbeat_back_addr":"172.21.15.67:6831/3364232548","heartbeat_front_addr":"172.21.15.67:6829/3364232548","state":["exists","up"]},{"osd":4,"uuid":"fc221eb3-1e0a-4ab9-8c88-7484b90f63e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6803","nonce":2141080358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6805","nonce":2141080358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6809","nonce":2141080358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":2141080358},{"type":"v1","addr":"172.21.15.137:6807","nonce":2141080358}]},"public_addr":"172.21.15.137:6803/2141080358","cluster_addr":"172.21.15.137:6805/2141080358","heartbeat_back_addr":"172.21.15.137:6809/2141080358","heartbeat_front_addr":"172.21.15.137:6807/2141080358","state":["exists","up"]},{"osd":5,"uuid":"b09b00bb-ac76-4574-80b0-c479538f84e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6819","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6821","nonce":748642727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6824","nonce":748642727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6832","nonce":748642727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":748642727},{"type":"v1","addr":"172.21.15.137:6828","nonce":748642727}]},"public_addr":"172.21.15.137:6821/748642727","cluster_addr":"172.21.15.137:6824/748642727","heartbeat_back_addr":"172.21.15.137:6832/748642727","heartbeat_front_addr":"172.21.15.137:6828/748642727","state":["exists","up"]},{"osd":6,"uuid":"45c7a720-d042-4c1f-8c7c-0c670f1a344e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6820","nonce":2947557560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6823","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6825","nonce":2947557560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6831","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6833","nonce":2947557560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6827","nonce":2947557560},{"type":"v1","addr":"172.21.15.137:6829","nonce":2947557560}]},"public_addr":"172.21.15.137:6820/2947557560","cluster_addr":"172.21.15.137:6825/2947557560","heartbeat_back_addr":"172.21.15.137:6833/2947557560","heartbeat_front_addr":"172.21.15.137:6829/2947557560","state":["exists","up"]},{"osd":7,"uuid":"828a6f76-53ec-4ac6-aa74-43b884808b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6811","nonce":2951291350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6813","nonce":2951291350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6817","nonce":2951291350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2951291350},{"type":"v1","addr":"172.21.15.137:6815","nonce":2951291350}]},"public_addr":"172.21.15.137:6811/2951291350","cluster_addr":"172.21.15.137:6813/2951291350","heartbeat_back_addr":"172.21.15.137:6817/2951291350","heartbeat_front_addr":"172.21.15.137:6815/2951291350","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.368441+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.207233+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.023535+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.234961+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:37.986885+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.187139+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.144486+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-17T22:59:38.112213+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-18T00:49:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 msgr2=0x7f2034068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 0x7f2034068d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b850 tx=0x7f204c008040 comp rx=0 tx=0).stop 2024-01-18T00:49:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 msgr2=0x7f205c1f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f20540196f0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 shutdown_connections 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2034066840 0x7f2034068d00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f205c1517f0 0x7f205c1f55a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f205c0ca780 0x7f205c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 --2- 172.21.15.67:0/3072596219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205c0ca3a0 0x7f205c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 >> 172.21.15.67:0/3072596219 conn(0x7f205c06ad40 msgr2=0x7f205c156170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 shutdown_connections 2024-01-18T00:49:09.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.684+0000 7f2064600640 1 -- 172.21.15.67:0/3072596219 wait complete. 2024-01-18T00:49:09.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-18T00:49:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 Processor -- start 2024-01-18T00:49:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 -- start start 2024-01-18T00:49:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90e806d210 0x7f90e8072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e815b9c0 con 0x7f90e8072840 2024-01-18T00:49:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e815ae40 con 0x7f90e806d210 2024-01-18T00:49:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.848+0000 7f90ef000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e815b120 con 0x7f90e81517a0 2024-01-18T00:49:09.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.852+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.852+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:55782/0 (socket says 172.21.15.67:55782) 2024-01-18T00:49:09.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.852+0000 7f90e7e00640 1 -- 172.21.15.67:0/1638357378 learned_addr learned my addr 172.21.15.67:0/1638357378 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:09.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.852+0000 7f90e7400640 1 --2- 172.21.15.67:0/1638357378 >> v2:172.21.15.137:3300/0 conn(0x7f90e806d210 0x7f90e8072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.856+0000 7f90e7e00640 1 -- 172.21.15.67:0/1638357378 >> v2:172.21.15.137:3300/0 conn(0x7f90e806d210 msgr2=0x7f90e8072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:09.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.856+0000 7f90e7e00640 1 --2- 172.21.15.67:0/1638357378 >> v2:172.21.15.137:3300/0 conn(0x7f90e806d210 0x7f90e8072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.856+0000 7f90e7e00640 1 -- 172.21.15.67:0/1638357378 >> v1:172.21.15.137:6789/0 conn(0x7f90e8072840 legacy=0x7f90e8157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.856+0000 7f90e7e00640 1 -- 172.21.15.67:0/1638357378 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e815b400 con 0x7f90e81517a0 2024-01-18T00:49:09.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.864+0000 7f90e7e00640 1 --2- 172.21.15.67:0/1638357378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009870 tx=0x7f90d801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219e0fde19cfd5f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:09.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.872+0000 7f90e6a00640 1 -- 172.21.15.67:0/1638357378 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ab620 con 0x7f90e81517a0 2024-01-18T00:49:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.872+0000 7f90e6a00640 1 -- 172.21.15.67:0/1638357378 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f90d80ab780 con 0x7f90e81517a0 2024-01-18T00:49:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.872+0000 7f90e6a00640 1 -- 172.21.15.67:0/1638357378 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80abb30 con 0x7f90e81517a0 2024-01-18T00:49:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- 172.21.15.67:0/1638357378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 msgr2=0x7f90e806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- 172.21.15.67:0/1638357378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009870 tx=0x7f90d801c510 comp rx=0 tx=0).stop 2024-01-18T00:49:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- 172.21.15.67:0/1638357378 shutdown_connections 2024-01-18T00:49:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- 172.21.15.67:0/1638357378 >> v2:172.21.15.137:3300/0 conn(0x7f90e806d210 0x7f90e8072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- 172.21.15.67:0/1638357378 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e81517a0 0x7f90e806ccd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- 172.21.15.67:0/1638357378 >> 172.21.15.67:0/1638357378 conn(0x7f90e80cb070 msgr2=0x7f90e80cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- 172.21.15.67:0/1638357378 shutdown_connections 2024-01-18T00:49:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- 172.21.15.67:0/1638357378 wait complete. 2024-01-18T00:49:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 Processor -- start 2024-01-18T00:49:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- start start 2024-01-18T00:49:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e8072840 0x7f90e8071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90e81517a0 0x7f90e813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e813caa0 con 0x7f90e806d210 2024-01-18T00:49:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81f1470 con 0x7f90e81517a0 2024-01-18T00:49:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.876+0000 7f90ef000640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81f0bd0 con 0x7f90e8072840 2024-01-18T00:49:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.880+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.880+0000 7f90e7e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42754/0 (socket says 172.21.15.67:42754) 2024-01-18T00:49:09.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.880+0000 7f90e7e00640 1 -- 172.21.15.67:0/301120183 learned_addr learned my addr 172.21.15.67:0/301120183 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:09.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.880+0000 7f90e7400640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e8072840 0x7f90e8071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.880+0000 7f90ed000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90e81517a0 0x7f90e813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 -- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e8072840 msgr2=0x7f90e8071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e8072840 0x7f90e8071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 -- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90e81517a0 msgr2=0x7f90e813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90e81517a0 0x7f90e813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 -- 172.21.15.67:0/301120183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80094d0 con 0x7f90e806d210 2024-01-18T00:49:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.884+0000 7f90e7e00640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ad040 tx=0x7f90d80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.888+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80c0480 con 0x7f90e806d210 2024-01-18T00:49:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.888+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f90d80b9070 con 0x7f90e806d210 2024-01-18T00:49:09.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.888+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80c0880 con 0x7f90e806d210 2024-01-18T00:49:09.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.888+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e81f0eb0 con 0x7f90e806d210 2024-01-18T00:49:09.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.888+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e813c730 con 0x7f90e806d210 2024-01-18T00:49:09.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.892+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e80746a0 con 0x7f90e806d210 2024-01-18T00:49:09.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.908+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f90d80b5400 con 0x7f90e806d210 2024-01-18T00:49:09.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.912+0000 7f90dfe00640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 0x7f90c0068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:09.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.912+0000 7f90e7400640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 0x7f90c0068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:09.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:09.912+0000 7f90e7400640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 0x7f90c0068d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f90e8141b80 tx=0x7f90d0009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:10.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.160+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90d80bb070 con 0x7f90e806d210 2024-01-18T00:49:10.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.160+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f90d80ec3c0 con 0x7f90e806d210 2024-01-18T00:49:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.364+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f90e8145130 con 0x7f90e806d210 2024-01-18T00:49:10.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.448+0000 7f90dfe00640 1 -- 172.21.15.67:0/301120183 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f90d80f4e60 con 0x7f90e806d210 2024-01-18T00:49:10.451 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 msgr2=0x7f90c0068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 0x7f90c0068d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f90e8141b80 tx=0x7f90d0009190 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 msgr2=0x7f90e81f04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ad040 tx=0x7f90d80192b0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 shutdown_connections 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f90c0066890 0x7f90c0068d50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90e81517a0 0x7f90e813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f90e8072840 0x7f90e8071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 --2- 172.21.15.67:0/301120183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90e806d210 0x7f90e81f04d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 >> 172.21.15.67:0/301120183 conn(0x7f90e80cb070 msgr2=0x7f90e80c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 shutdown_connections 2024-01-18T00:49:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.452+0000 7f90ef000640 1 -- 172.21.15.67:0/301120183 wait complete. 2024-01-18T00:49:10.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-18T00:49:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.620+0000 7f0624a00640 1 Processor -- start 2024-01-18T00:49:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.620+0000 7f0624a00640 1 -- start start 2024-01-18T00:49:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0624a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f061c153a10 0x7f061c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0624a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f061c0c7dc0 0x7f061c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0624a00640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0c8710 con 0x7f061c15cd10 2024-01-18T00:49:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0624a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c159720 con 0x7f061c0c7dc0 2024-01-18T00:49:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0624a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0c9900 con 0x7f061c153a10 2024-01-18T00:49:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0621600640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f061c15cd10 0x7f061c0c8b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:34116/0 (socket says 172.21.15.67:34116) 2024-01-18T00:49:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0621600640 1 -- 172.21.15.67:0/498613295 learned_addr learned my addr 172.21.15.67:0/498613295 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:49:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0622000640 1 --2- 172.21.15.67:0/498613295 >> v2:172.21.15.137:3300/0 conn(0x7f061c153a10 0x7f061c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.624+0000 7f0622a00640 1 --2- 172.21.15.67:0/498613295 >> v2:172.21.15.67:3300/0 conn(0x7f061c0c7dc0 0x7f061c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.628+0000 7f0622000640 1 -- 172.21.15.67:0/498613295 >> v2:172.21.15.67:3300/0 conn(0x7f061c0c7dc0 msgr2=0x7f061c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.628+0000 7f0622000640 1 --2- 172.21.15.67:0/498613295 >> v2:172.21.15.67:3300/0 conn(0x7f061c0c7dc0 0x7f061c0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.628+0000 7f0622000640 1 -- 172.21.15.67:0/498613295 >> v1:172.21.15.137:6789/0 conn(0x7f061c15cd10 legacy=0x7f061c0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.628+0000 7f0622000640 1 -- 172.21.15.67:0/498613295 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c15a670 con 0x7f061c153a10 2024-01-18T00:49:10.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.636+0000 7f0622000640 1 --2- 172.21.15.67:0/498613295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c153a10 0x7f061c15a130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f061c0cdcc0 tx=0x7f060c01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95e4786b3e04f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0620c00640 1 -- 172.21.15.67:0/498613295 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0a8950 con 0x7f061c153a10 2024-01-18T00:49:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0620c00640 1 -- 172.21.15.67:0/498613295 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f060c0a8ab0 con 0x7f061c153a10 2024-01-18T00:49:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0620c00640 1 -- 172.21.15.67:0/498613295 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c0a8e60 con 0x7f061c153a10 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 -- 172.21.15.67:0/498613295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c153a10 msgr2=0x7f061c15a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 --2- 172.21.15.67:0/498613295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c153a10 0x7f061c15a130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f061c0cdcc0 tx=0x7f060c01ec50 comp rx=0 tx=0).stop 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 -- 172.21.15.67:0/498613295 shutdown_connections 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 --2- 172.21.15.67:0/498613295 >> v2:172.21.15.67:3300/0 conn(0x7f061c0c7dc0 0x7f061c0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 --2- 172.21.15.67:0/498613295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c153a10 0x7f061c15a130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 -- 172.21.15.67:0/498613295 >> 172.21.15.67:0/498613295 conn(0x7f061c061100 msgr2=0x7f061c061510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 -- 172.21.15.67:0/498613295 shutdown_connections 2024-01-18T00:49:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.644+0000 7f0624a00640 1 -- 172.21.15.67:0/498613295 wait complete. 2024-01-18T00:49:10.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 Processor -- start 2024-01-18T00:49:10.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 -- start start 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c0c7dc0 0x7f061c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061c153a10 0x7f061c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0c4ec0 con 0x7f061c153a10 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0c59c0 con 0x7f061c0c7dc0 2024-01-18T00:49:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0624a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1549e0 con 0x7f061c15cd10 2024-01-18T00:49:10.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0622a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:10.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0622000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c0c7dc0 0x7f061c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:10.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0622a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:42116/0 (socket says 172.21.15.67:42116) 2024-01-18T00:49:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.648+0000 7f0622a00640 1 -- 172.21.15.67:0/2426581140 learned_addr learned my addr 172.21.15.67:0/2426581140 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.656+0000 7f0622a00640 1 -- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c0c7dc0 msgr2=0x7f061c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.656+0000 7f0622a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c0c7dc0 0x7f061c0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.656+0000 7f0622a00640 1 -- 172.21.15.67:0/2426581140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061c153a10 msgr2=0x7f061c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.656+0000 7f0622a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061c153a10 0x7f061c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.656+0000 7f0622a00640 1 -- 172.21.15.67:0/2426581140 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009420 con 0x7f061c15cd10 2024-01-18T00:49:10.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.660+0000 7f0622a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f061400efc0 tx=0x7f061400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.664+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614014480 con 0x7f061c15cd10 2024-01-18T00:49:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.664+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f061400f040 con 0x7f061c15cd10 2024-01-18T00:49:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.664+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614014840 con 0x7f061c15cd10 2024-01-18T00:49:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.664+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c1e2b30 con 0x7f061c15cd10 2024-01-18T00:49:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.664+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0c5400 con 0x7f061c15cd10 2024-01-18T00:49:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:10.668+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c0746a0 con 0x7f061c15cd10 2024-01-18T00:49:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.008+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f06140149a0 con 0x7f061c15cd10 2024-01-18T00:49:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.008+0000 7f061a000640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 0x7f05f4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:11.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.008+0000 7f0622000640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 0x7f05f4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:11.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.012+0000 7f0622000640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 0x7f05f4068d50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f060c0b2000 tx=0x7f060c0aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:11.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.012+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f0614056b20 con 0x7f061c15cd10 2024-01-18T00:49:11.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.036+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f0614052760 con 0x7f061c15cd10 2024-01-18T00:49:11.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:11.248+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f061c0c8900 con 0x7f061c15cd10 2024-01-18T00:49:12.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f061a000640 1 -- 172.21.15.67:0/2426581140 <== mon.2 v2:172.21.15.137:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0614018020 con 0x7f061c15cd10 2024-01-18T00:49:12.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 msgr2=0x7f05f4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 0x7f05f4068d50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f060c0b2000 tx=0x7f060c0aa070 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 msgr2=0x7f061c155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f061400efc0 tx=0x7f061400c490 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 shutdown_connections 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f05f4066890 0x7f05f4068d50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f061c15cd10 0x7f061c155f50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f061c153a10 0x7f061c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 --2- 172.21.15.67:0/2426581140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061c0c7dc0 0x7f061c0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 >> 172.21.15.67:0/2426581140 conn(0x7f061c061100 msgr2=0x7f061c158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 shutdown_connections 2024-01-18T00:49:12.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.376+0000 7f0624a00640 1 -- 172.21.15.67:0/2426581140 wait complete. 2024-01-18T00:49:12.398 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-18T00:49:12.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.540+0000 7f27c2a00640 1 Processor -- start 2024-01-18T00:49:12.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.540+0000 7f27c2a00640 1 -- start start 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27c2a00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27bc1539b0 0x7f27bc0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27c2a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27bc0ca2b0 0x7f27bc070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27c2a00640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc15a5e0 con 0x7f27bc071220 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27c2a00640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc15ce40 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27c2a00640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc153d90 con 0x7f27bc1539b0 2024-01-18T00:49:12.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27bb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27bc0ca2b0 0x7f27bc070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:12.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27bbe00640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27bc1539b0 0x7f27bc0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:12.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27bb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f27bc0ca2b0 0x7f27bc070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47576/0 (socket says 172.21.15.67:47576) 2024-01-18T00:49:12.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.544+0000 7f27bb400640 1 -- 172.21.15.67:0/3830490994 learned_addr learned my addr 172.21.15.67:0/3830490994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.548+0000 7f27bb400640 1 -- 172.21.15.67:0/3830490994 >> v2:172.21.15.137:3300/0 conn(0x7f27bc1539b0 msgr2=0x7f27bc0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.548+0000 7f27bb400640 1 --2- 172.21.15.67:0/3830490994 >> v2:172.21.15.137:3300/0 conn(0x7f27bc1539b0 0x7f27bc0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.548+0000 7f27bb400640 1 -- 172.21.15.67:0/3830490994 >> v1:172.21.15.67:6789/0 conn(0x7f27bc071220 legacy=0x7f27bc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.548+0000 7f27bb400640 1 -- 172.21.15.67:0/3830490994 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0c7900 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.552+0000 7f27bb400640 1 --2- 172.21.15.67:0/3830490994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc070ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ca240 tx=0x7f27a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735bd19f54d0f52e server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27baa00640 1 -- 172.21.15.67:0/3830490994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a40ab610 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27baa00640 1 -- 172.21.15.67:0/3830490994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27a40ab770 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27baa00640 1 -- 172.21.15.67:0/3830490994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a40abb20 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 -- 172.21.15.67:0/3830490994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc0ca2b0 msgr2=0x7f27bc070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3830490994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc070ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ca240 tx=0x7f27a401c500 comp rx=0 tx=0).stop 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 -- 172.21.15.67:0/3830490994 shutdown_connections 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3830490994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc070ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3830490994 >> v2:172.21.15.137:3300/0 conn(0x7f27bc1539b0 0x7f27bc0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 -- 172.21.15.67:0/3830490994 >> 172.21.15.67:0/3830490994 conn(0x7f27bc06ad40 msgr2=0x7f27bc06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 -- 172.21.15.67:0/3830490994 shutdown_connections 2024-01-18T00:49:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.556+0000 7f27c2a00640 1 -- 172.21.15.67:0/3830490994 wait complete. 2024-01-18T00:49:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 Processor -- start 2024-01-18T00:49:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 -- start start 2024-01-18T00:49:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27bc071220 0x7f27bc1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc1539b0 0x7f27bc0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc155c60 con 0x7f27bc1539b0 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc150800 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27c2a00640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc155820 con 0x7f27bc071220 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27bb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27bb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.67:43992/0 (socket says 172.21.15.67:43992) 2024-01-18T00:49:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.560+0000 7f27bb400640 1 -- 172.21.15.67:0/3477375652 learned_addr learned my addr 172.21.15.67:0/3477375652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:12.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bbe00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27bc071220 0x7f27bc1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bb400640 1 -- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27bc071220 msgr2=0x7f27bc1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bb400640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27bc071220 0x7f27bc1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bb400640 1 -- 172.21.15.67:0/3477375652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc1539b0 msgr2=0x7f27bc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bb400640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc1539b0 0x7f27bc0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.564+0000 7f27bb400640 1 -- 172.21.15.67:0/3477375652 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a40094d0 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.568+0000 7f27bb400640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27a401a130 tx=0x7f27a401ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:12.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a40ab610 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27a40b4820 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a40b4bf0 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc1563f0 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc154110 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.572+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc153f70 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.604+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f27a40b4d50 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.604+0000 7f27b3e00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 0x7f2794068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.604+0000 7f27bbe00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 0x7f2794068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:12.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.604+0000 7f27bbe00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 0x7f2794068d50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009ac0 tx=0x7f27ac009190 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:12.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.608+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f27a40ef5c0 con 0x7f27bc0ca2b0 2024-01-18T00:49:12.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:12.864+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f27a40eb900 con 0x7f27bc0ca2b0 2024-01-18T00:49:13.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.028+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27bc0c4060 con 0x7f27bc0ca2b0 2024-01-18T00:49:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27b3e00640 1 -- 172.21.15.67:0/3477375652 <== mon.1 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27bc0c4060 con 0x7f27bc0ca2b0 2024-01-18T00:49:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 msgr2=0x7f2794068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 0x7f2794068d50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009ac0 tx=0x7f27ac009190 comp rx=0 tx=0).stop 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 msgr2=0x7f27bc0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f27a401a130 tx=0x7f27a401ad40 comp rx=0 tx=0).stop 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 shutdown_connections 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f2794066890 0x7f2794068d50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27bc1539b0 0x7f27bc0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27bc0ca2b0 0x7f27bc0ccd80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 --2- 172.21.15.67:0/3477375652 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f27bc071220 0x7f27bc1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 >> 172.21.15.67:0/3477375652 conn(0x7f27bc06ad40 msgr2=0x7f27bc1577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 shutdown_connections 2024-01-18T00:49:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.748+0000 7f27c2a00640 1 -- 172.21.15.67:0/3477375652 wait complete. 2024-01-18T00:49:13.773 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-18T00:49:13.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 Processor -- start 2024-01-18T00:49:13.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 -- start start 2024-01-18T00:49:13.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04c4153940 0x7f04c40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:13.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 0x7f04c415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:13.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c415dba0 con 0x7f04c40ca2b0 2024-01-18T00:49:13.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c415a570 con 0x7f04c4153940 2024-01-18T00:49:13.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.940+0000 7f04cb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41599f0 con 0x7f04c415d1d0 2024-01-18T00:49:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.944+0000 7f04c9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 0x7f04c415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.944+0000 7f04c8a00640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f04c4153940 0x7f04c40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.944+0000 7f04c9400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 0x7f04c415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3301/0 says I am v2:172.21.15.67:42134/0 (socket says 172.21.15.67:42134) 2024-01-18T00:49:13.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.944+0000 7f04c9400640 1 -- 172.21.15.67:0/4225054603 learned_addr learned my addr 172.21.15.67:0/4225054603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:13.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.948+0000 7f04c8a00640 1 -- 172.21.15.67:0/4225054603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 msgr2=0x7f04c415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-18T00:49:13.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.948+0000 7f04c8a00640 1 --2- 172.21.15.67:0/4225054603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 0x7f04c415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.948+0000 7f04c8a00640 1 -- 172.21.15.67:0/4225054603 >> v1:172.21.15.67:6789/0 conn(0x7f04c40ca2b0 legacy=0x7f04c4070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.948+0000 7f04c8a00640 1 -- 172.21.15.67:0/4225054603 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4159cd0 con 0x7f04c4153940 2024-01-18T00:49:13.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.952+0000 7f04c8a00640 1 --2- 172.21.15.67:0/4225054603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c40c93a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04b40097c0 tx=0x7f04b401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267769d7b9ae898c server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.956+0000 7f04c3400640 1 -- 172.21.15.67:0/4225054603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40a8970 con 0x7f04c4153940 2024-01-18T00:49:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.956+0000 7f04c3400640 1 -- 172.21.15.67:0/4225054603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f04b40a8ad0 con 0x7f04c4153940 2024-01-18T00:49:13.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.956+0000 7f04c3400640 1 -- 172.21.15.67:0/4225054603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40a8e80 con 0x7f04c4153940 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- 172.21.15.67:0/4225054603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 msgr2=0x7f04c40c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- 172.21.15.67:0/4225054603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c40c93a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04b40097c0 tx=0x7f04b401ec70 comp rx=0 tx=0).stop 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- 172.21.15.67:0/4225054603 shutdown_connections 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- 172.21.15.67:0/4225054603 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c415d1d0 0x7f04c415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- 172.21.15.67:0/4225054603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c40c93a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- 172.21.15.67:0/4225054603 >> 172.21.15.67:0/4225054603 conn(0x7f04c406ad40 msgr2=0x7f04c406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- 172.21.15.67:0/4225054603 shutdown_connections 2024-01-18T00:49:13.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- 172.21.15.67:0/4225054603 wait complete. 2024-01-18T00:49:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 Processor -- start 2024-01-18T00:49:13.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- start start 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c40ca2b0 0x7f04c40c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c415d1d0 0x7f04c40c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40c6500 con 0x7f04c4153940 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4151e90 con 0x7f04c415d1d0 2024-01-18T00:49:13.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.960+0000 7f04cb400640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41520f0 con 0x7f04c40ca2b0 2024-01-18T00:49:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.964+0000 7f04c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.964+0000 7f04c3e00640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47602/0 (socket says 172.21.15.67:47602) 2024-01-18T00:49:13.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.964+0000 7f04c3e00640 1 -- 172.21.15.67:0/2748273677 learned_addr learned my addr 172.21.15.67:0/2748273677 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.964+0000 7f04c9400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c415d1d0 0x7f04c40c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:13.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.964+0000 7f04c8a00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c40ca2b0 0x7f04c40c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.968+0000 7f04c3e00640 1 -- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c40ca2b0 msgr2=0x7f04c40c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.968+0000 7f04c3e00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c40ca2b0 0x7f04c40c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.968+0000 7f04c3e00640 1 -- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c415d1d0 msgr2=0x7f04c40c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.968+0000 7f04c3e00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c415d1d0 0x7f04c40c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:13.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.968+0000 7f04c3e00640 1 -- 172.21.15.67:0/2748273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009420 con 0x7f04c4153940 2024-01-18T00:49:13.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.972+0000 7f04c3e00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c420 tx=0x7f04ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0052d0 con 0x7f04c4153940 2024-01-18T00:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f04ac005430 con 0x7f04c4153940 2024-01-18T00:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac007280 con 0x7f04c4153940 2024-01-18T00:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c41516b0 con 0x7f04c4153940 2024-01-18T00:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40c6190 con 0x7f04c4153940 2024-01-18T00:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:13.976+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c40c6350 con 0x7f04c4153940 2024-01-18T00:49:14.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.004+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f04ac0073e0 con 0x7f04c4153940 2024-01-18T00:49:14.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.004+0000 7f04c0c00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 0x7f049c068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.004+0000 7f04c8a00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 0x7f049c068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:14.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.004+0000 7f04c8a00640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 0x7f049c068d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f04b40b2000 tx=0x7f04b40aa070 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:14.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.252+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f04ac054d60 con 0x7f04c4153940 2024-01-18T00:49:14.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.252+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f04ac051010 con 0x7f04c4153940 2024-01-18T00:49:14.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.416+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04c41525f0 con 0x7f04c4153940 2024-01-18T00:49:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.636+0000 7f04c0c00640 1 -- 172.21.15.67:0/2748273677 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f04c41525f0 con 0x7f04c4153940 2024-01-18T00:49:14.640 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 msgr2=0x7f049c068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 0x7f049c068d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f04b40b2000 tx=0x7f04b40aa070 comp rx=0 tx=0).stop 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 msgr2=0x7f04c41eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c420 tx=0x7f04ac00c8e0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 shutdown_connections 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f049c066890 0x7f049c068d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c415d1d0 0x7f04c40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04c4153940 0x7f04c41eedb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 --2- 172.21.15.67:0/2748273677 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f04c40ca2b0 0x7f04c40c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 >> 172.21.15.67:0/2748273677 conn(0x7f04c406ad40 msgr2=0x7f04c40711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:14.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 shutdown_connections 2024-01-18T00:49:14.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.640+0000 7f04cb400640 1 -- 172.21.15.67:0/2748273677 wait complete. 2024-01-18T00:49:14.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-18T00:49:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 Processor -- start 2024-01-18T00:49:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 -- start start 2024-01-18T00:49:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4fec070f40 0x7f4fec15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec0b2330 con 0x7f4fec1518f0 2024-01-18T00:49:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec0c7d80 con 0x7f4fec0c9330 2024-01-18T00:49:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4ff2600640 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec0c8060 con 0x7f4fec070f40 2024-01-18T00:49:14.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4feaa00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4fec0c9330 0x7f4fec1511e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.67:34126/0 (socket says 172.21.15.67:34126) 2024-01-18T00:49:14.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.836+0000 7f4feaa00640 1 -- 172.21.15.67:0/4020406832 learned_addr learned my addr 172.21.15.67:0/4020406832 (peer_addr_for_me v1:172.21.15.67:0/0) 2024-01-18T00:49:14.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.844+0000 7f4feb400640 1 --2- 172.21.15.67:0/4020406832 >> v2:172.21.15.67:3300/0 conn(0x7f4fec070f40 0x7f4fec15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:14.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.848+0000 7f4feb400640 1 -- 172.21.15.67:0/4020406832 >> v1:172.21.15.137:6789/0 conn(0x7f4fec0c9330 legacy=0x7f4fec1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.848+0000 7f4feb400640 1 -- 172.21.15.67:0/4020406832 >> v1:172.21.15.67:6789/0 conn(0x7f4fec1518f0 legacy=0x7f4fec161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.848+0000 7f4feb400640 1 -- 172.21.15.67:0/4020406832 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0c8340 con 0x7f4fec070f40 2024-01-18T00:49:14.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.904+0000 7f4feb400640 1 --2- 172.21.15.67:0/4020406832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec15b2e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0097c0 tx=0x7f4fdc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaeda11f026127a server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:14.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.908+0000 7f4fea000640 1 -- 172.21.15.67:0/4020406832 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0a8970 con 0x7f4fec070f40 2024-01-18T00:49:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.908+0000 7f4fea000640 1 -- 172.21.15.67:0/4020406832 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4fdc0a8ad0 con 0x7f4fec070f40 2024-01-18T00:49:14.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.908+0000 7f4fea000640 1 -- 172.21.15.67:0/4020406832 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0a8e80 con 0x7f4fec070f40 2024-01-18T00:49:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.908+0000 7f4ff2600640 1 -- 172.21.15.67:0/4020406832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 msgr2=0x7f4fec15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.908+0000 7f4ff2600640 1 --2- 172.21.15.67:0/4020406832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec15b2e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0097c0 tx=0x7f4fdc01ec70 comp rx=0 tx=0).stop 2024-01-18T00:49:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- 172.21.15.67:0/4020406832 shutdown_connections 2024-01-18T00:49:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 --2- 172.21.15.67:0/4020406832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec15b2e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- 172.21.15.67:0/4020406832 >> 172.21.15.67:0/4020406832 conn(0x7f4fec06ad40 msgr2=0x7f4fec06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- 172.21.15.67:0/4020406832 shutdown_connections 2024-01-18T00:49:14.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- 172.21.15.67:0/4020406832 wait complete. 2024-01-18T00:49:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 Processor -- start 2024-01-18T00:49:14.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- start start 2024-01-18T00:49:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec0c9330 0x7f4fec14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec1518f0 0x7f4fec0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec1541a0 con 0x7f4fec070f40 2024-01-18T00:49:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec06c1e0 con 0x7f4fec1518f0 2024-01-18T00:49:14.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.912+0000 7f4ff2600640 1 -- --> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec1543f0 con 0x7f4fec0c9330 2024-01-18T00:49:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.916+0000 7f4feaa00640 1 --2- >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec0c9330 0x7f4fec14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.916+0000 7f4feb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.916+0000 7f4feb400640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47620/0 (socket says 172.21.15.67:47620) 2024-01-18T00:49:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.916+0000 7f4feb400640 1 -- 172.21.15.67:0/3443769735 learned_addr learned my addr 172.21.15.67:0/3443769735 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-01-18T00:49:14.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 -- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec0c9330 msgr2=0x7f4fec14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec0c9330 0x7f4fec14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 -- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec1518f0 msgr2=0x7f4fec0c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:14.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec1518f0 0x7f4fec0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:14.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 -- 172.21.15.67:0/3443769735 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc009420 con 0x7f4fec070f40 2024-01-18T00:49:14.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.920+0000 7f4feb400640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc01b880 tx=0x7f4fdc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:14.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.924+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b9630 con 0x7f4fec070f40 2024-01-18T00:49:14.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.928+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4fdc0b97b0 con 0x7f4fec070f40 2024-01-18T00:49:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.928+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec1546d0 con 0x7f4fec070f40 2024-01-18T00:49:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.928+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b9b80 con 0x7f4fec070f40 2024-01-18T00:49:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.928+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec06be70 con 0x7f4fec070f40 2024-01-18T00:49:14.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.928+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0746a0 con 0x7f4fec070f40 2024-01-18T00:49:14.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.948+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 85993+0+0 (secure 0 0 0) 0x7f4fdc0b7040 con 0x7f4fec070f40 2024-01-18T00:49:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.948+0000 7f4fe3400640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 0x7f4fc4068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-18T00:49:14.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.948+0000 7f4feaa00640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 0x7f4fc4068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-18T00:49:14.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.948+0000 7f4feaa00640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 0x7f4fc4068d50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4fec06d9d0 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-18T00:49:14.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:14.952+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f4fdc0f4590 con 0x7f4fec070f40 2024-01-18T00:49:15.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:15.196+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173695 (secure 0 0 0) 0x7f4fdc0f0140 con 0x7f4fec070f40 2024-01-18T00:49:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:15.356+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fec071530 con 0x7f4fec070f40 2024-01-18T00:49:15.722 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:50:03.941 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.725 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:50:03.944 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.750 INFO:tasks.ceph.mon.a.smithi067.stderr:==00:01:50:03.969 27348== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.845 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:50:04.156 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.848 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:50:04.159 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.851 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:50:04.162 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.858 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:50:04.169 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.916 INFO:tasks.ceph.mon.c.smithi137.stderr:==00:01:50:04.226 27837== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:15.922 INFO:tasks.ceph.mon.b.smithi137.stderr:==00:01:50:04.232 27836== Warning: unimplemented fcntl command: 1036 2024-01-18T00:49:16.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4fe3400640 1 -- 172.21.15.67:0/3443769735 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f4fdc0b5030 con 0x7f4fec070f40 2024-01-18T00:49:16.398 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data_ec' removed 2024-01-18T00:49:16.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 msgr2=0x7f4fc4068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 0x7f4fc4068d50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4fec06d9d0 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 msgr2=0x7f4fec06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc01b880 tx=0x7f4fdc01ba10 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 shutdown_connections 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:6800/942351233,v1:172.21.15.137:6801/942351233] conn(0x7f4fc4066890 0x7f4fc4068d50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec1518f0 0x7f4fec0c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.137:3301/0,v1:172.21.15.137:6790/0] conn(0x7f4fec0c9330 0x7f4fec14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 --2- 172.21.15.67:0/3443769735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fec070f40 0x7f4fec06c670 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.396+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 >> 172.21.15.67:0/3443769735 conn(0x7f4fec06ad40 msgr2=0x7f4fec0c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.400+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 shutdown_connections 2024-01-18T00:49:16.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-01-18T00:49:16.400+0000 7f4ff2600640 1 -- 172.21.15.67:0/3443769735 wait complete. 2024-01-18T00:49:16.431 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-18T00:49:16.431 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-18T00:49:16.431 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:16.444 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:49:16.432+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 31161) UID: 0 2024-01-18T00:49:16.444 INFO:tasks.ceph.mds.a.smithi067.stderr:2024-01-18T00:49:16.432+0000 b9ce640 -1 mds.a *** got signal Terminated *** 2024-01-18T00:49:19.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-18T00:49:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-18T00:49:19.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-01-18T00:49:22.533 INFO:tasks.ceph.mds.a:Stopped 2024-01-18T00:49:22.534 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-18T00:49:22.534 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:22.544 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:49:22.535+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 31162) UID: 0 2024-01-18T00:49:22.544 INFO:tasks.ceph.mds.c.smithi067.stderr:2024-01-18T00:49:22.535+0000 b9ce640 -1 mds.c *** got signal Terminated *** 2024-01-18T00:49:25.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-18T00:49:25.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-01-18T00:49:25.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-01-18T00:49:25.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2024-01-18T00:49:28.635 INFO:tasks.ceph.mds.c:Stopped 2024-01-18T00:49:28.636 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-18T00:49:28.636 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:28.647 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:49:28.635+0000 b9ce640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 31166) UID: 0 2024-01-18T00:49:28.647 INFO:tasks.ceph.mds.e.smithi067.stderr:2024-01-18T00:49:28.635+0000 b9ce640 -1 mds.e *** got signal Terminated *** 2024-01-18T00:49:31.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2024-01-18T00:49:31.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2024-01-18T00:49:31.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~13s 2024-01-18T00:49:31.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-01-18T00:49:34.737 INFO:tasks.ceph.mds.e:Stopped 2024-01-18T00:49:34.738 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-18T00:49:34.738 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:34.738 INFO:tasks.ceph.mds.b:Stopped 2024-01-18T00:49:34.738 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-18T00:49:34.738 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:34.738 INFO:tasks.ceph.mds.d:Stopped 2024-01-18T00:49:34.738 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-18T00:49:34.738 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:34.739 INFO:tasks.ceph.mds.f:Stopped 2024-01-18T00:49:34.739 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-18T00:49:34.739 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-18T00:49:34.739 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:34.740 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-18T00:49:34.739+0000 7f4f2d200640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27457) UID: 0 2024-01-18T00:49:34.740 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-01-18T00:49:34.739+0000 7f4f2d200640 -1 osd.0 36 *** Got signal Terminated *** 2024-01-18T00:49:38.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-18T00:49:38.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-18T00:49:38.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-01-18T00:49:38.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-01-18T00:49:40.841 INFO:tasks.ceph.osd.0:Stopped 2024-01-18T00:49:40.841 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-18T00:49:40.841 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:40.842 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-18T00:49:40.843+0000 7f12a5400640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27460) UID: 0 2024-01-18T00:49:40.842 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-01-18T00:49:40.843+0000 7f12a5400640 -1 osd.1 38 *** Got signal Terminated *** 2024-01-18T00:49:44.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-18T00:49:44.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-01-18T00:49:46.943 INFO:tasks.ceph.osd.1:Stopped 2024-01-18T00:49:46.944 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-18T00:49:46.944 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:46.945 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-18T00:49:46.943+0000 7f8ef0e00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27462) UID: 0 2024-01-18T00:49:46.945 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-01-18T00:49:46.943+0000 7f8ef0e00640 -1 osd.2 39 *** Got signal Terminated *** 2024-01-18T00:49:50.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-18T00:49:50.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-18T00:49:53.045 INFO:tasks.ceph.osd.2:Stopped 2024-01-18T00:49:53.045 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-18T00:49:53.045 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:53.046 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-18T00:49:53.047+0000 7f45de800640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27465) UID: 0 2024-01-18T00:49:53.046 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-01-18T00:49:53.047+0000 7f45de800640 -1 osd.3 40 *** Got signal Terminated *** 2024-01-18T00:49:56.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-18T00:49:56.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-18T00:49:59.147 INFO:tasks.ceph.osd.3:Stopped 2024-01-18T00:49:59.147 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-18T00:49:59.147 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:49:59.149 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-18T00:49:59.148+0000 7f7614782640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28226) UID: 0 2024-01-18T00:49:59.149 INFO:tasks.ceph.osd.4.smithi137.stderr:2024-01-18T00:49:59.148+0000 7f7614782640 -1 osd.4 41 *** Got signal Terminated *** 2024-01-18T00:50:01.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-18T00:50:01.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-18T00:50:05.249 INFO:tasks.ceph.osd.4:Stopped 2024-01-18T00:50:05.249 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-18T00:50:05.249 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:05.250 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-18T00:50:05.252+0000 7fdfc0c07640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28227) UID: 0 2024-01-18T00:50:05.250 INFO:tasks.ceph.osd.5.smithi137.stderr:2024-01-18T00:50:05.252+0000 7fdfc0c07640 -1 osd.5 42 *** Got signal Terminated *** 2024-01-18T00:50:07.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-18T00:50:07.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-18T00:50:11.351 INFO:tasks.ceph.osd.5:Stopped 2024-01-18T00:50:11.351 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-18T00:50:11.351 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:11.352 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-18T00:50:11.348+0000 7f8a59f5f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28230) UID: 0 2024-01-18T00:50:11.352 INFO:tasks.ceph.osd.6.smithi137.stderr:2024-01-18T00:50:11.348+0000 7f8a59f5f640 -1 osd.6 43 *** Got signal Terminated *** 2024-01-18T00:50:13.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-18T00:50:13.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-01-18T00:50:17.453 INFO:tasks.ceph.osd.6:Stopped 2024-01-18T00:50:17.454 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-18T00:50:17.454 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:17.455 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-18T00:50:17.452+0000 7fed77133640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28232) UID: 0 2024-01-18T00:50:17.455 INFO:tasks.ceph.osd.7.smithi137.stderr:2024-01-18T00:50:17.452+0000 7fed77133640 -1 osd.7 43 *** Got signal Terminated *** 2024-01-18T00:50:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-18T00:50:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-01-18T00:50:23.555 INFO:tasks.ceph.osd.7:Stopped 2024-01-18T00:50:23.555 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-18T00:50:23.556 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-18T00:50:23.556 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:23.611 INFO:tasks.ceph.mgr.y:Stopped 2024-01-18T00:50:23.611 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-18T00:50:23.611 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:23.643 INFO:tasks.ceph.mgr.x:Stopped 2024-01-18T00:50:23.643 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-18T00:50:23.643 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-18T00:50:23.643 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:23.655 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:50:23.646+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27344) UID: 0 2024-01-18T00:50:23.655 INFO:tasks.ceph.mon.a.smithi067.stderr:2024-01-18T00:50:23.646+0000 a369640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-18T00:50:23.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-18T00:50:29.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-18T00:50:29.745 INFO:tasks.ceph.mon.a:Stopped 2024-01-18T00:50:29.745 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-18T00:50:29.745 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:29.758 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:50:29.748+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27829) UID: 0 2024-01-18T00:50:29.758 INFO:tasks.ceph.mon.b.smithi137.stderr:2024-01-18T00:50:29.748+0000 a369640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-01-18T00:50:34.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-18T00:50:34.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-18T00:50:35.847 INFO:tasks.ceph.mon.b:Stopped 2024-01-18T00:50:35.847 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-18T00:50:35.847 INFO:teuthology.orchestra.run:waiting for 300 2024-01-18T00:50:35.872 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:50:35.848+0000 a369640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27830) UID: 0 2024-01-18T00:50:35.876 INFO:tasks.ceph.mon.c.smithi137.stderr:2024-01-18T00:50:35.848+0000 a369640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-01-18T00:50:39.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-18T00:50:39.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-18T00:50:41.949 INFO:tasks.ceph.mon.c:Stopped 2024-01-18T00:50:41.949 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-18T00:50:41.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-18T00:50:41.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:50:41.985 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-18T00:50:42.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:50:42.374 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-18T00:50:42.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:50:42.557 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-18T00:50:42.766 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:50:42.766 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-18T00:50:42.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-18T00:50:42.989 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-18T00:50:43.260 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-18T00:50:43.260 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-18T00:50:43.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-18T00:50:43.439 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-18T00:50:43.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi137.front.sepia.ceph.com 2024-01-18T00:50:43.617 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-18T00:50:43.767 INFO:tasks.ceph:Archiving mon data... 2024-01-18T00:50:43.768 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/data/mon.a.tgz 2024-01-18T00:50:43.768 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-01-18T00:50:43.779 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.9iRbVQSLjC 2024-01-18T00:50:43.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9iRbVQSLjC 2024-01-18T00:50:43.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.9iRbVQSLjC 2024-01-18T00:50:43.985 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.9iRbVQSLjC is 366KB 2024-01-18T00:50:44.046 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.9iRbVQSLjC 2024-01-18T00:50:44.055 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/data/mon.b.tgz 2024-01-18T00:50:44.055 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-01-18T00:50:44.061 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.BAYuglriSX 2024-01-18T00:50:44.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BAYuglriSX 2024-01-18T00:50:44.189 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.BAYuglriSX 2024-01-18T00:50:44.255 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.BAYuglriSX is 378KB 2024-01-18T00:50:44.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-18T00:50:44.355 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.BAYuglriSX 2024-01-18T00:50:44.360 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/data/mon.c.tgz 2024-01-18T00:50:44.361 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-01-18T00:50:44.409 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.kAo7n4VHDY 2024-01-18T00:50:44.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kAo7n4VHDY 2024-01-18T00:50:44.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.kAo7n4VHDY 2024-01-18T00:50:44.604 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.kAo7n4VHDY is 378KB 2024-01-18T00:50:44.622 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.kAo7n4VHDY 2024-01-18T00:50:44.627 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-18T00:50:44.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-18T00:50:44.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-18T00:50:44.811 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun 2024-01-18T00:50:45.157 INFO:tasks.ceph:Archiving crash dumps... 2024-01-18T00:50:45.159 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/remote/smithi067/crash 2024-01-18T00:50:45.160 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-18T00:50:45.182 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/remote/smithi137/crash 2024-01-18T00:50:45.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-18T00:50:45.196 INFO:tasks.ceph:Shutting down logrotate 2024-01-18T00:50:45.197 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:50:45.197 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-18T00:50:45.207 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) rocksdb::ObjectLibrary::AddFactoryEntry(char const*, std::unique_ptr >&&) UnknownInlinedFun During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_1ec1182e55b4a38b17dd0d004d9fa6814d0269d4/qa/tasks/ceph.py", line 189, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:50:45.207 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-18T00:50:45.207 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-18T00:50:45.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-18T00:50:45.317 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-18T00:50:45.325 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-18T00:50:45.326 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-18T00:50:45.329 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-18T00:50:45.346 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2024-01-18T00:50:45.347 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2024-01-18T00:50:45.347 INFO:teuthology.orchestra.run.smithi067.stdout:*hv01.front.sepi 44.4.53.2 2 u 13 256 377 0.153 +1.775 0.269 2024-01-18T00:50:45.347 INFO:teuthology.orchestra.run.smithi067.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 256 377 0.168 -2.013 0.309 2024-01-18T00:50:45.347 INFO:teuthology.orchestra.run.smithi067.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 256 377 0.172 -1.119 0.194 2024-01-18T00:50:45.347 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 44.4.53.2 2 u 262 256 377 0.188 +0.345 0.463 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 256 377 0.198 -2.248 0.735 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 103 256 377 0.151 -1.467 0.747 2024-01-18T00:50:45.349 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-01-18T00:50:45.349 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-18T00:50:45.358 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-18T00:50:45.359 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-18T00:50:45.367 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-18T00:50:45.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-18T00:50:45.385 INFO:teuthology.task.internal:Duration was 11633.249764 seconds 2024-01-18T00:50:45.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-18T00:50:45.395 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-18T00:50:45.395 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-18T00:50:45.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-18T00:50:45.482 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-18T00:50:45.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-01-18T00:50:45.483 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-18T00:50:45.504 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-01-18T00:50:45.504 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-18T00:50:45.514 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-18T00:50:45.515 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-18T00:50:45.551 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-18T00:50:45.909 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-18T00:50:45.909 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-18T00:50:45.912 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-18T00:50:45.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-18T00:50:45.996 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-18T00:50:45.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-18T00:50:46.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-18T00:50:46.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-18T00:50:46.041 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:50:46.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:50:46.078 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-01-18T00:50:46.082 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-01-18T00:50:46.108 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:50:46.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-18T00:50:46.152 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-18T00:50:46.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-18T00:50:46.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-18T00:50:46.167 INFO:teuthology.task.internal:Transferring archived files... 2024-01-18T00:50:46.168 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/remote/smithi067 2024-01-18T00:50:46.168 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-18T00:50:46.224 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277/remote/smithi137 2024-01-18T00:50:46.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-18T00:50:46.246 INFO:teuthology.task.internal:Removing archive directory... 2024-01-18T00:50:46.247 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-18T00:50:46.263 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-18T00:50:46.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-18T00:50:46.304 INFO:teuthology.task.internal:Not uploading archives. 2024-01-18T00:50:46.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-18T00:50:46.315 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-18T00:50:46.315 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-18T00:50:46.318 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-18T00:50:46.324 INFO:teuthology.orchestra.run.smithi067.stdout: 658069 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 18 00:50 /home/ubuntu/cephtest 2024-01-18T00:50:46.341 INFO:teuthology.orchestra.run.smithi137.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 18 00:50 /home/ubuntu/cephtest 2024-01-18T00:50:46.343 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-18T00:50:46.353 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-18T00:50:46.363 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi067 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2024-01-18T00:50:46.364 INFO:teuthology.nuke:Checking targets against current locks 2024-01-18T00:50:46.390 DEBUG:teuthology.nuke:shortname: smithi067 2024-01-18T00:50:46.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T00:50:46.415 DEBUG:teuthology.nuke:shortname: smithi137 2024-01-18T00:50:46.415 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-18T00:50:46.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 21:27:14.319617', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbBVX91fPWhWEghfT3/vYO8wim162SMfESdMeAMbx9/dXHCllqg004UB9sL6cF6d4GFju8DsG+UQ2ZEAE0M/qg='} 2024-01-18T00:50:46.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-01-17_20:20:37-fs-main-distro-default-smithi/7519277', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 21:27:14.318510', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLRieEIZnvYpaO6HMlc5Cf6XrKn7zR3BvvkenFAPRg0SGXfz8POMzwLMBhzj09sKUNTDwP/igCcPggeiyx/BCo='} 2024-01-18T00:50:46.471 INFO:teuthology.orchestra.console.smithi067:Power off 2024-01-18T00:50:46.471 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T00:50:46.489 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-18T00:50:46.489 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T00:50:46.498 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-01-18T00:50:46.498 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:46.513 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-18T00:50:46.513 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:46.521 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-18T00:50:46.535 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-18T00:50:50.523 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:50.537 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:50.634 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-01-18T00:50:50.648 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-18T00:50:54.635 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:54.649 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T00:50:54.745 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-01-18T00:50:54.757 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-18T00:50:54.846 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-01-18T00:50:54.858 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-18T00:50:54.963 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 064ffc2b249f42d6c6a333d6e6f3d5392519ee92 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/valgrind} duration: 11633.249763965607 failure_reason: 'Command failed on smithi067 with status 3: ''sudo logrotate /etc/logrotate.d/ceph-test.conf''' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-01-18T00:50:54.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T00:50:55.037 INFO:teuthology.run:FAIL